An evaluation of strategic behaviors in a high fidelity simulated flight task - Comparing primary performance to a figure of merit

The usual method of evaluating flight performance during a simulation is to collect as many primary performance measurements as possible. Then analyze all the measurements to find one sensitive to the manipulations imposed on the pilot during the scenario. Although this method can be useful, it is usually unreliable from one study to another. A simulation was conducted to test an integrated figure of merit (FOM) constructed using a standardized procedure. Pilots flew two full-mission scenarios in an instrument trainer with three degrees of motion freedom. The primary performance measurements selected assessed the pilot's performance in accuracy, smoothness, and activity. The results suggest that the integrated FOMs performed comparably to the primary performance measurements in determining which flight imposed the higher demands on the pilot. The standardized construction process allow adjustments to the FOM, so it can be used in different applications.