Assessing information transfer in full mission flight simulations

Considerable attention must be given to the important topic of aircrew situation awareness in any discussion of aviation safety and flight deck design. Reliable means of assessing this important aspect of crew behavior without simultaneously interfering with the behavior are difficult to develop. Unobtrusive measurement of crew situation awareness is particularly important in the conduct of full mission simulations where considerable effort and cost is expended to achieve a high degree of operational fidelity. An unobtrusive method of assessing situational awareness is described here which employs a topical analysis of intra-crew communications. The communications were taken from videotapes of crew behavior prior to, during, and following an encounter with a microburst/windshear event. The simulation scenario re-created an actual encounter with an event during an approach into Denver Stapleton Airport. The analyses were conducted on twelve experienced airline crews with the objective of determining the effect on situation awareness of uplinking ground-based information of the crew during the approach. The topical analysis of crew communication was conducted on all references to weather or weather-related topics. The general weather topic was further divided into weather subtopical references such as surface winds, windshear, precipitation, etc., thereby allowing for an assessment of the relative frequency of subtopic reference during the scenario. Reliable differences were found between the relative frequency of subtopic references when comparing the communications of crews receiving a cockpit display of ground-based information to the communications of a control group. The findings support the utility of this method of assessing situation awareness and information value in full mission simulations. A limiting factor in the use of this measure is that crews vary in the amount of intra-crew communications that may take place due to individual differences and other factors associated with crew coordination. This factor must be taken into consideration when employing this measure. Viewgraphs are given.