Preliminary results from the evaluation of Cockpit Resource Management training - Performance ratings of flightcrews

The first data from the NASA/University of Texas Crew Performance project on the behavior of flightcrews with and without formal training in Cockpit Resource Management (CRM) is reported. Expert observers made detailed ratings of 15 components of crew behavior in both line operations and in full mission simulations. The results indicate that such training in crew coordination concepts increases the percentage of crews rated as above average in performance and decreases the percentage rated as below average. The data also show high and unexpected degrees of variations in rated performance among crews flying different aircraft within the same organization. It was also found that the specific behaviors that triggered observer ratings of above or below average performance differed markedly between organizations. Characteristics of experts' ratings and future research needs are also discussed.