Scenario-Based Task Design for Airline Pilot Anticipatory Behaviors: Asynchronous Assessment of Complex Cognitive Skills

Airline pilots must anticipate potential threats to passenger safety and efficient flight. Such anticipation needs to occur at both the system and individual levels, yet no formal training for these anticipatory behaviors currently exists. The emerging field of resilience engineering provides a framework to explore this problem.

Given the complex nature of this problem, the assessment portion of the project constituted a challenge. Simulator time is expensive as simulators are costly to run, and they are extremely limited in number. Also, by the nature of their work, pilots as a group are hard to connect with in person; thus, asynchronous methods were adopted. Further, to ensure that authentic pilot behaviors were observed, task-based scenarios were used rather than focus group or interview protocols.

This session explores the design of asynchronous learning and a measure for assessing pilot anticipatory behaviors outside of a simulator to help design learning opportunities for pilots. The scenario-based and active assessment items will be discussed in detail, and demonstrations of these items will be shared. These items constitute the bulk of the challenge for this work. At the time of this writing, data is being collected to assess the effectiveness of the interactive training module and validate the measures. This data will be analyzed and presented as part of the session. This will include any linkages between the scenario-based and traditional assessment items.