Deep-reasoning fault diagnosis - An aid and a model

The design and evaluation are presented for the knowledge-based assistance of a human operator who must diagnose a novel fault in a dynamic, physical system. A computer aid based on a qualitative model of the system was built to help the operators overcome some of their cognitive limitations. This aid differs from most expert systems in that it operates at several levels of interaction that are believed to be more suitable for deep reasoning. Four aiding approaches, each of which provided unique information to the operator, were evaluated. The aiding features were designed to help the human's casual reasoning about the system in predicting normal system behavior (N aiding), integrating observations into actual system behavior (O aiding), finding discrepancies between the two (O-N aiding), or finding discrepancies between observed behavior and hypothetical behavior (O-HN aiding). Human diagnostic performance was found to improve by almost a factor of two with O aiding and O-N aiding.