NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
Automatic Facial Expression Recognition and Operator Functional StateThe prevalence of human error in safety-critical occupations remains a major challenge to mission success despite increasing automation in control processes. Although various methods have been proposed to prevent incidences of human error, none of these have been developed to employ the detection and regulation of Operator Functional State (OFS), or the optimal condition of the operator while performing a task, in work environments due to drawbacks such as obtrusiveness and impracticality. A video-based system with the ability to infer an individual's emotional state from facial feature patterning mitigates some of the problems associated with other methods of detecting OFS, like obtrusiveness and impracticality in integration with the mission environment. This paper explores the utility of facial expression recognition as a technology for inferring OFS by first expounding on the intricacies of OFS and the scientific background behind emotion and its relationship with an individual's state. Then, descriptions of the feedback loop and the emotion protocols proposed for the facial recognition program are explained. A basic version of the facial expression recognition program uses Haar classifiers and OpenCV libraries to automatically locate key facial landmarks during a live video stream. Various methods of creating facial expression recognition software are reviewed to guide future extensions of the program. The paper concludes with an examination of the steps necessary in the research of emotion and recommendations for the creation of an automatic facial expression recognition program for use in real-time, safety-critical missions
Document ID
20130008635
Acquisition Source
Langley Research Center
Document Type
Conference Paper
Authors
Blanson, Nina
(Yale Univ. New Haven, CT, United States)
Date Acquired
August 27, 2013
Publication Date
March 1, 2012
Publication Information
Publication: Selected Papers Presented at MODSIM World 2011 Conference and Expo
Subject Category
Systems Analysis And Operations Research
Distribution Limits
Public
Copyright
Public Use Permitted.
No Preview Available