Evaluation of Electronic Formats of the NASA Task Load Index

Paper questionnaires are being replaced by electronic questionnaires. The primary objective of this research was to determine whether electronic formats of paper questionnaires change subjects ratings and, if so, how the ratings changed. Results indicated that there were no statistically significant differences in self-assessment of workload when using the electronic replica or the paper format of the NASA-TLX scale. Variations of the electronic formats were tested to enforce structure to the TLX scale. Respondents had more consistent ratings with these alternative formats of the NASA-TLX. Non-pilots, in general, had lower workload ratings than pilots. The time to input the rating was the fastest for the electronic facsimile and random title formats. Also subjects preferred the electronic formats and thought these formats were easier to use. Therefore, moving questionnaires from paper to electronic media could change respondents' answers.