Human-in-the-Loop Evaluations: Process and Mockup Fidelity

Human-in-the-loop (HITL) evaluations are iterative events used during design and
development to identify issues with the implementation of human systems integration. HITL
evaluations involve human test subjects who are user-representative participants performing
activities with representative hardware, software, and procedures. The paper will describe the
process by which HITL evaluations can be implemented in a program or project. This will
include definitions for developmental and verification HITL evaluations, levels of mockup
fidelity, and certification of HITL articles. The proposed process can be tailored depending
on the type of HITL evaluation being conducted. It is highly recommended that findings are
timely reported and incorporated in the hardware and/or software design.