NASA Logo

NTRS

NTRS - NASA Technical Reports Server

Back to Results
PHI-NOM: Physics-Based Hand Interactions for Natural Object Manipulation in Virtual RealityTraining for space missions or surgical procedures is inherently expensive, logistically complex, and resource-intensive, making immersive virtual reality (VR) an appealing alternative for rehearsing mission-critical tasks. However, current VR systems often rely on handheld controllers or gesture recognition, failing to simulate the physics necessary for equipment handling and assembly tasks. This paper introduces PHI-NOM (Physics-Based Hand Interactions for Natural Object Manipulation). This controller-free VR framework provides biomechanically accurate, real-time hand interactions by modeling fingertip contact and grasp physics. Built using motion capture and Unreal Engine, PHI-NOM employs a new algorithm for physics-based object manipulation, enabling natural actions such as grasping, lifting, rotating, and passing objects without the need for controllers, predefined gestures, or intermediary devices. Unlike existing methods that rely on computationally intensive inverse kinematics or physics solvers, PHI-NOM achieves low computational overhead through a lightweight model that provides visually accurate real-world physics. This design enables real-time interaction, supports diverse object geometries, allows for two-handed manipulation, and facilitates both individual and collaborative training scenarios, including cooperative tool use and system assembly. By enhancing tactile realism, PHI-NOM promotes motor learning and improves skill transfer from virtual to real-world environments.
Document ID
20250004916
Acquisition Source
Kennedy Space Center
Document Type
Conference Paper
Authors
Phi Nguyen
(OSTEM Intern)
Wessley Dennis
(Kennedy Space Center Merritt Island, Florida, United States)
Antonio Pego
(Kennedy Space Center Merritt Island, Florida, United States)
Date Acquired
May 12, 2025
Subject Category
Computer Systems
Meeting Information
Meeting: 6th Augmented, Virtual, and Mixed Realities Workshop: xR Technologies in Digital Engineering Environments
Location: Los Angeles, CA
Country: US
Start Date: July 30, 2025
End Date: July 31, 2025
Sponsors: Institute of Electrical and Electronics Engineers (IEEE)
Funding Number(s)
OTHER: NONE
Distribution Limits
Public
Copyright
Public Use Permitted.
Technical Review
Single Expert
Keywords
Hand-Object Manipulation
Virtual Reality
Simulation Training
No Preview Available