A Virtual Reality Planning Environment for High-Risk, High-Latency Teleoperation

In-Space Servicing, Assembly, and Manufacturing has the potential to enable larger-scale and longer-lived infrastructure projects in space. Servicing in particular has the potential to vastly increase the usable lifetimes of satellites, both newly launched and existing. However, some of these servicing tasks require delicate manipulation and, to apply to existing satellites, need to be able to operate on structures that were not designed for servicing and, in some cases, where the exact shape of the structure is not known in advance. For this reason, human-in-the-loop ground-based teleoperation is the only option for some missions.

Ground-based teleoperation presents its own difficulties. In addition to the challenge of performing delicate operations in constrained spaces, communication with the servicing platform is subject to a variable time delay on the order of 2-7 seconds, and the only visual feedback comes from camera views with limited situational awareness and viewing angles.