XR Teleoperation Demo Development

Abstract

This thesis designs an educational real-time visual feedback teleoperation demonstration. The importance of a good user experience is highlighted while showcasing the feasibility of using open-source solutions such as Godot Engine version 4 for teleoperation setups. Reviewed literature narrowed design requirements, outlining that a representative teleoperation demonstration could provide a positive experience, intuitive movement control, direct real-time visual feedback for teleoperation and be open-sourced, with user and video stream evaluations as research objectives. Employing design thinking, 'RoverXR' is iteratively developed with M5 RoverC-Pro for movement and serving WebSocket protocol real-time Motion JPEG high-definition video from Raspberry Pi v2.1 Camera Module via a Raspberry Pi Zero. Custom MPV player and Godot scenes were prepared, featuring video stream playback and providing a virtual user interface on the Meta Quest 2 headset. User evaluation participants report a positive, engaging experience and provide helpful feedback, showcasing the potential of low-latency, high-quality video streaming, and virtual scene representation in teleoperation demonstrations for educational purposes.