TeleopXR

TeleopXR transforms virtual reality (VR) and augmented reality (AR) headsets into precise robot controllers, offering an innovative solution for robotic teleoperation. This lightweight platform provides an installation-free teleoperation interface equipped with low-latency video streaming and comprehensive WebXR state tracking, making it ideal for real-time robot control.

Key Features

• VR/Passthrough Interaction: Effortlessly toggle between immersive VR and AR Passthrough modes, allowing users to either fully engage in the virtual environment or maintain situational awareness.
• WebRTC Video Streaming: Experience ultra-low latency, real-time video feedback directly in the headset, establishing a near-instantaneous visual connection to the robot.
• Robot Visualization: Utilize real-time 3D visualization to keep the digital representation of the robot perfectly synchronized with its physical counterpart.
• Whole-Body Inverse Kinematics (IK): Achieve intuitive control of robot movements through advanced IK techniques, simplifying complex coordination tasks.

Quick Start Demo

Utilize the built-in demo to confirm connectivity and visualize XR state data in real-time.

Documentation

For further insights on integrating TeleopXR into various projects, including details on the Generic Python API and ROS2 Interface, consult the official documentation: here.

Development Information

Developers can contribute to TeleopXR by following the set prerequisites and setup instructions found in the documentation. Key requirements include Python 3.10+, supported libraries, and Node.js for frontend development.

For those looking to customize or extend the project, extensive guidelines and prerequisites are provided to ensure a smooth development experience. TeleopXR is built on solid foundations, drawing inspiration and support from established robotics libraries such as Pyroki and Ballpark, which enhance its functionality in inverse kinematics and collision detection.