X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting
This paper presents X-OP, a hierarchical whole-body teleoperation framework using a single XR device that generalizes across robot morphologies without retraining. It features an MPC-based motion retargeter jointly optimizing operator intent and dynamic feasibility, with state synchronization and SLAM feedback for robust execution. Simulations show over 30% faster task completion and 20% lower power consumption for a humanoid, and zero collisions for a mobile manipulator. Real-world experiments confirm effectiveness and user adaptability. The plug-and-play framework enables scalable, morphology-agnostic teleoperation with real-time behavior customization.
[2606.07934] X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting
[Submitted on 6 Jun 2026]
Title:X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting
View a PDF of the paper titled X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting, by Jen-Wei Wang and 3 other authors
View PDF HTML (experimental)
Abstract:Whole-body teleoperation is essential for scalable robot data collection in loco-manipulation tasks, yet existing approaches relying on exoskeleton suits or multi-camera setups impose prohibitive cost, complexity, and environmental constraints. Recent methods using a single extended reality (XR) device with end-to-end reinforcement learning policies partially address these limitations but require robot-specific retraining, suffer from out-of-distribution failures, and rely on motion retargeting that neglects dynamic feasibility. We propose a hierarchical whole-body teleoperation framework driven by a single XR device that generalizes across diverse robot morphologies without retraining robot-specific policies. A Model Predictive Control (MPC)-based motion retargeter jointly optimizes alignment with the operator's intent and the robot's dynamic feasibility, generating optimal commands for existing low-level controllers. To ensure robust online execution, we introduce a state synchronization method that resets the simulator state at each MPC step to handle noisy real-world measurements and contact sensitivity, and integrate SLAM-based global pose feedback to mitigate long-term drift. Simulation results show higher success rates on whole-body control tasks for both a humanoid (over 30% lower completion time and 20% lower power consumption) and a mobile manipulator (zero collisions) compared to baselines. Real-world experiments further validate the effectiveness and flexibility of our method, demonstrating the successful deployment of the proposed retargeter on both platforms for whole-body control tasks and the ease of allowing users to adjust teleoperation behavior based on their preferences. This plug-and-play framework offers a scalable, morphology-agnostic solution for whole-body robot teleoperation, enabling real-time behavioral customization and broad applicability across platforms.
Comments: 9 pages, 4 figures
Subjects:
Robotics (cs.RO)
Cite as: arXiv:2606.07934 [cs.RO]
(or arXiv:2606.07934v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2606.07934
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Sarthak Ranjeet Kaingade [view email] [v1] Sat, 6 Jun 2026 01:50:59 UTC (672 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting, by Jen-Wei Wang and 3 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.RO
new | recent | 2026-06
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
Loading...
Data provided by:
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)