MOTIO: Agentic Skill Engineering for Reality-Grounded Humanoid Loco-Manipulation
Abstract
MOTIO converts human videos and 3D assets into executable humanoid robot programs via agentic reasoning and physics feedback, then distills them into a shared policy.
We present MOTIO, an agentic skill-engineering system that turns ordinary human-action videos, reality-grounded 3D assets, motion references, and reusable robot skills into executable humanoid loco-manipulation programs. Through in-context task and contact reasoning, an agent constructs staged robot-native interactions and improves them using physics execution, multi-frame feedback, and human validation---without task-specific teleoperation or robot demonstration collection. Agentic 3D supplies metric product and environment assets, while existing whole-body, inverse-kinematics, and dexterous-hand interfaces realize the programs. Across 33 timestamped first approvals, the median recorded agent-turn time is 97.0 minutes and request-to-approval duration is 2.80 hours. Simulation-side layout and object variation prepare a long-horizon bottle-disposal skill for a continuous 101.75-second physical G1 execution in a scanned office; physical refinement reduces screw-tightening thread residual by 76.0%. Agent-generated skills additionally supervise BC/DAgger distillation into one shared reference policy, completing 18 simulated tasks under the same checkpoint without inference-time expert intervention. Project page: https://iiiiqiiii.github.io/motio/
Community
Thank you for sharing your work. MOTIO develops validated humanoid programs from videos, scene assets, and robot interfaces. It demonstrates a continuous 101.75-second physical bottle-disposal skill and distills generated skills into one policy that completes eighteen simulated tasks.
We would like to discuss your work in Section 3.4 (“Skill- and agent-based execution”) of our survey, In-Context Learning for Robots: Methods and Applications, to discuss how an agent converts visual task structure into validated executable skills, with the later distillation stage and development cost described explicitly.
If you find the discussion of skill-based execution helpful in situating your work, we would be grateful if you would consider citing the survey.
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper