Daily Tech Wizard Newsletter

Stories / / By Daily Tech Wizard

Headset-controlled humanoid robot catches a tossed ball

This humanoid robot can catch a tossed ball.

A humanoid robot caught a tossed ball while being controlled through a headset, with about 20 ms between headset streaming and policy output.

Controlling a humanoid in real time is hard because the software that translates a human's motion into robot motion adds delay. Optimization-based retargeting pipelines and conditioning on future frames both contribute.

Existing motion tracking policies typically want dense reference targets: full joint positions, body-part transformations, and even future frames. That ties the controller to expensive upstream modules.

HuMiT, a whole-body teleoperation system, takes a different route. Its tracking policy needs only root height, root velocity, and the SE(3) poses of four sparse keypoints at the current frame. The researchers report tracking fidelity competitive with methods that use richer reference states.

A video-based optical flow measurement puts the median latency at 65 ms across different motion types. The team validated the system on a Unitree G1 humanoid, and the system showed split-second reactive responses and coordinated loco-manipulation.

The paper comes from Liu Cao, Botian Xu, Ruoqu Chen, Jiajun Liu, Mingzhi Pei, Zihao Wang, Zhongyu Li and Mengdi Xu, submitted to arXiv on 21 October 2026.

Would you trust a headset to steer a robot in real time?

Archive video: InsideScience – Öffentliche Wissenschaft in Sonderforschungs, CC BY 3.0 (Wikimedia Commons); NASA

Video: xiaohu-art.github.io/Track