Hydra-0: Action Flow for Generalist World Modeling and Control

TL;DR

Hydra-0 is a generalist world model that represents robot actions as pixel motion, enabling generalist world modeling and control. It achieves lower robot-motion and object-motion errors than the baseline. Hydra-0 supports zero-shot composition and data-efficient adaptation.

Why It Matters

Hydra-0's action flow interface has potential for connecting heterogeneous training data and robot control. This can lead to more efficient and adaptable robot learning. It also enables open-loop policy evaluation and zero-shot composition.

Key Findings

• 90.4% lower robot-motion error
• 60.2% lower object-motion error
• emergent inverse mode for predicting robot motion