VPP2: Does Better Video Prediction Improve Robot Manipulation?

Podcast: Embodied AI 101 · Shaoqing Tan

Opublikowano: 2026-10-12

Can better video prediction make a robot manipulation policy more general? This episode examines what VPP2's experiments establish, how its training pipeline works, and where the causal story remains incomplete. We cover three questions: why complete manipulation events may provide better supervision than fixed video fragments; what the real-world ALOHA and simulation results say about generalization; and what the public implementation actually enables a robotics team to reproduce. The method combines manipulation-focused video pretraining, fixed-horizon adaptation, distillation, and a transformer action expert. Evaluations span real ALOHA manipulation and benchmark-specific policies for LIBERO and RoboDojo simulation. The central limitation is...