SOLE-R1: Can Video-Language Rewards Train Manipulation Policies?

Podcast: Embodied AI 101 · Shaoqing Tan

Opublikowano: 2026-10-11

Can a robot learn manipulation from random actions using only rewards generated from video? This episode explains what SOLE-R1 demonstrates, how its reward model is trained, and where its generalization claims need qualification. We examine three questions: why realistic failure coverage matters beyond reversed demonstrations; what the reasoning and reinforcement-learning ablations actually establish; and whether benchmark success translates into a practical on-robot learning system. The discussion connects video-language reward modeling with off-policy reinforcement learning across simulated manipulation benchmarks and physical Franka experiments. We also compare SOLE-R1's operating regime with RoboReward, Robometer, and ReWiND, rather than treating their results as...