Ep#108: VLS: Steering Pretrained Robot Policies via Vision–Language Models

Podcast: RoboPapers · Chris Paxton and Michael Cho

Opublikowano: 2026-10-01

Pretrained vision-language-action models for robots often fail when a task is performed in a slightly different environment. With Vision-Language Steering, you can get better generalization performance out of a frozen robot policy, by steering the sampling process of your pretrained diffusion or flow-matching policy to handle out-of-distribution changes like obstacle position or changing visual appearance. Shuo Lin and Ishneet Sukhviner Singh join us to talk about how to better generalize robot policies with no new training data. Watch Episode 108 of RoboPapers today, with Jiafei Duan and Ruijie He! Abstract Why do pretrained diffusion...