Ep#83: PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation

Podcast: RoboPapers · Chris Paxton and Michael Cho

Opublikowano: 2026-05-29

Spatial understanding is important to moving around in complex environments and is a huge part of the challenge of generalizing to new scenes. Most world models, however, largely ignore this spatial dimension, focusing on 2D images. Not PointWorld, though. PointWorld is a 3D world model trained from real and simulated data which can perform a wide variety of manipulation tasks on a real robot, including grasping or handling articulated objects, all without any additional fine tuning. Wenlong Huang joins us to tell us more about what makes this work and how it’s different from other world mo...