HexaShell: Can Debugging Code Generalize RGB Robot Manipulation?

Podcast: Embodied AI 101 · Shaoqing Tan

Opublikowano: 2026-10-19

Can a robot improve at manipulation by debugging code instead of updating neural-network weights? This episode explains how HexaShell turns robot experience into reusable tools, and what its RoboDojo score actually establishes. We cover three questions: how calibrated RGB observations become metric positions; why the reported 39.7% success rate uses category-balanced scoring; and how holding out layouts differs from holding out tasks. The experiments use a simulated dual-arm ARX X5 with head and wrist cameras, camera calibration, and proprioception. Along the way, we connect the design to Code as Policies and URAI, examine an inspectable geometric helper, and separate tool development...