Urbex: Can Agentic VLM Search Improve City-Scale 3D Grounding?

Podcast: Embodied AI 101 · Shaoqing Tan

Opublikowano: 2026-10-14

Can an agentic vision-language model search a 3D city more effectively than a system that ranks candidate objects? This episode examines what Urbex improves, how its visual tools and reinforcement learning work, and where the evidence stops short of robotic deployment. We cover three central questions: why landmark lookup, zooming, and oblique views help; why higher Hit@1 does not necessarily mean accurate 3D boundaries; and what the released code reveals about training and evaluation reproducibility. Urbex operates on prepared urban point clouds and rendered views, including real photogrammetry scenes, rather than demonstrating closed-loop control on a physical robot. Its strongest...