1028: The Chip Built for Agentic AI Inference, with SambaNova's Anton McGonnell

Podcast: Super Data Science: ML & AI Podcast with Jon Krohn · Jon Krohn

Opublikowano: 2026-09-18

In Episode #1028, Anton McGonnell (VP of Product at SambaNova) joins Jon Krohn to explain why the chips running most AI inference today were never designed for the job. Agentic AI has changed the computational profile of inference, with much larger inputs and far heavier caches feeding the token generation that follows, and that shift has exposed where GPU architecture struggles. SambaNova has raised over $2 billion to build an alternative, the reconfigurable dataflow unit, which lays a whole model out spatially across the chip rather than executing it kernel by kernel. In this episode, Anton discusses why the speed that...