94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati

Podcast: The Neon Show · Siddhartha Ahluwalia

Opublikowano: 2026-06-09

Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom. We discuss a simple question: Who wins when models become cheaper and more abundant? And try to answer this by looking at how inference spend v/s compute spend is shifting, and why inference may become the biggest i...