TheBitCast

1025: Word Gravity: How Transformers Bend Space, with Dr. Luis Serrano

Podcast: Super Data Science: ML & AI Podcast with Jon Krohn · Jon Krohn

Opublikowano: 2026-09-08

In Episode #1025, Dr. Luis Serrano (Founder of Serrano Academy) joins Jon Krohn to explain the paper he co-authored on the curved spacetime of transformer architectures, in which attention stops being a lookup table and becomes something closer to gravity: words bend the space around them, and the embedding of "bank" visibly curves toward "river" as it travels through the layers of the network. In this episode, he recreates Eddington’s 1919 eclipse experiment inside a transformer, draws the line between an LLM workflow and an actual agent, explains why agent evaluation is a step harder than evaluating an essay, and gi...