077 - What Is AI Training?

Opublikowano: 2026-10-07

How does an AI model learn in the first place? This episode builds on the show's earlier episodes on tokens, embeddings, attention, and Transformers to explain training: the process that turns a model's huge collection of adjustable parameters into something useful. For a language model, training centers on a surprisingly simple task: predicting the next token. Using the illustrative example "The cat sat on the...", the episode shows a model producing probabilities across possible next tokens, with the gap between its prediction and the correct answer measured by...