068 - What Is Inside a Model Like Claude?

Opublikowano: 2026-09-27

What is inside a model like Claude, from the moment you type a question to the answer it gives back? This episode walks through the pieces that make up that experience: tokens and parameters, the Transformer architecture and its attention mechanism, post-training, and the software layer wrapped around the model, alongside Anthropic's own interpretability research into what's happening inside the network. Claude is built around the Transformer architecture, and the episode is upfront about a limit: Anthropic has publicly described its models as Transformer-based but doesn't publish every architectural detail of...