1020: How to Choose Model Size and Effort Level: The Two Critical Dials

Podcast: Super Data Science: ML & AI Podcast with Jon Krohn · Jon Krohn

Opublikowano: 2026-08-21

In Episode #1020, Jon Krohn unpacks the two dials that increasingly decide what you get out of a large language model: which model size you pick and how much effort you tell it to spend. Using a July Anthropic blog post by Claude Code’s Lydia Holly as a jumping-off point, with guidance that generalizes to any model family, Jon explains what each setting actually does under the hood. Model size swaps which frozen weights handle your request (roughly, how capable), while effort sets how thorough and certain the model must be before calling a task done, not a simple “thin...