TheBitCast

071 - What Is AI Temperature?

Podcast: Learn AI in Bits · Dan W

Opublikowano: 2026-10-01

Why does an AI sometimes give different answers to the exact same prompt? This episode explains temperature, the sampling setting behind that familiar slider in AI tools and APIs, and what it's controlling under the hood. A language model generates text one token at a time, and at each step it has a probability distribution over possible next tokens. Temperature controls how that distribution is sampled. OpenAI's own API documentation describes it as a measure of how often the model outputs a less likely token, with a range from zero to...