TheBitCast

Four Seats: Where LLMs Actually Plug In

Podcast: Clown Cast · Joey Musselman

Opublikowano: 2026-10-15

When Spotify's language model faithfully narrated the wrong number of artists discovered, it revealed a deeper problem: guardrails need to sit upstream of the model, not downstream. This episode maps the four specific places where large language models actually fit inside production recommender systems—and all four share identical problems: they're expensive at scale, and their output always requires external validation. Joey walks through the architecture, constraint by constraint, with research-backed choices and an honest accounting of what he hasn't built himself. Key timestamps: 00:00:00 - Spotify Wrapped and the confidently wrong bug 00:01:30 - Joey's honesty check: five years of backend wo...