Smart Brevity 3: Your training signal has a shape, and it can lie: who teaches, how loudly, and who checks

Podcast: Smart Brevity · Jamiepluscoffee

Opublikowano: 2026-10-03

Your training signal has a shape, and it can lie: who teaches, how loudly, and who checks; On-policy distillation scaling: small RL teachers can lift bigger students past themselves; Multi-teacher distillation: normalize each teacher's feedback spread or the loudest domain wins; RIDE: extrapolate the RL direction in hidden states, not in word probabilities; Co-cheating: self-play loops reward shared errors; cross-fitted graders break the echo; Decision models: calibrated classifiers as cheap routers and eval judges; UCB tree search over experiment notebooks, and the reward hacking it invites; Environment interaction shape decides what skills transfer; Cost per completed t