TheBitCast

Smart Brevity 2: Measure the decision, not just the outcome

Podcast: Smart Brevity · Jamiepluscoffee

Opublikowano: 2026-09-26

Measure the decision, not just the outcome; Regularized harness self-improvement: auto-tuned agent harnesses overfit unless edit size, specificity and bloat are constrained.; Decision-fork evals: grade an agent's choices at branch points; longer thinking does not improve taste, distillation does.; Instance-aware rubric rewards: a per-prompt checklist scored item by item works as eval and RL reward.; Full-duplex voice with async delegation: the frontend keeps talking while a background harness runs tools.; KV cache from zero, plus shrinking it by architecture and splitting prefill from decode.; Parallel test-time compute: many agents plus a verifier as a separate scaling a