"“Alignment Engineering” vs. “Misalignment Science”" by Edward James Young

Podcast: LessWrong (Curated & Popular) · LessWrong

Opublikowano: 2026-10-05

There has been much discussion recently around whether a large portion of alignment research is net negative. Without endorsing or refuting them, the basic arguments here are: Prosaic alignment of models is becoming a bottleneck for capabilities.Therefore improving the prosaic alignment of models enables faster capabilities advances, which bring us closer to RSI.It is unlikely these prosaic alignment methods remain sufficient during the RSI loop, and so this work brings us closer to doom.Furthermore, dealing with these more prosaic failures reduces the likelihood of a warning shot of sufficient magnitude to cause a slowdown which...