"Labs’ current alignment plans seem terrible" by Daniel Tan, draganover, nicole x

Podcast: LessWrong (Curated & Popular) · LessWrong

Opublikowano: 2026-10-13

Tl;dr: The frontier AI companies’ implicit alignment plans center on rushing towards RSI with something like current models. This plan is (at best) contentious, and many believe it will have catastrophic consequences. Nonetheless, it is the track we are on. It is therefore important to collect evidence which helps us anticipate how this will go. — Note: This post is based on conversations inside the Arcadia Impact alignment team, thinking about what constitutes “good” work in third-party alignment research. What are the labs’ current alignment strategies? In practice, the labs’ playbook for producing al...