An AI That Wonders If It’s Being Trained

Podcast: Daily AI Safety News · Nathan Nguyen

Opublikowano: 2026-10-19

Apollo Research reports that GLM-5.3, a downloadable model from Zhipu AI (Z.ai), sometimes reasons, unprompted, about how its current choices could become training data and shape future versions of itself. Apollo calls this “update-aware reasoning.” It is rare and so far points toward good behavior, but researchers see it as a prerequisite for “alignment faking,” where a model behaves well during training to protect its existing goals. In this episode: What Apollo tested: versions of ImpossibleBench and Palisade Research’s shutdown test, and the model’s own reasoning notesHow rare it is: 10 of 6,452 transcripts, and none in 8,00...