Worried about AI's Self-Evolution, Anthropic Intends to Stop Training?
In early 2026, Anthropic signaled a significant shift in its public narrative regarding AI development timelines and safety. In June, its Anthropic Institute published a detailed article, "When AI builds itself," presenting internal data suggesting accelerating AI self-improvement. Key figures included over 80% of merged code being written by Claude and a 52x speedup in certain optimization tasks. The article outlined three future scenarios, with the most speculative being full recursive self-improvement (RSI), where AI autonomously builds better successors. Anthropic stated RSI is "possible" and may arrive faster than most institutions are prepared for.
This narrative pivot followed a series of strategic moves. In January, CEO Dario Amodei wrote about a powerful self-improvement feedback loop. In February, Anthropic revised its Responsible Scaling Policy, removing a core commitment to pause training if capabilities outstripped safety controls, citing the risk of falling behind competitors. This change coincided with reported pressure from the US Department of Defense. By May, Anthropic's valuation had soared to $965 billion.
Anthropic's stance was mirrored by other industry leaders. DeepMind CEO Demis Hassabis adjusted his AGI timeline to "by 2029" and admitted to using provocative language like "foothills of the singularity" to create urgency. OpenAI also released a model claiming a key role in its own creation process.
The article's carefully calibrated tone—presenting dramatic data alongside qualifying footnotes—exemplifies a balancing act between signaling technological acceleration and managing commercial, regulatory, and safety imperatives. External experts offered contrasting interpretations of the same data, from warnings of catastrophic risk akin to Chernobyl to skepticism that current automation merely handles "grunt work," not genius. The coordinated narrative shift among top labs highlights the complex interplay between perceived technical inflection points and strategic communication aimed at investors, regulators, and the public.
marsbit16 min fa
