Anthropic Warns AI Needs Emergency Brake Now

Anthropic, valued at $965 billion, is urging a global pause on AI development, warning that humanity is losing control of the technology. The company offered to suspend its own advanced AI work, citing the looming threat of recursive self-improvement, where AI systems autonomously develop themselves. Executives warn this could happen within two years. Anthropichas already withheld its most powerful model, Mythos, over fears it could enable devastating cyberattacks. However, the company acknowledged that a global freeze faces near-impossible coordination challenges, requiring rivals like the US and China to agree on identical terms. Critics argue Anthropic is exaggerating risks to stifle competition.