In a weekend essay, Anthropic CEO Dario Amodei argued for restraining how quickly large language models are built, pointing to risks he believes the technology poses. The piece adds to a broader shift in the AI industry toward warnings about catastrophic outcomes, prompting debate over what should follow.
A researcher who previously worked at OpenAI has resigned from Anthropic, saying neither company is handling the technology responsibly. He also noted that many of the people developing advanced AI genuinely believe it poses an existential risk to humanity. The departure adds to ongoing internal dissent over safety practices at leading AI labs.
Jacob Coxon, who is leaving Anthropic, used a CNN appearance to argue that AI systems capable of improving themselves represent an existential risk to humanity. Other safety staff at Anthropic and OpenAI reportedly hold similar concerns, and the topic has since drawn attention from US politicians and podcaster Joe Rogan. The report notes that cultural and financial factors also shape how the debate is being framed.
Three researchers at Anthropic have publicly stated that artificial intelligence could lead to human extinction within roughly ten years if left unregulated. One of the researchers reportedly resigned from the company in protest. The warnings add to ongoing debate about safety risks and government oversight of advanced AI systems.
OpenAI has added Paul Christiano, a well-known researcher who works on AI alignment and existential risk, to the board of its foundation. The appointment brings a prominent voice focused on safety and long-term risk into the organization's governance. Christiano is known for his work on aligning machine learning systems with human intent and for founding the Alignment Research Center.
A researcher at Anthropic has left the company while publicly cautioning about the dangers of AI systems that can improve themselves. The departing employee said concerns about catastrophic outcomes for humanity are sincerely held within the field, not just rhetorical. The resignation adds to ongoing debate about safety practices at leading AI labs.