A colleague at Anthropic responded by saying the company has no plan to address alignment risks from superintelligence

Jacob Coxon warns that AI could pose an existential threat to humanity after resigning from Anthropic over concerns about the rapid development of advanced AI systems.

CEO Dario Amodei published the warning in the aftermath of the viral resignation of whistleblower Jacob Coxon, who said AI was posing an existential threat to humanity.

He went from obscure AI researcher to notable independent AI critic literally overnight.

Anthropic researcher Jacob Coxon, who raised alarm about OpenAI and Anthropic, has quit, warning that AI labs are 'gambling with our lives'. Coxon, 27, declared his departure in a series of X posts, saying both Anthropic and its rival OpenAI are failing to act responsibly as they race to build advanced AI systems.

Jacob Coxon is a 27-year-old British AI researcher who formerly worked for OpenAI and Anthropic, the companies behind ChatGPT and Claude.

"Sorry, but asking Jacob about AI extinction risk is like asking your AC guy about climate change," Hugging Face CEO Clement Delangue wrote on X.

An Anthropic researcher quit over fears of runaway AI. His colleague who still works there agreed. Security experts argue that the incidents that are already on record call for tighter oversight, not panic.