They were triggered by warnings from researchers at Anthropic that there were credible fears within the company that AI could wipe out humanity in a matter of years. It is unusual, to say the least, for people within a firm to publicly air such doomsday warnings about their most cutting-edge products.

Jacob Coxon, who resigned over concerns about rapid AI development, said building a superintelligence is like “summoning an alien species.”

The head of the artificial intelligence company calls the exponential rate of AI developments a "warning sign," with risks for humanity, and says, "We need to slow down." He talks with "Sunday Morning" about possible steps forward.

"So these AIs are getting smarter, very, very quickly. And in particular, in the next six months to a year, I expect the capabilities of our AI systems to be quite scary."

Anthropic CEO Dario Amodei compared the AI race with China to Cold War nuclear tensions, urging arms limitation-style talks to slow growing technology.

In a lengthy essay published Saturday morning, Anthropic CEO Dario Amodei said that the AI industry needs to deliberately slow the pace of AI development. Amodei proposed a three-point plan he's calling "pacing the frontier," and it is a striking message from the head of a company racing toward what could be the largest IPO in history.

Dario Amodei created the artificial intelligence lab to be protected from the very threat it is facing.

Monday, September 14. Anthropic says it cut off access to its Claude assistant in several cases it considered sensitive. The U.S. company says it identified research that could contribute to the development of biological weapons,