AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells

Here is a story making headlines in the economy: AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells Figure caption, 'There is a possibility of human extinction,' former Anthropic employee says about AIByBrandon Livesay and Mitchell Labiak, business reporterPublished13 September 2026An artificial intelligence researcher who quit AI firm Anthropic has said people working on the technology were "genuinely frightened" about the speed of its advancements and what it could mean for humanity. "I believe that if we don't slow down at the current rate of progress, there is a strong chance that we could all die in the immediate future," he said. Jacob Coxon was speaking to the after his resignation post on the dangers of AI went viral on a backdrop of growing safety concerns about the industry.

The 27-year-old's former boss, Anthropic head Dario Amodei, recently called for AI development to slow down - though some have questioned the motivations behind this. The bosses of two rival AI firms, Sam Altman of OpenAI and Elon Musk of xAI, have both said they agree with Amodei's proposal for industry-wide deceleration and regulation, as well as independent monitoring of AI model development. Amodei wrote in an essay on Saturday that developing the technology was not in question, but the risks associated with it were "serious", and that companies and governments must be given time to address them.

Economic Details

Coxon – who worked at OpenAI before joining Anthropic – welcomed the suggestion of a slowdown but said it would need to be co-ordinated with China to avoid "a race at an international scale". "The people who work at these companies are completely serious when they ask for regulation because they find themselves trapped in a race. And they're scared of the outcomes of that race," he told Sunday with Laura Kuenssberg.

Anthropic boss Dario Amodei calls for AI development to slow down Published1 day agoThe hardest question to answer, according to Coxon, was what an AI apocalypse would look like. One of the risks outlined in Amodei's comments was of a swarm of bots acting like a supercomputer that could take over the internet. Coxon said this scenario could be realistic in six months to a year.

In response to Coxon's departure, an Anthropic spokesperson told News: "We have always been transparent that AI will bring both enormous benefits and unprecedented risks. "To address these risks, we continue to build models with some of the strongest safeguards in the industry. "The firm has been a pioneer in studying how AI models work, the spokesperson added.

It was the first to publish a framework for mitigating the risks posed by their development - and it also "aggressively" tests its models and publishes the findings to aid scrutiny and prevent incidents of "AI misalignment". "This work is also why we believe the world would benefit from the industry adopting a lawful, verifiable way to work together to pace how we release powerful models," they said.

Economists are analysing what the news means for the markets.