Ex‐OpenAI researcher warns AI could kill humans, Anthropic safety executive backs grim forecast
Jacob Coxon, a 27-year-old AI researcher who worked at OpenAI and Anthropic, has left the industry, citing concerns that both companies are irresponsibly accelerating the development of self-improving AI. Coxon claims that AI developers genuinely believe superintelligence could pose an existential threat to humanity by the end of the decade. Evan Hubinger, an Anthropic safety executive, corroborated Coxon's concerns, estimating a greater than 10 percent risk of AI killing all humans within the next ten years. This comes as Anthropic prepares for its market debut and amid calls from over 1,000 tech industry employees, including Anthropic's CEO Dario Amodei, for a coordinated slowdown in advanced AI development.
The departure of Jacob Coxon from the AI industry and the stark warnings from Anthropic's Evan Hubinger about AI's existential risk, estimated at over 10 percent in the next decade, underscore a growing internal conflict within leading US AI firms. This is not merely about individual researchers' fears; it reflects a systemic tension between rapid development and safety, even as companies like Anthropic acknowledge the risks but feel compelled to race ahead due to competitive pressures. For Asia, this internal debate in the US points to the critical need for regional governments and AI developers to proactively establish clear regulatory frameworks. Without federal AI regulation in the United States, the competitive push for recursive self-improvement could create a fragmented global safety landscape. Asian nations, particularly those investing heavily in AI research and deployment, must consider how to balance innovation with robust safety protocols to avoid inheriting unmitigated risks from an unregulated global race. The calls for international coordination on AI development, as voiced by OpenAI's chief scientist Jakub Pachocki, resonate strongly for Asian policymakers aiming to shape a secure AI future.
Related reading
6 stories
Viral: Anthropic Researcher Drops A Bombshell, Quits After Warning Of AI Risks | ‘Gamble With Lives’
We previously reported on an Anthropic researcher quitting over AI risks, echoing the concerns in this article.

Anthropic researcher says more than 10% chance AIcould kill all humans
This earlier piece detailed the Anthropic researcher's grim forecast of AI's existential threat to humanity.

If driverless cars already work, why aren’t they everywhere?

People’s Daily rejects US claims of malicious AI distillation, warns of countermeasures

Databricks to Invest Over US$350 Million in Singapore, Double Its Workforce

