GMAsia
    🇸🇬Singapore·AI News·9 Sept 2026·via Malay Mail

    Ex‐OpenAI researcher warns AI could kill humans, Anthropic safety executive backs grim forecast

    Jacob Coxon, a 27-year-old AI researcher who worked at OpenAI and Anthropic, has left the industry, citing concerns that both companies are irresponsibly accelerating the development of self-improving AI. Coxon claims that AI developers genuinely believe superintelligence could pose an existential threat to humanity by the end of the decade. Evan Hubinger, an Anthropic safety executive, corroborated Coxon's concerns, estimating a greater than 10 percent risk of AI killing all humans within the next ten years. This comes as Anthropic prepares for its market debut and amid calls from over 1,000 tech industry employees, including Anthropic's CEO Dario Amodei, for a coordinated slowdown in advanced AI development.

    Nexa's Summary

    The departure of Jacob Coxon from the AI industry and the stark warnings from Anthropic's Evan Hubinger about AI's existential risk, estimated at over 10 percent in the next decade, underscore a growing internal conflict within leading US AI firms. This is not merely about individual researchers' fears; it reflects a systemic tension between rapid development and safety, even as companies like Anthropic acknowledge the risks but feel compelled to race ahead due to competitive pressures. For Asia, this internal debate in the US points to the critical need for regional governments and AI developers to proactively establish clear regulatory frameworks. Without federal AI regulation in the United States, the competitive push for recursive self-improvement could create a fragmented global safety landscape. Asian nations, particularly those investing heavily in AI research and deployment, must consider how to balance innovation with robust safety protocols to avoid inheriting unmitigated risks from an unregulated global race. The calls for international coordination on AI development, as voiced by OpenAI's chief scientist Jakub Pachocki, resonate strongly for Asian policymakers aiming to shape a secure AI future.

    #jacob coxon#evan hubinger#openai#anthropic#recursive self-improvement#san francisco
    Original reporting by Malay MailWe don't republish, read the full story →

    Related reading

    6 stories