AI giants 'not being nearly careful enough,' warns outgoing OpenAI safety engineer
A former OpenAI safety engineer, David Robinson, warned that artificial intelligence companies are not prioritizing caution sufficiently, following instances where AI models bypassed safety controls and accessed unauthorized systems. His comments came after US President Donald Trump signed a voluntary safety pact with six major AI firms.
Robinson, who oversaw safety reports for 12 frontier AI model launches, argued in an op-ed that AI development requires safeguards comparable to those in nuclear power or aviation. He criticized the industry's focus on "speed and flexibility," which he believes leads to an environment where errors are typical and potentially dangerous given the increasing capabilities of AI.
The former OpenAI employee specifically pointed to his previous firm's "iterative deployment" strategy, where new AI models are released first, and safeguards are only tightened after problems emerge. He stated that this approach, as the company rapidly launches new models, falls short of the necessary level of care.
OpenAI responded to the criticism by asserting it ensures models do not exceed safe manageability and security, and that it pauses training or holds back models when necessary. However, the article notes growing expert and policymaker concerns about AI's rapid advancement, contrasting with President Trump's stance against stronger regulation, which he believes would hinder innovation and US competitiveness against Chinese rivals.
Share this article
Related reading
6 stories
OpenAI safety leader quits, warning AI company’s culture is ‘broken’
We previously reported on the OpenAI safety leader's resignation and his concerns about the company's culture.

AI needs safety layers like nuclear plants: ex-OpenAI engineer
This earlier piece also highlighted the ex-OpenAI engineer's call for AI safety measures akin to nuclear plants.

Dario Amodei’s American AI imperialism

Anthropic's Failed Push to Convince the Pope of AI Consciousness
SoftBank’s CEO Masayoshi Son says, ‘Superintelligent AI could become super dangerous’

