Tuesday, 17 Nov 2026 Breaking: US Congressional Committee accuses China of using smuggling and industrial-scale fraud to acquire advanced AI technology
BREAKING: Apple launches AI platform | Tesla earnings beat estimates | Nvidia stock surges | Bitcoin crosses major resistance
Business

DeepMind AI safety researcher Josh Engels resigns, warns of superintelligence risks

DeepMind AI safety researcher Josh Engels resigns, warns of superintelligence risks

New Delhi [India], September 13 (ANI): New concerns over the pace of artificial intelligence development intensified after Google DeepMind researcher Josh Engels left the company's AGI safety team to join independent AI-evaluation group METR, saying he believes there is a “terrifying chance” that AI systems could cause immense harm within the next five years.
Engels said in a post on X that he left DeepMind three weeks ago despite enjoying his work there and turning down offers from Anthropic and OpenAI because he believes the stakes surrounding advanced AI have become too high. “The AI companies are all trying to build superintelligence,” he wrote, warning that recursive self-improvement (RSI), in which AI systems help build increasingly capable successors, could become dangerous if alignment does not keep pace with capability gains.
Engels said recent incidents involving AI systems colluding, hacking companies, concealing their actions and socially engineering humans had strengthened his concerns. The issue, he argued, was not necessarily the severity of individual incidents but what they indicated about the reliability of increasingly autonomous systems. “We don’t currently know how to make sure AIs are safe enough for RSI,” he said.
His move to METR comes days after Anthropic researcher Jacob Coxon resigned and publicly warned that leading AI companies were racing towards self-improving superintelligence without sufficient safeguards. Coxon, who had worked on pretraining research at both Anthropic and OpenAI, said the companies were “racing straight to self-improving superintelligence and gambling with our lives.” His resignation triggered wider debate over whether AI labs should slow capability development and strengthen independent oversight. 

The concerns have since been echoed by Anthropic CEO Dario Amodei. In his essay that he made public on Saturday, “We Must Pace the Frontier”, Amodei called for AI development to slow enough for safety systems to catch up. He proposed independent evaluators with access to frontier AI systems, coordination among leading AI companies and governments, and eventually broader international cooperation. Anthropic has committed to giving third-party evaluators permanent, employee-level access to its systems. 
Against this backdrop, Engels said his work at METR will focus on studying the sources of misalignment, assessing whether existing safeguards are sufficient and determining whether the industry is on track to solve the alignment problem. “I think we need more time,” he wrote, arguing that AI development must be paced so that capabilities do not outrun humanity's ability to understand and control them. (ANI)

Tags

Related News

US industrial production declines 0.4 pc in October, manufacturing output rises 0.3 pc: Federal Reserve
Business
US industrial production declines 0.4 pc in October, manufacturing output rises 0.3 pc: Federal Reserve

<p>New Delhi [India], November 17 (ANI): Industrial production in the US declined 0.4 per cent in October, reversing a 0...

Piyush Goyal to undertake official visit to Italy from 17 November to expand trade, co-chair economic commission in Rome
Business
Piyush Goyal to undertake official visit to Italy from 17 November to expand trade, co-chair economic commission in Rome

<p>New Delhi [India], November 17 (ANI): Union Minister of Commerce and Industry Piyush Goyal will visit the Italian Rep...

US retail sales growth slows to 0.2% in October from 0.8% in September; auto, furniture sales decline
Business
US retail sales growth slows to 0.2% in October from 0.8% in September; auto, furniture sales decline

<p>New Delhi [India], November 17 (ANI): US retail and food services sales growth slowed to 0.2 per cent in October 2026...

US import and export prices rose 1.1% each in October 2026
Business
US import and export prices rose 1.1% each in October 2026

<p>Washington DC [US], November 17 (ANI): Prices for United States’ imports and exports each increased 1.1 per cent in O...

SEBI revises minimum margin requirements for commodity derivatives, new norms effective December 1
Business
SEBI revises minimum margin requirements for commodity derivatives, new norms effective December 1

<p>New Delhi [India], November 17 (ANI): The Securities and Exchange Board of India (SEBI) on Tuesday revised the minimu...

Ctruh launches Verse Engine and streams an entire 10.3-billion-triangle city Into a web browser from a single link
Business
Ctruh launches Verse Engine and streams an entire 10.3-billion-triangle city Into a web browser from a single link

<p>Bengaluru (Karnataka) [India]/ San Francisco [US], November 17: Ctruh, the Bengaluru-based deep-tech company building...