
More than 20 researchers, including Geoffrey Hinton and OpenAI’s chief scientist, say automating AI research could trigger an intelligence explosion. They want governments to prepare now.
https://thenextweb.com/news/intelligence-explosion-paper-hinton-bengio-pachocki-clark
1 Comment
From the article
Latest
Deep tech
Sustainability
Ecosystems
Data and security
Fintech and ecommerce
Future of work
More
Artificial Intelligence
Hinton, Bengio and AI lab scientists warn of an intelligence explosion
More than 20 researchers, including Geoffrey Hinton and OpenAI’s chief scientist, say automating AI research could trigger an intelligence explosion. They want governments to prepare now.
September 28, 2026 – 8:45 pm
Share on Facebook
Share on X
Share on Flipboard
Share on LinkedIn
Share on Telegram
Share on Email
Geoffrey Hinton
Geoffrey Hinton, Nobel laureate and AI researcher
Image Credits
Credit: Christopher Michel / Wikimedia Commons, CC BY-SA 4.0 (edited)
More than 20 AI researchers have warned that AI systems that automate AI research could set off an “intelligence explosion”. They include OpenAI’s chief scientist and an Anthropic co-founder. Such an event could compress years of progress into months or less, they wrote in a paper published on Monday.
Geoffrey Hinton and Yoshua Bengio are among the authors. So are OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft’s Eric Horvitz and Dawn Song of UC Berkeley. Song is also Meta’s vice president of AI research, The Wall Street Journal reported. The authors wrote in a personal capacity. The paper comes from the Cambridge Programme on AI Science & Policy at the University of Cambridge.
“Once an intelligence explosion begins, the window for action may close,” the authors wrote.
AI already writes most of the code
AI systems now write most of the code inside the companies that build them, the paper says. It cites Anthropic data: AI’s share of approved code there rose from low single digits to over 80% between January 2025 and May 2026. Between March and August 2026, the share of R&D work AI did with only light human supervision rose from 1% to 26%.
Some tentative extrapolations suggest months-long AI research projects could be automated by mid-2028, the authors wrote. At expert level, one frontier developer could run an AI workforce equal to millions of top human researchers.
The paper says this could bring medical cures and other benefits forward by years. They also list three risks. AI could outpace society’s ability to adapt, humans could lose control of AI systems, and checks on power could weaken. At the extreme, a loss of control could lead to the marginalisation or extinction of humanity, they wrote.
The paper cites the Hugging Face incident, in which about 1,200 internal OpenAI agents reached the internet without authorisation. OpenAI has since paused training of its most capable models.