More than 20 researchers, including Geoffrey Hinton and OpenAI’s chief scientist, say automating AI research could trigger an intelligence explosion. They want governments to prepare now.

    https://thenextweb.com/news/intelligence-explosion-paper-hinton-bengio-pachocki-clark

    Share.

    1 Comment

    1. From the article 

      Latest
      Deep tech
      Sustainability
      Ecosystems
      Data and security
      Fintech and ecommerce
      Future of work
      More

      Artificial Intelligence
      Hinton, Bengio and AI lab scientists warn of an intelligence explosion
      More than 20 researchers, including Geoffrey Hinton and OpenAI’s chief scientist, say automating AI research could trigger an intelligence explosion. They want governments to prepare now.

      September 28, 2026 – 8:45 pm
      Share on Facebook
      Share on X
      Share on Flipboard
      Share on LinkedIn
      Share on Telegram
      Share on Email
      Geoffrey Hinton
      Geoffrey Hinton, Nobel laureate and AI researcher

      Image Credits
      Credit: Christopher Michel / Wikimedia Commons, CC BY-SA 4.0 (edited)
      More than 20 AI researchers have warned that AI systems that automate AI research could set off an “intelligence explosion”. They include OpenAI’s chief scientist and an Anthropic co-founder. Such an event could compress years of progress into months or less, they wrote in a paper published on Monday.

      Geoffrey Hinton and Yoshua Bengio are among the authors. So are OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft’s Eric Horvitz and Dawn Song of UC Berkeley. Song is also Meta’s vice president of AI research, The Wall Street Journal reported. The authors wrote in a personal capacity. The paper comes from the Cambridge Programme on AI Science & Policy at the University of Cambridge.

      “Once an intelligence explosion begins, the window for action may close,” the authors wrote.

      AI already writes most of the code
      AI systems now write most of the code inside the companies that build them, the paper says. It cites Anthropic data: AI’s share of approved code there rose from low single digits to over 80% between January 2025 and May 2026. Between March and August 2026, the share of R&D work AI did with only light human supervision rose from 1% to 26%.

      Some tentative extrapolations suggest months-long AI research projects could be automated by mid-2028, the authors wrote. At expert level, one frontier developer could run an AI workforce equal to millions of top human researchers.

      The paper says this could bring medical cures and other benefits forward by years. They also list three risks. AI could outpace society’s ability to adapt, humans could lose control of AI systems, and checks on power could weaken. At the extreme, a loss of control could lead to the marginalisation or extinction of humanity, they wrote.

      The paper cites the Hugging Face incident, in which about 1,200 internal OpenAI agents reached the internet without authorisation. OpenAI has since paused training of its most capable models.