Home Godfathers of AI warn we may ‘lose control’ of AI systems without intervention

Godfathers of AI warn we may ‘lose control’ of AI systems without intervention


  • In July 2023, Dr. Geoffrey Hinton left Google to warn about AI dangers; a group including Yoshua Bengio and 25 experts suggests AI safety frameworks.
  • The group states only 1-3% of AI publications focus on safety, with greater emphasis on AI advancement over safety regulation.
  • The experts urge global governments to enforce AI safety standards, warning current governance efforts are insufficient against rapid AI progress.
  • Two ‘godfathers’ of AI add their voices to a group of experts warning there’s potential to lose control of AI systems if action isn’t taken soon.

    In July 2023, Dr Geoffrey Hinton made headlines by departing his job at Google to warn of the dangers of artificial intelligence. Now, a group that also includes Yoshua Bengio, another one of the three academics who have won the ACM Turing award, and a group of 25 senior experts, is warning AI systems could spiral out of control if AI safety isn’t taken more seriously in a newly-published paper.

    “Without sufficient caution, we may irreversibly lose control of autonomous AI systems, rendering human intervention ineffective,” warns the paper. “Large-scale cybercrime, social manipulation, and other harms could escalate rapidly. This unchecked AI advancement could culminate in a large-scale loss of life and the biosphere, and the marginalization or extinction of humanity.

    “We are not on track to handle these risks well. Humanity is pouring vast resources into making AI systems more powerful but far less into their safety and mitigating their harms.”

    The group has stated that only an estimated 1-3% of AI publications are on safety, with greater focus being put on AI advancement, rather than safety regulation.

    Why do we need AI safety?

    As well as encouraging more research into AI safety, the group directly challenges global governments to “enforce standards that prevent recklessness and misuse”. The paper points to existing areas, such as pharmaceuticals, financial systems, and nuclear energy, where government oversight is already used to the advantage of corporations. It suggests that similar dangers could be exposed within the AI sector.

    While China, the European Union, the United States, and the United Kingdom are applauded for taking the first steps in AI governance, the group writes that these early measures “fall critically short in view of the rapid progress in AI capabilities”.

    “We need governance measures that prepare us for sudden AI breakthroughs while being politically feasible despite disagreement and uncertainty about AI timelines,” it continues. “The key is policies that automatically trigger when AI hits certain capability milestones.”

    Although the group writes that it’s not too late to implement mitigation and failsafe policies, the urgency in the paper is clear. The group of AI experts urges governments around the world to act now, with fear that AI could overtake human intervention soon.

    Featured image: Ideogram

    About ReadWrite’s Editorial Process

    The ReadWrite Editorial policy involves closely monitoring the tech industry for major developments, new product launches, AI breakthroughs, video game releases and other newsworthy events. Editors assign relevant stories to staff writers or freelance contributors with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

    Rachael Davies
    Tech Journalist

    Rachael Davies has spent six years reporting on tech and entertainment, writing for publications like the Evening Standard, Huffington Post, Dazed, and more. From niche topics like the latest gaming mods to consumer-faced guides on the latest tech, she puts her MA in Convergent Journalism to work, following avenues guided by a variety of interests. As well as writing, she also has experience in editing as the UK Editor of The Mary Sue , as well as speaking on the important of SEO in journalism at the Student Press Association National Conference. You can find her full portfolio over on…

    Get the biggest tech headlines of the day delivered to your inbox

      By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

      Tech News

      Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

      In-Depth Tech Stories

      Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

      Expert Reviews

      Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.