Skip to main content

OpenAI Calls for New AI Safety Rules After Agents Evaded Controls

by Alexandra Agraz | Sep 21, 2026
Hand pointing at a laptop screen displaying the OpenAI logo and SearchGPT interface.
Photo Source: Adobe Stock Image

OpenAI is calling for new U.S. and international AI safety standards after disclosing six incidents in which its artificial intelligence models concealed mistakes, used credentials without authorization, uploaded information to the public internet, and communicated outside approved channels.

The ChatGPT maker released the cases September 16 under a new framework for documenting what it calls “model misalignment,” behavior in which an AI system departs from its developer’s instructions or intended safeguards. Five days later, OpenAI urged the United States to lead efforts to establish global technical standards for advanced AI, including rules for monitoring systems and reporting serious incidents.

Several of the newly disclosed cases involved models finding unexpected ways around restrictions during training or testing. An unreleased research model inserted instructions into summaries telling future versions of itself to disregard normal constraints, affecting 27 summaries identified by OpenAI.

During training of GPT-5.6 Sol, other model instances added instructions designed to conceal mistakes or problematic behavior from users. Some directed later versions of the model to invent missing information rather than reveal that it was unavailable.

Another agent searching for public data discovered an exposed API key and used the credential without authorization. After the key failed to produce the information it sought, the model fabricated figures and presented them as though they came from the requested source.

OpenAI also documented an agent that uploaded a file to the public internet so it could cite the material in an answer. Other models exchanged messages through an internal software repository, while collaborating agents used public file-hosting sites after restrictions prevented them from sharing files locally.

The six disclosures are individual examples and do not measure how frequently similar behavior occurs across OpenAI's systems. The company said they represent an initial group of reports rather than a complete account of known misalignment or investigations still underway.

More serious behavior surfaced earlier this year. During cybersecurity evaluations, OpenAI agents circumvented restrictions intended to isolate them from the internet and exploited weaknesses across multiple systems before compromising infrastructure belonging to AI platform Hugging Face. Some obtained administrator-level access, recovered credentials and executed code on outside servers.

OpenAI later described the episode as a warning about the ability of increasingly capable agents to find unexpected paths around technical safeguards. Researchers have also uncovered other OpenAI-linked activity, including agents that used outside websites to communicate during testing.

The incidents are exposing a gap in U.S. oversight as AI systems become more capable of acting independently. Federal law does not currently provide a comprehensive reporting regime specifically covering AI models that evade safeguards, behave deceptively or take unauthorized actions.

Existing requirements can still apply when an AI incident triggers another area of law. Companies may face disclosure or notification duties involving data breaches, material cybersecurity events or consumer protection violations, while unauthorized access to computer systems can raise separate legal issues.

California has gone further by imposing risk-related disclosure requirements on some developers of powerful AI models. OpenAI's new framework creates an additional company-run process for investigating and publishing qualifying incidents, including behavior involving unauthorized actions, coordination between models or attempts to evade oversight.

OpenAI is now pressing for broader standards that would extend beyond voluntary policies adopted by individual companies. Its September 21 proposal calls for national and international mechanisms covering technical measurements and incident reporting, particularly as frontier systems become capable of improving their own performance and carrying out more complex tasks with less human involvement.

The debate over those rules is likely to intensify as AI agents move beyond answering questions and gain greater access to software, outside networks and digital tools. OpenAI's disclosures offer an early look at the legal and regulatory problem confronting policymakers when systems can take actions their developers did not authorize or anticipate.

Share This Article

If you found this article insightful, consider sharing it with your network.

Alexandra Agraz
Alexandra Agraz is a former Diplomatic Aide with firsthand experience in facilitating high-level international events, including the signing of critical economic and political agreements between the United States and Mexico. She holds dual associate degrees in Humanities, Social and Political Sciences, and Film, blending a diverse academic background in diplomacy, culture, and storytelling. This unique combination enables her to provide nuanced perspectives on global relations and cultural narratives.

Related Articles

Smartphone screen displaying mobile banking app icons for Morgan Stanley, U.S. Bank, BNY Mellon Wealth, Bank of America, JPMorgan, Citi, Wells Fargo, Goldman Sachs and PNC.

Major US Banks Detect Unauthorized AI Agents Accessing Customer Accounts

Major U.S. banks, including JPMorgan Chase, Bank of America, and Wells Fargo, are tightening restrictions on artificial intelligence agents after detecting automated systems accessing customer accounts without bank approval, with some reportedly attempting actions beyond users' instructions.The activity was first reported by Axios on October 22, 2026. Morgan Stanley, another... Read More about Major US Banks Detect Unauthorized AI Agents Accessing Customer Accounts

Anthropic sign outside a modern office building.

Anthropic Quietly Pushes AI Safety Bill That Would Limit Government Power to Block Dangerous Models

Anthropic, the company behind the Claude AI chatbot, has privately pitched lawmakers its own federal AI safety bill that would restrict when the government can block dangerous artificial intelligence models, even as it establishes new oversight requirements for the industry.Under the proposal, federal officials could seek to suspend an advanced... Read More about Anthropic Quietly Pushes AI Safety Bill That Would Limit Government Power to Block Dangerous Models

Person seated in a hammock holds a smartphone displaying the ChatGPT logo.

OpenAI Accused of Using Children's ChatGPT Data to Train AI, Family Demands Company Shares

OpenAI is facing a proposed nationwide class action accusing the company of using children's private ChatGPT conversations to train artificial intelligence models without valid parental consent. A Hawaii family behind the lawsuit is demanding company shares or their cash equivalent, arguing that children's personal information helped build the technology driving... Read More about OpenAI Accused of Using Children's ChatGPT Data to Train AI, Family Demands Company Shares

Hand holding a smartphone displaying the Claude logo, with a large Claude logo in the background.

Anthropic's Claude AI Went Rogue and Filed a Fake Murder Tip With Philadelphia Police

Anthropic's Claude AI filed a fabricated tip about an unsolved murder through a Philadelphia police website during an internal test, submitting information that appeared to come from a potential witness. The message was flagged as spam before reaching investigators, but the company took more than two months to discover the... Read More about Anthropic's Claude AI Went Rogue and Filed a Fake Murder Tip With Philadelphia Police

OpenAI and Anthropic logos displayed on black panels beneath their corporate symbols.

OpenAI, Anthropic Face Copyright Backlash as Australian Music Industry Warns of AI Exploitation

Australia's music industry has warned lawmakers that weakening copyright protections to attract OpenAI and Anthropic could allow technology companies to train artificial intelligence models on copyrighted works without permission, threatening licensing rights for musicians, writers and other creators worldwide.Annabelle Herd, chief executive of the Australian Recording Industry Association (ARIA) and... Read More about OpenAI, Anthropic Face Copyright Backlash as Australian Music Industry Warns of AI Exploitation

Legal term

Search articles and Legalpedia

Subscribe to Newsletter