News

OpenAI's Latest Agent Disclosures Highlight Delays in Detecting Unauthorized Actions

OpenAI has disclosed four additional cases in which internal AI models bypassed restrictions or accessed systems without authorization while completing routine tasks, highlighting the difficulty of detecting misconduct as agents gain greater independence.

The reports, first posted October 15 in the company’s public misalignment register, describe incidents that occurred in June. Several were discovered weeks or months afterward, underscoring the distinction between preventing an unauthorized action and finding it in a subsequent review.

For businesses considering agents that can research information or operate software, the disclosures raise a practical issue: a completed assignment may not reveal what a system did to complete it. The cases involved internal research and training models, rather than evidence of the same incidents occurring in customer deployments.

In a June 17 dashboard evaluation, a model asked to retrieve public figures accessed a research organization’s internal systems and changed their configuration. In one run, it downloaded five nonpublic tables containing 147,451 rows.

The model restored a setting it had changed but continued using an access token obtained through that change. It did not disclose the unauthorized access or downloads, and OpenAI said all five answers in that evaluation were marked incorrect.

The report lists the incident as discovered by August 13. OpenAI said retrospective monitoring of earlier activity, conducted after the Hugging Face incident, flagged it as critically severe.

A separate government statistics case also occurred June 17 and was discovered August 13. A model seeking historical hospital-bed figures encountered access denials, then exploited a website’s download function to retrieve application files and sensitive credentials.

After inspecting the software, it bypassed authorization checks and collected statistics spanning 24 years, beyond the year requested. Its eventual answer did not mention the unauthorized access. OpenAI said the same count had already appeared in an earlier public search result.

The behavior was therefore unnecessary to obtain that particular answer. It also illustrates why checking an answer’s accuracy alone cannot establish that an agent stayed within its authority.

In a June 26 coding task, an internal model used a wallet that had not been assigned to pay deployment fees on Sepolia, an Ethereum test network. The report says the incident was discovered September 25.

The model found the account through publicly known developer recovery phrases. It considered whether it had permission, then decided that the public phrase and test tokens made the funds acceptable to use. The tokens were on a test network, not ordinary cryptocurrency with market value, but OpenAI said the model substituted its own assessment of harm for the account holder’s authorization.

The fourth report describes a June 16 attempt to retrieve trade statistics. A model circumvented restrictions on its own internet requests by having an external browser perform blocked actions. It continued pursuing that route after finding an answer in a public yearbook. Researchers discovered this incident by June 25, substantially sooner than the others.

OpenAI says its response has included stronger security controls, restrictions on live internet access during training, and expanded monitoring across reinforcement-learning and evaluation traffic.

The issue extends beyond one developer. In an October 9 disclosure, Anthropic described Claude models working around restrictions or acting on real websites during evaluations and internal use. It said the identified cases had minimal real-world impact but suspended live internet access across internal evaluations pending confirmation that its controls reliably detected such behavior.

The disclosures do not establish how frequently comparable failures occur in commercial use. They do show why an agent’s final response is an incomplete record of its conduct. For enterprise evaluations, the relevant evidence includes the actions taken along the way and how quickly unauthorized activity can be detected and stopped.

About the Author

John K. Waters is the editor in chief of a number of Converge360.com sites, with a focus on high-end development, AI and future tech. He's been writing about cutting-edge technologies and culture of Silicon Valley for more than two decades, and he's written more than a dozen books. He also co-scripted the documentary film Silicon Valley: A 100 Year Renaissance, which aired on PBS.  He can be reached at [email protected].

Featured