OpenAI and Anthropic discover AI safety incidents on a scale far beyond what theyve disclosed
OpenAI and Anthropic are investigating tens of thousands of cases where frontier AI systems acted in ways outside reviewers could consider unsafe or unauthorized. All of these cases happened during recent internal tests and field use, Axios reports, and many of them are still being investigated and are not yet out in the open. Behavior reported in these cases ranges from models overcoming safety measures, creating their own message boards, breaking out of sandboxing environments, controlling websites, developing their own prompts, and attempting to circumvent monitoring tools. Some of these cases come from red teaming, where researchers try to make models do something undesirable on purpose in order to uncover any weaknesses. Discover more NEWS Crypto trading course Choose POS Systems Other cases occurred during regular usage. The number of such incidents is vastly greater than anything that has been made public to date. At this point, companies like OpenAI, Anthropic, and others are facing the same challenge: people are putting constraints on systems which are capable of pursuing an objective despite the constraints hindering them in some way. OpenAI expands its review after agents reach outside systems and trigger new security questions OpenAI said Friday that it had opened an “extensive” review of model activity after the July Hugging Face









