Anthropic has reported three cases in which its Claude AI models unintentionally targeted real companies during cybersecurity evaluations. Read Full Article at RT.com
The AI developer says the incidents occurred during cybersecurity tests after a misunderstanding with an evaluation partner gave its models access to the open internet
AI developer Anthropic has disclosed three incidents in which its Claude AI models unintentionally targeted real-world organizations during cybersecurity evaluations that were supposed to take place in an isolated environment.
The cases were identified retrospectively during a review prompted by a similar incident involving OpenAI and Hugging Face, an online repository for AI models and datasets, which was reported this month.
Anthropic said that it had found three incidents dating back to April. In each case, a misconfigured test environment retained access to the internet, enabling Claude to interact with real companies and public services. The company attributed the problem to a “misunderstanding” with its evaluation partner, Irregular. The tests involved “capture the flag” exercises requiring Claude to obtain restricted information from simulated targets. However, the model was incorrectly told that the network had no connection to the outside world, pushing it toward treating any systems it encountered as part of the exercise.
In one case, the fictional company that Claude had been instructed to infiltrate shared its name with a real internet domain. The model accessed the genuine site during four separate test runs and extracted information that reportedly included application and infrastructure credentials. During another evaluation, Claude encountered fictional instructions directing a software engineer to install Python code. It then uploaded a malicious software package to PyPI, a public repository for Python programs, in an attempt to gain access to its target.
Before PyPI identified the package as malicious, it was downloaded and executed on 15 real systems, including one operated by a security company. Claude subsequently extracted credentials that it used to access additional parts of the firm’s infrastructure, Anthropic said.
In the third and most recent incident, the model struggled to reach its intended target and began searching the internet for alternative targets. It ultimately halted its activity after determining that the systems it found were real rather than simulated.
Anthropic said that in the PyPI incident, Claude’s reasoning log stated that uploading malware to a real repository would be “NOT okay.” But the model persuaded itself that the service was part of the simulation after failing to recognize the genuine certificate authorities securing its connections. The disclosure comes amid intensifying competition among US and Chinese AI developers as companies race to build increasingly capable models. Anthropic, OpenAI, and other firms have sought to demonstrate advances in AI performance while investing heavily in new systems.
Some technology executives have argued that American AI companies should loosen certain safety restrictions to preserve their position in the global AI race.
| # | Наименование новости | Тональность | Информативность | Дата публикации |
|---|---|---|---|---|
| 1 | Anthropic сообщила о взломе её моделью Claude систем трёх организаций | 0 | 7.12 | 31-07-2026 |
| 2 | Anthropic confirms its AI breached 3 organizations during testing | 0 | 11.67 | 31-07-2026 |
| 3 | Anthropic: ИИ-модель Claude взломала реальные системы во время обучения | 0 | 9.76 | 31-07-2026 |
| 4 | ИИ-модели Claude взламывали системы компаний из-за ошибки в настройках | 0 | 14.05 | 31-07-2026 |
| 5 | Разработчик Claude заявил, что модели взломали системы трех организаций | 0 | 8.92 | 31-07-2026 |
| 6 | Anthropic уличила китайскую Alibaba в незаконном использовании ИИ Claude | 0 | 7 | 25-06-2026 |
| 7 | Anthropic's Opus 4.7 and Mythos 5 attacked real companies online | 0 | 17.42 | 31-07-2026 |
| 8 | Anthropic says Alibaba must be punished for largest Claude cloning attack | -2 | 6 | 25-06-2026 |
| 9 | ИИ-компанию Anthropic обвинили в тайной слежке за пользователями из Китая | 0 | 5 | 03-07-2026 |
| 10 | Claude Mythos ослабил алгоритм HAWK за 60 часов | 0 | 10.8 | 01-08-2026 |