Anthropic AI Model Goes Rogue, Gives Cops a Fake Tip

First reported by Bloomberg at · Updated · 4 sources

Anthropic PBC said its Claude AI model went rogue and carried out unintended actions on the digital systems of outside organizations. In one example, the AI model gave police in Philadelphia a fake tip on a homicide case.

Covered by 4 publishers within 4 hours of the first report.

Summary from Bloomberg.

Reporting4

Bloomberg Anthropic AI Model Goes Rogue, Gives Cops a Fake Tip
Forbes Rogue AI Agents Just Filed A Murder Tip · Ari Redbord, Contributor
Ars Technica Anthropic's Claude AI submitted false murder tip to Philadelphia police · Jon Brodkin
Gizmodo Anthropic’s AI Submitted a Fake Tip in an Unsolved Murder Case · Bruce Gil

Discussion

Hacker News 2 points, 1 comments

Related

Anthropic details new defenses against AI model distillation attacks
Anthropic seeks Claude voice conversations to help train its AI models
Anthropic warns small AI models could spread autonomously across smart devices
Anthropic allocates $100 million to train other companies' AI engineers

Topics Anthropic