Anthropic accuses three Chinese AI labs of abusing Claude to improve their own models

Date:

Share post:

Anthropic is issuing a call to action against AI “distillation attacks,” after accusing three AI companies of misusing its Claude chatbot. On its website, Anthropic claimed that DeepSeek, Moonshot and MiniMax have been conducting “industrial-scale campaigns…to illicitly extract Claude’s capabilities to improve their own models.”

Distillation in the AI world refers to when less capable models lean on the responses of more powerful ones to train themselves. While distillation isn’t a bad thing across the board, Anthropic said that these types of attacks can be used in a more nefarious way. According to Anthropic, these three Chinese AI firms were responsible for more than “16 million exchanges with Claude through approximately 24,000 fraudulent accounts.” From Anthropic’s perspective, these competing companies were using Claude as a shortcut to develop more advanced AI models, which could also lead to circumventing certain safeguards.

Anthropic said in its post that it was able to link each of these distilling attack campaigns to the specific companies with “high confidence” thanks to IP address correlation, metadata requests and infrastructure indicators, along with corroborating with others in the AI industry who have noticed similar behaviors.

Early last year, OpenAI made similar claims of rival firms distilling its models and banned suspected accounts in response. As for Anthropic, the company behind Claude said it would upgrade its system to make distillation attacks harder to do and easier to identify. While Anthropic is pointing fingers at these other firms, it’s also facing a lawsuit from music publishers who accused the AI company of using illegal copies of songs to train its Claude chatbot.

Source link

spot_img

Related articles

The Promptware Kill Chain – Schneier on Security

The Promptware Kill Chain Attacks against modern generative artificial intelligence (AI) large language models (LLMs) pose a real threat....

What’s The Oldest Tech Hardware You Still Use?

Shiny Thing Syndrome (STS) is a hard condition to shake, and I’ve been collecting computer hardware since the...

Strategies, Technology and Best Practices

Gamification in Hybrid and Virtual Events: Strategies, Technology and Best Practices Skip to main content Source link