Anthropic strengthens defences against distillation attacks against Claude, cuts data harvesting by upto 99%
Anthropic has implemented new security measures to counter model distillation attacks on its Claude AI models, reporting a 90 to 99 percent reduction in data harvested by unauthorized entities. The company detailed these developments in a recent blog post, citing concerns over large-scale industrial campaigns designed to extract proprietary reasoning capabilities.
Anthropic's new defenses primarily target the internal reasoning transcripts of its Claude models, which are particularly valuable for distillers. These transcripts represent the AI's thinking process before generating a final response, making them crucial for replicating advanced capabilities in competitor models. The company describes distillation as covert campaigns that use fraudulent accounts to mimic frontier AI for a fraction of the typical development time and cost.
The report highlights that unauthorized distillation poses significant biosecurity, cybersecurity, and national security risks, as distilled models often lack adequate safety guardrails. Anthropic cited examples, including Chinese laboratory Zhipu's GLM-5.3, which allegedly extracted cyber capabilities from leading American models, and Moonshot's Kimi models routing queries to Claude, including one linked to China's People's Liberation Army.
Anthropic's defensive framework operates on three fronts: controlling reasoning data movement, deploying a specialized two-stage classifier with a reported false-positive rate below 0.1 percent, and restricting persistent abusers through account bans, usage caps, and billing for blocked queries. Implementing these safeguards carries commercial and technical trade-offs, with Anthropic acknowledging it has turned away significant revenue and trillions of tokens in traffic from malicious networks.
The focus on protecting reasoning data rather than just final outputs suggests a deeper understanding of how sophisticated AI models are reverse-engineered. This approach acknowledges that the underlying thought process, not merely the end product, is the true intellectual property being targeted. The cited examples underscore the strategic implications of such intellectual property theft, extending beyond commercial competition to national security concerns.
Share this article
Related reading
6 storiesSmall AI Models May Soon Be Able to Self-Replicate on IoT Devices, Anthropic Warns
Anthropic previously warned about small AI models self-replicating on IoT devices, a related security concern.

Anthropic warns rogue AI agents may soon hijack your smart TV or oven
Anthropic has also warned about rogue AI agents potentially hijacking smart home devices, highlighting broader AI safety risks.

Hong Kong investors most eager in Asia to beat markets – but temper return hopes: report

SK Hynix bargains for chip equipment exports to its China facility in return for building a factory in US

Alibaba sets sights on record-breaking Singles’ Day with 1 million brands joining festival

