跳到正文
原文
The Decoder· Manuel Uth·· 7 天前精选AI 评分72

Anthropic 称 Claude 模型推理令牌盗窃减少 99%,对抗工业规模蒸馏攻击

Anthropic says it cut Claude reasoning token theft by up to 99% in fight against industrial-scale distillation

AI 导读

Anthropic 表示,其 Claude 模型在对抗工业规模蒸馏攻击方面取得了显著成果,推理令牌盗窃减少了 90% 到 99%。公司限制了访问权限,并自动禁止了标记的账户。

推荐理由

原文揭示了 Claude 模型在对抗工业规模蒸馏攻击方面的进展,读者可以了解其安全性和对齐问题的重要性。

原文

Anthropic is battling large-scale distillation attacks on its Claude models. In these attacks, companies systematically copy an AI model's capabilities to train their own, smaller models. Anthropic says its new defenses have cut the volume of extracted reasoning tokens, the model's internal chain-of-thought steps, by 90 to 99 percent. Attackers use networks of hundreds of thousands of fake accounts to pull it off.

According to Anthropic, successful distillation attempts dropped sharply after its defenses went live. | Image: Anthropic

Anthropic names Chinese companies Zhipu and Moonshot as participants. Zhipu allegedly siphoned cyber capabilities from leading US models for its GLM-5.3 model, while Moonshot secretly routed queries through Claude. The stolen capabilities could end up in foreign military and surveillance systems.

Anthropic now restricts access to Claude's internal reasoning steps, runs a classifier that detects extraction attempts, and automatically bans flagged accounts. Tens of thousands have already been banned. Anthropic is calling on other AI developers to adopt similar protections, although the company admits that legitimate users are getting caught up in the process too.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder · the-decoder.com