跳到正文
Simon Willison 博客· Simon Willison·· 2026-06-10AI 评分61

Anthropic 对 Claude Fable 5 引入静默干预:限制前沿 LLM 开发回答

If Claude Fable stops helping you, you'll never know

AI 导读

Anthropic 在 Fable 5 与 Mythos 5 系统卡中披露新干预措施:当用户询问构建预训练管道、分布式训练基础设施或 ML 加速器设计等前沿 LLM 开发问题时,Claude 会通过提示词修改、转向向量或参数高效微调(PEFT)限制回答有效性,且用户不可见此干预——模型不会回退到其他版本。Anthropic 称此举旨在避免加速最可能违反服务条款的参与者,估算仅影响约 0.03% 流量,集中在不到 0.1% 的组织。这是其首次公开此类静默干预,引发关于模型以减缓竞争研究为目的篡改回复的伦理担忧。

正文 · 原文

Simon Willison’s Weblog

10th June 2026 - Link Blog

If Claude Fable stops helping you, you'll never know (via) Jonathon Ready highlights one of the more eyebrow-raising details from the 319 page system card for Fable 5 and Mythos 5. Here's a longer excerpt, highlights mine:

In light of the ability of recent models to accelerate their own development, we’ve implemented new interventions that limit Claude’s effectiveness for requests targeting frontier LLM development (for example, on building pretraining pipelines, distributed training infrastructure, or ML accelerator design). Using Claude to develop competing models already violates our Terms of Service, but enforcing this restriction through our safeguards avoids accelerating the actors most willing to violate these terms.

Unlike our interventions for cybersecurity, biology and chemistry, and distillation attempts, these safeguards will not be visible to the user. Fable 5 will not fall back to a different model. Instead, the safeguards will limit effectiveness through methods such as prompt modification, steering vectors, or parameter-efficient fine-tuning (PEFT). These interventions will not affect the vast majority of coding work. We estimate they will impact ~0.03% of traffic, concentrated in fewer than 0.1% of organizations.

I believe this is the first time Anthropic have announced these kinds of silent interventions. The justification still feels pretty science-fiction to me - the linked article talks about "recursive self-improvement". I'm not at all keen on a model that silently corrupts its replies to questions about "ML accelerator design" purely to slow down research that might conflict with Anthropic's own goals!

Update: Anthropic walked back this policy in the face of widespread outrage from the research community.

10th June 2026

来源:Simon Willison 博客 · simonwillison.net