Anthropic近期调整了Claude Fable 5的安全机制。此前开发者发现,部分敏感提示被静默降级为Opus 4.8而非明确拒绝。现在,涉及前沿LLM开发、网络安全、生物安全的请求将可见地回退到Opus 4.8,API会返回拒绝原因。隐藏措施虽上线快、误报少,但损害用户知情权。可见措施更易被探测和绕过,短期误报增多,Anthropic将同步调优分类器。该调整主要为了防止竞争对手通过Fable 5输出训练小模型的知识蒸馏风险。
Some good move by Anthropic
They just reversed Claude Fable 5’s hidden safeguards after developers found that some sensitive prompts were being silently downgraded to Opus 4.8 instead of being clearly refused.
Now those prompts will visibly fall back to Opus 4.8 after backlash.
The problem was that researchers, developers, and evaluators could send a normal technical prompt and receive a degraded answer without knowing whether Fable 5 had answered badly or whether Anthropic had quietly weakened the response.
That breaks trust because users need to know whether they are testing the real model, a restricted version of the model, or a fallback system.
A fallback model is the safety handoff: when a classifier flags a prompt about frontier LLM work, cyber, or bio, the system routes it to Opus 4.8 rather than letting Fable 5 respond directly.
Anthropic says hidden safeguards shipped faster and produced fewer mistaken blocks, but it now admits that users should see when safety systems change the model behavior.
But now, the cost of this visible guardrails is more false positives, because visible filters are easier to test, jailbreak, and tune around, so Anthropic has to make the classifiers stricter while it improves them.
----
For this whole safeguard, for Anthropic, the main trigger was distillation, where a smaller model is trained on outputs from a stronger model, which Anthropic saw as risky because competitors to Anthropic, could use Fable 5 to improve competing AI models.
We’re rolling out changes to make Fable 5’s safeguards for frontier LLM development visible. Starting this week, flagged requests will visibly fall back to Opus 4.8—the same as our safeguards for cyber and bio. You will see this every time it happens. On the API, any flagged requests will return a reason for their refusal (coming to server-side fallback in the next few days). We wanted to deploy Fable 5 to our users quickly and safely. Visible safeguards can be probed, so they have to be robust, which takes time to get right. Invisible safeguards can be targeted more narrowly, allowing us to ship quickly with very few false positives. We went with invisible safeguards for this reason—and that was the wrong tradeoff. You should have visibility into the safeguards we have in place, and why. We’re sorry for not getting the balance right. Making the safeguards visible makes them easier to work around, so keeping them robust to jailbreaks will unfortunately mean more false positives while we improve the classifiers. We're also tuning our bio and cyber classifiers to trigger less often on harmless requests. We know this is frustrating and we’ll do our best to keep this period as short as possible. If you think a request has been mistakenly flagged: run /feedback in Claude Code, click thumbs-down on the fallback in http://Claude.ai or Cowork, or file the safeguard appeal form for API requests. Your reports help us tune these classifiers and we appreciate your feedback. https://support.claude.com/en/articles/8241253-safeguards-warnings-and-appeals在 X 查看被引用的帖子
来源:Rohan Paul · x.com