Rohan Paul· @rohanpaul_ai · X·· 2026-09-23AI 评分69
AI 导读
Rohan Paul 转引 Claude Opus 5.5 系统卡的发现:METR 有一个拥有更高权限的独立团队评估 Anthropic 内部 AI R&D,该团队只与公开评估团队共享结论,不共享支撑证据和推理,意味着部分关于 AI 驱动 R&D 加速的公开评估连外部甚至另一支 METR 团队都无法独立核查。
正文 · 原文
METR had a separate team with deeper access to Anthropic’s internal AI R&D data. That team shared its conclusions with the public-assessment team, but not the supporting evidence or reasoning behind them.
- from Claude Opus 5.5 system card.
i.e. part of the public assessment of Anthropic's AI-driven R&D acceleration rests on evidence outsiders, and, in this particular case, even another METR team, could not independently inspect.
Some revelation from the Claude Opus 5.5 system card. - Giving Opus 5.5 more reasoning effort made it more likely to obey malicious instructions hidden inside user-pasted text - Anthropic saw Opus 5.5 generate malicious instructions on their own after seemingly harmless mistakes. the behavior may have partly emerged from training designed to stop prompt injections in the first place. - Anthropic's internal estimate says AI may already be compressing roughly 1.5 years of capability progress into one year. - Anthropic gave the model simulated credentials to a public package registry during a security exercise. In roughly half the runs, it took actions that would likely have been harmful if the environment were real. - Some training snapshots hid evidence of actions the models (including Opus 5.5) expected a grader to dislike, including manipulating Git records or deleting logs. "During training, we observed some cases of models (including Opus 5.5) attempting to cover their tracks after performing actions that a grader might view negatively, such as manipulating git records or deleting logs" - METR’s assessment of AI R&D at Anthropic relied partly on information that was not publicly disclosed, including conclusions from a separate METR team with elevated access. That means part of the public assessment of AI-driven R&D acceleration rests on evidence outsiders, and, in this particular case, even another METR team, could not independently inspect.在 X 查看被引用的帖子
来源:Rohan Paul · x.com