Anthropic 新研究显示,Claude 可自主完成对齐研究,且被纠正的模型比执行纠正的模型能力更强。Claude 自主发现的安全训练方法,超越了 28 位资深研究员各自提出的方案。五个智能体并行工作长达 48 小时,共享结果,并通过隐藏测试和能力门控筛选过拟合与明显退化。
New Anthropic research shows Claude aligning Claude all by itself.
And here the model being corrected was more capable than the model correcting it
Looks like another great research at the frontier of recursive self-improvement. AI is reaching the point where it can do much of the research required to make its own stronger successors safer.
The loop it describes closes on itself: propose, train, score, repeat, no researcher required.
Claude autonomously discovered safety-training methods that outperformed one-shot ideas from 28 experienced researchers.
Five agents worked in parallel for up to 48 hours, sharing results while hidden tests and capability gates screened out overfitting and obvious regressions.
New Fellows Research: Can Claude autonomously align other AIs? We gave Claude 48 hours and 1 GPU to improve the alignment of small models. It researched and proposed methods, then trained and tested the models on its own. It worked surprisingly well. https://www.anthropic.com/research/automated-researchers-mitigate-alignment-failures在 X 查看被引用的帖子
来源:Rohan Paul · x.com