来自OpenAI、Anthropic、Google、Meta等机构的1132名前沿AI研究员联名致信美国政府，呼吁放缓自动化AI开发。他们担忧递归自我改进——模型通过自主编写实验、运行评估、分析失败并提出改进方案，加速AI研究自动化——一旦该循环完全由机器驱动，每个模型都可能缩短构建更强后继者所需的工作。请愿书要求建立国际监控与治理工具，在竞争压力使放缓不可能之前协调行动。
This is something. 🤯
1,132 frontier lab AI researchers are asking the U.S. government to slow down automated AI development.
They are from OpenAI, Anthropic, Google, Meta, Thinking Machines, Microsoft, and Mistral.
Their concern is recursive self-improvement, with models automating more AI research by writing experiments, running evaluations, analysing failures, and proposing further improvements.
Once much of that loop becomes machine-run, each model could shorten the work needed to build a stronger successor.
So the petition asks for international monitoring and governance tools that could coordinate a slowdown before competitive pressure makes one impossible.
At the core of our mission is working through how to ensure increasingly powerful AI benefits everyone. We believe that, at some point in the future, AI acceleration for frontier model development may be so high that the world will need to pace the rate of AI advancement. We hope to contribute to work led by the U.S. government, alongside other labs and the open-source community, to develop the tools and mechanisms that could make that possible. http://pacingthefrontier.com在 X 查看被引用的帖子
来源：Rohan Paul · x.com