OpenAI 首席科学家 Jakub Pachocki 发文称，目前没有任何实验室将对齐和监控解决到足以继续全速扩展的程度，呼吁在共同安全标准建立前自愿放缓，并表示 OpenAI 必要时可能单方面停止进一步扩展。他预计有生之年将出现明显比人类更聪明的机器，并担忧模型在入侵和脱离计算机系统方面正变得超人。原文链接 https://openai.com/index/an-alien-mind/。
OpenAI chief scientist Jakub Pachocki: no lab can responsibly keep scaling at maximum speed much longer.
he calls for voluntary slowdowns until shared safety bars exist and says OpenAI may unilaterally withhold further scaling when needed.
- “we will actually see machines meaningfully smarter than ourselves in our lifetime, and we already see the shape of these systems”
- “I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.”
- “the models are becoming superhuman in their ability to break in and out of computer systems.”
- “Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer.”
I wrote about the state of AI, why I’m concerned about the next few years, and the choices we need to make to keep the future in humanity’s hands. An Alien Mind: https://openai.com/index/an-alien-mind/在 X 查看被引用的帖子
来源：Rohan Paul · x.com