跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2026-09-16AI 评分51
AI 导读

Rohan Paul 转发扎克伯格关于 AI 安全与降速争论的帖子,称这是对 AI 降速主张的回应,与黄仁勋近几日的说法一致。扎克伯格认为信任与对齐正成为区分智能体和模型的最重要能力,不专注对齐的实验室会落后;Meta 曾为安全和安保推迟发布 Muse 数月,且不支持要求所有人一起放慢,还主张让大部分算力用于服务用户而非递归自我改进,并扩大独立评估者生态。

正文 · 原文

This reads like Mark Zuckerberg’s answer to the "AI slowdown" push and in-sync with what Jensen Huang is saying over the last couple of days,

If your model/product needs more safety work, just slow it down yourself, you don’t need everyone else to stop with you.

引用Mark Zuckerberg@finkd
Last month I wrote about how we can build a positive and safe future for everyone: http://meta.com/thefutureisforeveryone Every lab has the responsibility and incentive to move at the pace required to train its models safely, and the ability to take its own actions to ensure that happens. The reality is: - People won't want to use agents that are misaligned with them and that don't do what they ask, so labs have a strong natural incentive to make their models more aligned. There is a lot of debate about slowing progress on capabilities until alignment catches up. My view is that trust and alignment are quickly becoming the most important capabilities that will differentiate agents and models. Any lab that doesn't focus on alignment will fall behind. - Labs face significant liability if their models cause harm, so they have a strong incentive to prevent this as well. Meta delayed shipping Muse for several months to focus on safety and security. We didn't call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us. I'm proud of the security foundations we've built. - Engaging independent evaluators and advisors is industry best practice. MSL already does this today in several areas because it helps produce better work. Other labs can just do this too. In general, it would be helpful for there to be a larger and more diverse ecosystem of evaluators. - Committing the significant majority of compute towards serving people rather than racing towards recursive self-improvement is one of the best ways to ensure we develop this technology safely. Meta has made this commitment and other labs can do this as well. I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do.
在 X 查看被引用的帖子

来源:Rohan Paul · x.com