Noam Brown· @polynoamial · X·· 2026-09-02AI 评分41
AI 导读
Noam Brown 发帖确认 Jakub 是 @OpenAI 的首席科学家。其引用的 OpenAI 帖子称,包括 Astra 在内的现役前沿模型计算图深度与 GPT-4 相差不超过两倍;OpenAI 从最早的推理模型起就保留并利用链式推理监控,认为该技术能观察模型对齐如何从训练分布泛化,但也承认其脆弱且趋势在变差,原因是与架构变更无关的因素,将另文详述,强化该技术是当前研究计划的核心目标。
正文 · 原文
Jakub is chief scientist at @OpenAI
I want to prevent a race into unmonitorability kicked off by confused reporting. The depth of the computation graph for our present frontier models, including Astra, is within a factor of two of GPT-4. OpenAI has worked to preserve and utilize chain-of-thought monitoring since our very first reasoning models. We deeply care about this technique, as it can give us a view into how model alignment generalizes from its training distribution. I do think it is fragile and unfortunately trending in a negative direction, for reasons not contingent on architecture changes that I will write about soon. But there are things we can do to strengthen it, and it's a core goal of our current research program.在 X 查看被引用的帖子
来源:Noam Brown · x.com