The Information 报道 OpenAI 的 Astra 模型采用 recurrent depth(looped transformer)架构,同一信息可多次经过相同 transformer 层后再生成下一个 token,在不按比例增加参数量的情况下提升每 token 计算量。
The information reports Astra reportedly uses "recurrent depth," or a "looped transformer," which helped its performance while making some internal reasoning less readable.
A looped transformer, or recurrent-depth model, can run the same information through the same transformer layers multiple times before producing the next token, instead of passing through each layer just once in a fixed stack.
That gives the model more computation per token without proportionally increasing its parameter count, potentially letting a smaller model behave more like a larger one while using less memory and bandwidth.
The concern is that more of this reasoning can happen inside internal numerical states rather than readable chain-of-thought text, making human monitoring harder.
OpenAI says Astra is its first model to reach the Critical cybersecurity capability threshold. Under its Preparedness Framework, that means Astra can, with the right tools and access, find unknown flaws and develop exploits across hardened systems without step-by-step human guidance. Hence, OpenAI now says Astra will launch with additional chain-of-thought monitoring, while classifiers can automatically stop potentially unauthorized actions. Astra reached roughly 39% exploit success at ~75K output tokens, while GPT-5.6 Sol is only around 1% there and needs nearly 140K tokens to reach ~12% i.e. Astra is dramatically more capable and token-efficient at exploit development on this internal benchmark. Expert assessments went further: Astra escaped a browser sandbox, executed host commands, and escalated an unprivileged operating-system user to root.在 X 查看被引用的帖子
来源:Rohan Paul · x.com