更强的AI智能体不仅来自更大模型,更来自其系统(Harness)——决定模型所见、可用工具、记忆及动作检查的完整系统。进步应聚焦扩展Harness的三个核心:更好的上下文控制(长上下文≠可用上下文)、更可信的记忆(过时笔记比无笔记更危险)、更优的工具或辅助智能体路由(多工具≠知何时用)。一次性基准分数愈发单薄——两个智能体可能给出相同答案,但一个消耗更多token、风险调用、携带污染记忆。下一前沿是扩展系统纪律,而非仅扩展机器内的思维。
Stronger agents will not come only from larger models, but from better systems around them.
The problem is that many AI agents are judged as if the model alone did the work, even though the real behavior also depends on memory, tools, context, routing, checks, and permissions.
This surrounding setup around the agent is called harness, meaning the system that decides what the model sees, what tools it can use, what it remembers, and what actions get checked.
Progress should come from scaling this harness, especially 3 parts: better context control, more trustworthy memory, and better routing to tools or helper agents.
Long context is not the same as usable context, memory is not the same as trustworthy memory, and having many tools is not the same as knowing when to use them.
A stale note can be more dangerous than no note, because it gives the agent confidence exactly when it should re-check the world.
A specialized subagent can also fail quietly if its output sounds plausible but no later layer verifies whether it is true.
This is why one-shot benchmark scores feel increasingly thin.
Two agents can reach the same final answer, while one burns far more tokens, makes riskier tool calls, carries corrupted memory, or succeeds only by accident.
The next frontier is not just scaling the mind inside the machine.
It is scaling the discipline around it.
----
– arxiv. org/abs/2605.26112
Title: "From Model Scaling to System Scaling: Scaling the Harness in Agentic AI"
来源:Rohan Paul · x.com