跳到正文
Rohan Paul· @rohanpaul_ai · X·· 2026-09-06AI 评分51
AI 导读

上海人工智能实验室提出 Harness-of-Harness(HoH)框架,让编码智能体在多次迭代间持续携带代码、测试证据、已知问题和更新后的计划。

正文 · 原文

Harness-of-Harness beat repeated coding-agent runs by carrying code, QA evidence, and plans forward.

Says long-horizon coding is not just about giving an agent more time; it needs persistent project state, independent testing, and replanning from real failures.

The problem: over a long project, coding agents can forget earlier decisions, repeat work, break working features, and miss unfinished requirements.

Harness-of-Harness, or HoH, fixes this by carrying the current software, test evidence, known problems, and an updated plan into the next coding run.

It improved all 3 tested agent setups across 3 software benchmarks.

The clearest comparison used Codex + GPT-5.5 on GameCraft-Bench: after 3 passes, HoH scored 71.52, while simply continuing the same coding agent scored 58.24.

The paper also ran HoH for 70 loops and produced a playable FPS from high-level requirements.

That longer test is only 1 game project and used extra tools and skills, so broader real-world generalization is still open.

So for long-running coding agents, invest in persistent project state, independent QA, and evidence-driven replanning—not just more calls.

来源:Rohan Paul · x.com