普渡大学论文提出 Naive Prompt Optimization(NPO),只保留一条提示词谱系,由教师模型根据近期 rollout 轨迹和奖励迭代修改。在 IFBench 和 HotpotQA 上,NPO 以更少的 rollout 达到与基于 Pareto 选择维护多候选的 GEPA 相当或更好的结果:3,500 vs 3,593 和 6,800 vs 6,871。
Prompt optimization may not need a search tree at all.
It may depend more on the quality of the teacher and its feedback than on how elaborate the search algorithm is.
This paper tests NPO, which keeps 1 prompt lineage and asks a teacher model to revise it from recent rollout traces and rewards.
Against GEPA, which maintains multiple prompt candidates with Pareto-based selection, NPO reached comparable or better results on IFBench and HotpotQA with slightly fewer rollouts: 3,500 vs 3,593 and 6,800 vs 6,871.
The gap widened as the teacher got stronger.
The gap widened as the teacher got stronger.
With DeepSeek-V4-Flash and especially GPT-5.5, NPO improved more consistently than GEPA, suggesting that stronger teacher reasoning plus rich feedback can replace some optimizer-side search.
Those optimized prompts also transferred to other student models, especially within the same model family.
来源:Rohan Paul · x.com