OpenAI 为 GPT-6 的提示词缓存带来更高命中率、诊断工具、断点、预热和保留缓存的推理变更。缓存复用可将缓存输入 token 成本降低最多 90%,新仪表盘展示缓存命中率及缓存与未缓存 token 量。作者指出高命中率仍是应用设计问题,开发者需让长时运行智能体的稳定指令和工具保持可复用。
OpenAI is making GPT-6 prompt caching more reliable and controllable, adding higher hit rates, diagnostics, breakpoints, prewarming, and cache-preserving reasoning changes.
Long-running agents often resend instructions, tool definitions, and earlier context, so caching avoids recomputing those prefixes across successive API calls.
That reuse can cut cached-input token costs by up to 90%, while a new dashboard exposes cache-hit rates and cached versus uncached token volume.
ofcourse, a high cache hit rate is still remains partly an application-design problem. because GPT-6’s improved caching alone doesn’t guarantee good economics; developers still need to structure long-running agents so stable instructions and tools remain reusable.
来源:Rohan Paul · x.com