跳到正文
Greg Brockman· @gdb · X·· 2026-08-25AI 评分41
AI 导读

OpenAI 公布首款自研推理芯片 Jalapeño 的实测性能:在基于 GPT-OSS 120B 的公开基准 InferenceX 上,其每千瓦峰值吞吐量更高、token 延迟更低,并在 DeepSeek R1 和 Kimi K2 上表现强劲。AI 参与设计使其从初始设计到流片仅用九个月,计划年底前部署,Gen 2 和 Gen 3 已在开发中。

正文 · 原文

inference numbers published for jalapeno, team did an amazing job https://openai.com/index/jalapeno-first-results/

引用tae kim@firstadopter
OpenAI: "Today, we shared the first measured performance results from Jalapeño, OpenAI’s first custom inference chip. On InferenceX, a public benchmark using GPT‑OSS 120B, Jalapeño delivered more peak throughput per kilowatt and lower token latency than the commercial systems in the comparison. It also performed strongly on DeepSeek R1 and Kimi K2, showing that its gains extend across model families." "This is Jevons paradox: greater efficiency makes more uses worthwhile, expanding consumption and creating new economic activity through more work completed, better decisions, more products launched, and more revenue generated." "AI played a direct role in Jalapeño’s development, enabling the team to move from initial design to tapeout in nine months by exploring implementations, shortening design, measurement, and verification loops, and continuously iterating on model workloads. AI also helped optimize the chip’s arithmetic circuits, allowing the team to fit more compute performance into the chip on schedule." "We plan to begin deploying Jalapeño within OpenAI’s compute infrastructure by the end of the year. It is the first generation of a multigenerational roadmap: Gen 2 is deep in development, and Gen 3 is taking shape. Each generation will build on what we learn and further advance both efficiency and speed." "As we prepare for deployment, we are continuing production qualification, maturing the software, preparing to operate Jalapeño at scale, and validating performance across more models."
在 X 查看被引用的帖子

来源:Greg Brockman · x.com