OpenAI 首款自研推理芯片 Jalapeño 已在实验室完成实测,从概念到真实负载表现优异。该芯片在更高吞吐和更低延迟上实现“每瓦特更多智能”,并与 Cerebras 深度合作推动 /ultrafast 高速推理,满足大量客户需求。
Excited about our Jalapeno results today. An incredible achievement from the team, taking a new chip from concept all the way to very impressive performance on real workloads in the lab.
Tomorrow’s fast will feel like today’s ultrafast. As I’ve mentioned before, we’re pushing to bring this to as many people as possible.
We’ve seen a TON of demand for /ultrafast, made possible by our deep partnership with Cerebras and their unique hardware, which will push the frontiers of tomorrow's ultrafast even further. I’m very much looking forward for the collaboration to continue pushing the absolute limits of how fast we can run our most capable models on Cerebras and bring this to the most demanding customers.
Since announcing Jalapeño, our first custom inference chip, we’ve been testing it and the system around it. The results show a major advance: more intelligence from every watt and faster responses, delivering both higher throughput and lower latency in one architecture without sacrificing efficiency.在 X 查看被引用的帖子
来源:Tibo · x.com