跳到正文
OpenBMB· @OpenBMB · X·· 2026-09-08AI 评分56
AI 导读

面壁智能 OpenBMB 宣布 MiniCPM5-2B 就绪,可通过 SGLang 部署,SGLang 提供首日(day-0)服务支持。SGLang 配方覆盖 NVIDIA RTX PRO 6000、RTX 5090、DGX Spark 和 Hopper 卡,在 5090 上启用 DSpark 后编码任务 bs=1 下单用户解码速度超过 250 tok/s。

正文 · 原文

Big thanks to @sgl_project for the day-0 support ! MiniCPM5-2B is ready to deploy with SGLang today.

引用SGLang@sgl_project
Congrats @OpenBMB on launching MiniCPM5-2B! SGLang has day-0 serving support, with recipes for @NVIDIAAI RTX PRO 6000, RTX 5090, DGX Spark, and Hopper cards. We are seeing over 250 tok/s/user decode at bs=1 on coding tasks with DSpark enabled on a 5090. It's an ultra-efficient 2B with incredible intelligence density. As of today it leads Artificial Analysis's Intelligence Index among open models under 4B, and scores above models more than 4x its size. This is another step toward general-purpose models running 24x7 on device, even on phones. Run MiniCPM5-2B with SGLang 👇
在 X 查看被引用的帖子

来源:OpenBMB · x.com