Tencent Hy· @TencentHunyuan · X·· 2026-08-30AI 评分47
AI 导读
腾讯混元 Hy4-preview 从发布首日起即支持在 vLLM 中运行，并已在 NVIDIA GPU 上完成验证。该模型总参数量 770B，激活参数 49B，采用 256 个路由专家加 1 个共享专家，支持 1M 上下文但每次查询仅关注 2048 个 token。
正文 · 原文
Hy4 preview runs in vLLM
@TencentHunyuan's Hy4-preview runs in vLLM from day 0, verified on NVIDIA GPUs. 🎉 - 770B total, 49B active, 256 routed experts plus one shared - 1M context, but each query attends to just 2048 tokens - Only 21 of the 78 layers compute their own sparse index, the other 57 reuse one - A 10B MTP layer ships inside the checkpoint, 0.7B of it active, draft depth 3 Tencent's HPC-Ops attention and MoE kernels have been in vLLM main since Hy3. VLLM_ENABLE_HPC_OPS=1 vllm serve tencent/Hy4-preview-FP8 -tp 8 Thanks @TencentHunyuan for the preview weights! 🙌 🔗 http://recipes.vllm.ai/tencent/Hy4-preview在 X 查看被引用的帖子
来源：Tencent Hy · x.com