跳到正文
Artificial Analysis· @ArtificialAnlys · X·· 2026-07-11AI 评分75
AI 导读

Meta 发布 Muse Spark 1.1,在 Artificial Analysis 智能指数中得分 51,较三个月前的 1.0 版本(43 分)提升 8 分。该模型在科学推理、编程和知识领域表现突出,与 GLM-5.2、GPT-5.4 和 GPT-5.6 Luna 并列 51 分,落后 Grok 4.5(54 分)3 分。Muse Spark 1.1 在 Humanity's Last Exam 上达到 45%,接近 Claude Opus 4.8(46%)。其 token 效率领先:运行智能指数仅需 9400 万输出 token,低于 GPT-5.4(1.09 亿)和 GLM-5.2(1.41 亿)。定价为每百万输入/输出 token 1.25/4.25 美元,缓存命中低至 0.15 美元。上下文窗口从 262k 扩展至 100 万 token,输出速度约 114 token/s。AA-Omniscience 得分提升主要源于幻觉率从 73% 降至 38%,而非准确率提升。

正文 · 原文

Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index and is cost and token efficient compared to its peers

Muse Spark 1.1 (xhigh) improves 8 points over Muse Spark 1.0 (43) in three months. It is effectively tied with GLM-5.2 (max), GPT-5.4 (xhigh), and GPT-5.6 Luna (max) at 51, three points behind Grok 4.5 (high, 54), with the leading edge at Claude Fable 5 (60), GPT-5.6 Sol (max, 59), and Claude Opus 4.8 (max, 56).

The gains concentrate in Scientific Reasoning, coding, and knowledge; agentic knowledge work lags on GDPval-AA v2.

@AIatMeta shared access with us ahead of public release for benchmarking. Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release!

Key Takeaways:
➤ Muse Spark 1.1 gains substantially on the first Muse Spark release. This was driven in particular by gains in agentic knowledge work (GDPval-AA v2) and coding (SciCode, TerminalBench). On Humanity's Last Exam, it reaches 45%, within a point of Claude Opus 4.8 (max, 46%) and ahead of GPT-5.5 (44%) and Grok 4.5 (high, 40%)
➤ The most token-efficient of the models effectively tied at 51 and among the cheaper models to run. Muse Spark 1.1 used 94M output tokens to run the Intelligence Index, fewer than GPT-5.4 (xhigh, 109M), GPT-5.6 Luna (max, 125M), and GLM-5.2 (max, 141M). We estimate ~$0.26 per Intelligence Index task at Meta's $1.25/$4.25 pricing - below GLM-5.2 ($0.37) and roughly 3x below GPT-5.4 ($0.89)
➤ The AA-Omniscience gain is driven by abstention rather than accuracy. The score more than quadrupled from 4 to 18 as the hallucination rate fell 35 points (73% to 38%), with the attempt rate down from 95% to 82% and accuracy roughly flat (45% to 41%)

Other model details:
➤ Context window: 1M tokens, up from 262k for Muse Spark 1.0
➤ Pricing: $1.25/$4.25 per 1M input/output tokens; cache hits discounted to $0.15 per 1M
➤ Output speed: ~114 tokens/s median on Meta's first-party API, with a ~21s time to first answer token
➤ Availability: Meta's first-party API at launch

来源:Artificial Analysis · x.com