#评测/基准
Arena.ai@arenaAI 评分5555
Artificial Analysis@ArtificialAnlysAI 评分5151
Artificial Analysis@ArtificialAnlysAI 评分5858
Artificial Analysis@ArtificialAnlysAI 评分6565Artificial Analysis 评测 Mistral 刚开放权重的旗舰模型 Mistral Large 4,总参数 1.05T、激活参数 52B,上下文窗口 1M tokens。
Artificial Analysis@ArtificialAnlysAI 评分6565
Arena.ai@arenaAI 评分6161引用Arena.ai@arenaReal-world results are in: GPT-6.1 Terra (Max) by @OpenAI just landed #14 in the Code Arena: WebDev with 1671 pts, delivering Pareto level results! That’s +151 pts over GPT-5.6 Terra, now at #56. At a median cost of $0.40 per task, GPT-6.1 Terra costs 28% less than GPT-5.6 Terra ($0.56 per task), reshaping the Pareto frontier. Compared to other models in the family, GPT-6.1 Terra (Max) is incredibly efficient: - 81 pts below #4 GPT-6.1 Sol (1752 pts), at 75% lower median cost per task. - Just 6 pts below #11 GPT-6 Sol (1677 pts), at 76% lower median cost per task Congrats to the @OpenAI team on this release!
Google@GoogleAI 评分6464引用Artificial Analysis@ArtificialAnlysGoogle’s Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5, and second only to Claude Opus 5.5 on the Artificial Analysis Coding Agent Index Gemini 4 Carbon scores 59 on Intelligence Index v5, driven by leading performance in complex reasoning, knowledge, and scientific tasks. It also has large gains in coding and knowledge work, particularly when compared to other Gemini models, but it is not leading in all these areas. As with launch of Gemini 4 Argon, Gemini 4 Carbon is being rolled out to selected users and is not yet publicly available. Google is offering a 50% launch discount, with no confirmed end date. All our charts and figures use standard pricing for both Gemini 4 Carbon and Argon. Key results for Gemini 4 Carbon with high reasoning: ➤ Gemini 4 Carbon leads the Intelligence Index v5, with the #1 score in 4 of the 9 Index evaluations: HLE-Diamond, Terminal-Bench-Science, AA-Omniscience, AutomationBench-AA. Carbon makes substantial gains elsewhere but is not leading in coding and knowledge work ➤ Behind only Claude Opus 5.5 on coding agents: With Antigravity CLI, Gemini 4 Carbon (high) scores 59 only 3 points behind Claude Code with Claude Opus 5.5 (max, 62) on the Artificial Analysis Coding Agent Index. Carbon ranks second on both Terminal-Bench 4.0 (64%) and FrontierCode v1.1 (51%), behind Claude Opus 5.5 (max) at 56%. Google has historically underperformed in this area and so this improvement stands out ➤ Improved agentic knowledge work, but not yet leading: On AA-Briefcase, Gemini 4 Carbon (high) scores 1609 Elo, a 126-point improvement over Gemini 4 Argon (high, 1483), but still behind models including Grok 4.7 (xhigh, 1638), Muse Wonder (max, 1659) and Kimi K3.1 Pro (1678). The largest gain comes from Presentation, up 293 Elo to 1598, alongside a 120-point improvement in Analytical Quality to 1671 ➤ Lower Cost per Task than Claude Opus 5.5 for comparable overall intelligence: Gemini 4 Carbon costs $7.76 per Intelligence Index task, ~23% less than Claude Opus 5.5 (max, $10.04) but ~1.2x GPT-6 Astra (max, $6.25). It uses 123k output tokens per task, 29% fewer than Claude Opus 5.5 (max, 173k). At the same $4/$20 standard pricing, its Cost per Task is in line with Gemini 4 Argon ($7.68), while scoring 9 points higher on the Intelligence Index ➤ Leading AA-Omniscience v1.1 score, with low hallucination: Gemini 4 Carbon scores 54 on our recently updated AA-Omniscience v1.1, 6 points ahead of Claude Opus 5.5 (max, 48) and 8 points ahead of Gemini 4 Argon (46). Accuracy (% correct) rises 10 points over Argon to 58%, while its hallucination rate rises from 4% to 11%. This is still the second lowest of any model, behind only Argon, compared with 50% for both Claude Opus 5.5 (max) and GPT-6 Astra (max) Key model details: ➤ Context Window: 1M tokens ➤ Multimodality: Text, image, video, and speech input, with text output ➤ Pricing: $4/$20 per 1M input/output tokens, the same as Gemini 4 Argon’s standard pricing, with a 50% discount. Cached input tokens receive a 95% discount ($0.20 per 1M) Congratulations to the @GoogleDeepMind team!
Arena.ai@arenaAI 评分6868引用Arena.ai@arenaExciting news: Gemini 4 Carbon (High) from @GoogleDeepMind just made a huge debut on Arena, landing #1 in Text Arena, #2 in Agent Arena, and #4 in Code Arena: WebDev. Back at the top, Gemini 4 Carbon delivers frontier intelligence and reshapes the Pareto frontier across three arenas. In Agent Arena, Gemini 4 Carbon ranks #2 with a +16.2% net improvement across +21.9K real-world agentic sessions from our global community, surpassing top models GPT-6 Astra and Fable-5.1. At $1.80 median cost per task, Gemini 4 Carbon (High) costs 72% less than the #1 ranked Claude Opus 5.5 (Max). Its standouts by key signals: - #1 Steerability (+18.6%): can the model course-correct when you push back? - #2 Praise vs Complaint (+37.9%): implicit sentiment in users' reactions - #3 Confirmed Success (+18.7%): explicit “yes, that worked” from users In Code Arena: WebDev, Carbon scored 1768 pts landing #4: - Just 2 pts below #3 Claude Sonnet 5.5 (xHigh), at 1770 pts - 89 pts above #11 Gemini 4 Argon (High), at 1679 pts By category, it ranks #3 in Gaming and Simulations, and #5 in Brand & Marketing. In Text Arena, Gemini 4 Carbon (High) is the new #1 with 1528 pts, now ahead of Gemini 4 Argon (High) at #2 with 1520 pts. Congrats to the @GoogleDeepMind team on this huge milestone!
Arena.ai@arenaAI 评分6969引用Arena.ai@arenaGemini 4 Carbon (High) by @GoogleDeepMind landed on the Pareto frontier in Agent Arena, Code Arena: WebDev, and Text Arena! In Agent Arena, it ranks #2 with +16.2% net improvement at $1.80 median cost per task. This is 72% less than #1 Claude Opus 5.5 (Max). Dive into the Agent Arena Pareto, and see where Gemini 4 Carbon (high) landed on the Pareto frontier for Code Arena: WebDev and Text at https://arena.ai/leaderboard/agent/pareto
Artificial Analysis 完整文章AI 评分7171 Artificial Analysis:Gemini 4 Carbon 登顶 Intelligence Index v5 榜首
Artificial Analysis 评测显示 Google 的 Gemini 4 Carbon 以 59 分登顶 Intelligence Index v5,编码 Agent 指数 59 分仅次于 Claude Opus 5.5 的 62 分。
Rohan Paul@rohanpaul_aiAI 评分7272Google DeepMind 发布新前沿模型 Gemini 4 Carbon,在 Artificial Analysis 上超过 GPT-6 Astra 和 Claude Opus 5.5。
引用Google DeepMind@GoogleDeepMindGemini 4 Carbon is our next frontier model. It’s state-of-the-art across cybersecurity and long-horizon capabilities.
IT之家·人工智能AI 评分6666 Artificial Analysis 发布 Intelligence Index v5 基准,DeepSeek V4.1 Flash 1017 取 FrontierCode 2.0 开源最高分
Artificial Analysis 昨日发布 Intelligence Index v5,60% 评测权重首次建立在私有测试集或隐藏答案之上,并把 Cognition 的 FrontierCode 2.0 纳入编码评测,按仓库维护者是否愿意合并 PR 打分。
Artificial Analysis@ArtificialAnlysAI 评分7171Artificial Analysis 评测显示,Google 的 Gemini 4 Carbon 以 59 分登上 Intelligence Index v5 第一。
Arena.ai@arenaAI 评分7373引用Google DeepMind@GoogleDeepMindGemini 4 Carbon is our next frontier model. It’s state-of-the-art across cybersecurity and long-horizon capabilities.
Demis Hassabis@demishassabisAI 评分4545⚡以闪电般的速度迭代!Gemini 4 Carbon 在关键基准上达到 SOTA,将前沿能力与深入的安全与保障研究相结合。
Artificial Analysis@ArtificialAnlysAI 评分5353
Artificial Analysis@ArtificialAnlysAI 评分5555
Artificial Analysis@ArtificialAnlysAI 评分6969
Artificial Analysis@ArtificialAnlysAI 评分5757The Decoder:AI NewsAI 评分6161 Artificial Analysis 新版 Intelligence Index 扩大开源与闭源模型差距
Artificial Analysis 改版其 Intelligence Index 至版本 5,Kimi K3.1 Pro 从第 4 降至第 9,开源模型与榜首差距从 3 分扩大到 12 分,Grok 4.7 也下跌 12 分。
Artificial Analysis 完整文章AI 评分6565 Artificial Analysis 发布 Intelligence Index v5 评测基准
Artificial Analysis 发布 Intelligence Index v5,引入 FrontierCode 2.0 和 Terminal-Bench-Science 两个新基准,并升级 HLE-Diamond、AA-Omniscience v1.1 和 CritPt v2,60% 的指数基于私有测试集或保留答案。
IT之家·人工智能AI 评分5959 谷歌更新 Android Bench 榜单:Gemini 4 Argon 编程能力落后于 Claude 与 GPT
谷歌更新评估安卓编程辅助能力的 Android Bench 榜单,新增 GPT-6 Sol、GPT-6.1 Sol、Claude Sonnet 5、Claude Sonnet 5.5 和 Gemini 4 Argon 的成绩,并标注各模型推理等级。
Artificial Analysis@ArtificialAnlysAI 评分5555
Artificial Analysis@ArtificialAnlysAI 评分4141
Artificial Analysis@ArtificialAnlysAI 评分4646
Arena.ai@arenaAI 评分6161Arena 公布 GPT-6.1 Terra (Max) 在 Code Arena: WebDev 榜单以 1671 分位列第 14,比 GPT-5.6 Terra 高 151 分,后者现列第 56。
引用OpenAI@OpenAIGPT-6.1 Terra:以更低的价格提供快速且强大的计算机使用能力。 GPT-6.1 Terra 能理解屏幕上的内容,跨应用执行操作,写作自然流畅,是一个能胜任你整个工作日的更强大模型,并具备承担更多工作的效率。
Mustafa Suleyman@mustafasuleymanAI 评分5757引用Artificial Analysis@ArtificialAnlysMicrosoft's MAI-Image-2.7-Preview takes #2 on AA-Image-Editing v2.1, close behind OpenAI's GPT Image 2.5 Sunburst (max) and a clear step up from MAI-Image-2.6 MAI-Image-2.7-Preview is Microsoft AI's newest image editing model, succeeding MAI-Image-2.6, released in August. In our testing, MAI-Image-2.7-Preview scores higher than MAI-Image-2.6 on all 7 editing actions we measure, and ranks #1 on 4 of them: Scene & Style Edit, Text or Symbol Edits, Reasoning-Based Edit, and Enhancement & Restoration. This new model improves on MAI-Image-2.6 with the biggest gains in Composition & Framing (+57 Elo), Text or Symbol Edits (+49) and Scene & Style Edit (+48). We see its best use cases to be in Live-Action Film, Consumer and Frontier edits, where it ranks #1. MAI-Image-2.7-Preview is available today in MAI Playground for image editing only, with text to image stated to be coming soon. Congratulations to @MicrosoftAI on the release! See below for our detailed analysis and example outputs of MAI-Image-2.7-Preview in the Artificial Analysis Image Arena 🧵
Artificial Analysis@ArtificialAnlysAI 评分5858
IBM Research:AIAI 评分5353 IBM 与 Kaggle 上线 ScarfBench 智能体 Java 框架迁移榜单
IBM 与 Kaggle 合作推出 ScarfBench 持续维护的公开榜单,评测编码智能体能否将企业 Java 应用在 Jakarta EE、Quarkus 和 Spring 之间迁移并保持应用行为。
公众号:面壁智能AI 评分4444 面壁智能 ForgeKernel 登顶华为 CANNBench 与英伟达 SOL-ExecBench 算子榜
面壁智能自研 AI 算子生成系统 ForgeKernel 同时登顶华为 CANNBench 950DT、950PR、A3 三大硬件榜单和英伟达 SOL-ExecBench(FlashInfer-Bench 合集)。
Artificial Analysis@ArtificialAnlysAI 评分4343
Arena.ai@arenaAI 评分7575引用OpenAI@OpenAIGPT-6.1 Terra:以更低的价格提供快速且强大的计算机使用能力。 GPT-6.1 Terra 能理解屏幕上的内容,跨应用执行操作,写作自然流畅,是一个能胜任你整个工作日的更强大模型,并具备承担更多工作的效率。
Artificial Analysis 完整文章精选AI 评分7676 Artificial Analysis 评测 GPT-6.1 Terra:以不到三分之一成本推进性价比前沿
Artificial Analysis 评测 OpenAI 发布的 GPT-6.1 Terra,称其在低中 effort 下达到智能与成本的 Pareto 前沿,价格为 GPT-5.6 Terra 的一半或更低($1/$5 每百万输入/输出 token)。
推荐理由:评测方给出 GPT-6.1 Terra 在智能指数、幻觉率和编码代理基准上的具体得分与成本对比,读者可据此评估其性价比位置。
Artificial Analysis@ArtificialAnlys同事件AI 评分7878Artificial Analysis 评测 OpenAI 新发布的 GPT-6.1 Terra,称其为 GPT-5.6 之后首个 Terra 级模型,智能更高而成本不到三分之一。
同一件事,精选收录的是《Artificial Analysis 评测 GPT-6.1 Terra:以不到三分之一成本推进性价比前沿》
OpenAI:部署安全与系统卡AI 评分4848 GPT-6.1 Terra 系统卡增补:生物化学能力定为 High,Sandbox Bench 通过率 22.7%
OpenAI 发布 GPT-6 Astra 系统卡增补,说明 GPT-6.1 Terra 沿用与 GPT-6 Astra 相同的数据与训练方式。该模型在生物与化学领域被定为 High 能力,Multimodal Troubleshooting Virology 越过指示性阈值。