5.6 Terra high is underrated. Switched @clawsweeper (GitHub review bot) to it and it's ~40% faster overall with negligible quality loss. Better than 5.5 on all counts. Massively cheaper. (Tried xhigh but that negates perf wins, didn't make a noticable difference in review evals)
#推理
Greg Brockman@gdbAI 评分5050引用Peter Steinberger 🦞@steipeteApple Machine Learning ResearchAI 评分5050 Apple 研究:Show Me Examples — 从图像集推断视觉概念
Apple 机器学习研究团队提出一种方法,让视觉语言模型(VLM)仅从图像集示例中推断视觉概念,无需文本指令。该方法通过对比示例图像与候选图像,使模型捕捉颜色、纹理等视觉规律,在多个概念推理基准上提升准确率。该研究目前为学术论文,未公布模型或 API 可用性。
Artificial Analysis@ArtificialAnlys精选AI 评分7676推荐理由:八天四个前沿模型,Frontier 从两家实验室变成六家,前三名分差仅三分,而且价格正在暴跌,模型选型的逻辑从「谁第一」变成了「够用且便宜」——对产品经理来说是真正的转折点。
TechCrunch:AIAI 评分5858 首家GPU金融商转向推理芯片:General Compute获4亿美元贷款,以SN50芯片为抵押
AI推理云初创公司General Compute从科技投资公司Upper90获得4亿美元贷款,可能是首笔以推理专用芯片为抵押的交易。其SN50芯片专为推理设计,功耗低且无需水冷,宣称推理速度比基于GPU的云服务快16倍。Upper90此前曾为Crusoe的GPU采购提供融资,如今转向押注开源模型推理基础设施。
Elon Musk@elonmuskAI 评分4646Elon Musk 发推“Try Grok”并引用第三方测试,对比 Grok 4.5、Kimi K3、GPT 5.6 Sol 和 Fable 5 在 Three.js 代码生成上的表现。
引用thehype.@thehypedotnewskimi k3 vs gpt 5.6 sol vs fable 5 vs grok 4.5 @Kimi_Moonshot just dropped kimi k3 – a 2.8t param native multimodal model, the first open 3t-class release. key facts: • 1m token context. stable latentmoe activating 16 of 896 experts, built on kimi delta attention (kda) and attention residuals • quantization-aware training from the sft stage onward – mxfp4 weights, mxfp8 activations. moonshot claims ~2.5x scaling efficiency over k2 • max thinking effort by default. low- and high-effort modes are "coming in updates" – there is no way to turn the thinking down today, and you feel it in every run • pricing: $0.30/mtok cache-hit input, $3.00/mtok cache-miss, $15.00/mtok output. claims >90% cache hit rate on coding workloads • benchmarks: swe marathon 42.0 (1st – fable 5: 35.0, sol: 39.0, opus 4.8: 40.0), terminal bench 2.1 88.3, browsecomp 91.2 (1st), program bench 77.8 (1st), gpqa-diamond 93.5. loses frontierswe 81.2 vs fable's 86.6, and deepswe 67.5 vs sol's 73.0 our test – 3 prompts, single-file html, @threejs, fully procedural, no assets: 1. photorealistic european roulette wheel – 37 pockets in the real sequence, mahogany clearcoat bowl, chrome turret, diamond deflectors, flick-to-spin, ball that spirals inward and settles on a mathematically real number 2. las vegas slot machine – 3 reels behind transmissive glass, drag the chrome lever to play, mechanical odometer counters modelled in 3d, coin physics on win 3. full pinball table – 6.5° tilted playfield, flipper impulse physics, spline ramps, drop targets, 6 bumpers, mechanical score reels in the backbox we ran the test on @aimlapi platform results: - cost #1 grok 4.5 – $0.30 #2 kimi k3 – $0.71 #3 gpt 5.6 sol – $2.05 #4 fable 5 – $7.69 - tokens #1 grok 4.5 – 34,241 #2 gpt 5.6 sol – 51,748 #3 fable 5 – 144,126 #4 kimi k3 – 157,999 - lines of code #1 gpt 5.6 sol – 3,054 #2 grok 4.5 – 3,047 #3 kimi k3 – 2,255 #4 fable 5 – 1,950 - generation time #1 grok 4.5 – 5.1 min #2 gpt 5.6 sol – 22.0 min #3 fable 5 – 31.5 min #4 kimi k3 – 75.6 min observations: • kimi k3 is cheap and it is slow. 75.6 minutes across three prompts against grok's 5.1. it is 2.4x grok's price and 15x grok's wall clock. the roulette took 15 min, the slot 18, the pinball 42 • it failed 2 of 3. only the roulette works. the slot machine has reel cutouts on both faces of the cabinet and the symbols face backwards – you can only read your spin by walking around to the rear of the machine. the pinball table stands vertically on its edge with the legs floating detached beside it. • 81% of kimi's output tokens are reasoning, not code. grok: 22%. you are not paying for a bigger answer, you are paying for a longer argument with itself • price per 100 shipped lines – grok $0.010, kimi $0.031, sol $0.067, fable $0.394. a 39x spread for the same three files kimi k3's code quality: upsides: • the roulette is genuinely good – procedural wood grain with real specular breakup, correct european sequence (0-32-15-19-4...), chrome turret, diamond deflectors, clean console • the pinball artwork is the best in the test – a synthwave "nova strike / deep space" field with six individually coloured neon bumper rings, a retro sun on a grid horizon, a nova burst, and a scoring legend printed on the apron. no other model printed the rules on the machine. it is a beautiful texture on a broken object • physics reasoning is real – it derived a 480hz substep for the collider, worked out ball settle conditions and termination guarantees, and checked every ramp exit vector by hand before writing any of it • it is the only model that saw the importmap trap coming. sol shipped a blank white page twice because three.js addons import the bare specifier 'three' and die without an import map downsides: • it dodged that trap on the slot by loading three.js r128 through classic script tags – a 2021 build with no working transmission. its slot glass rendered fully opaque and buried all three reels behind a white pane. the code asks for transmission: 0.93, ior: 1.5 – correct, and silently ignored by a renderer that predates the feature • after 42 minutes and 212k characters of reasoning, the pinball cabinet is not assembled. the table stands vertically on its edge like a wardrobe – the prompt asked for 6.5° from horizontal, it delivered 90°. the legs float detached in the void beside it. head-on it photographs beautifully; orbit ten degrees and it is a painted slab with four chrome rods hovering nearby • the playfield z-fights with the glass – hard black banding across the whole field as soon as you pull the camera back a note on the pinball, in fairness to kimi: nobody passed it. every model shipped broken ball physics and controls you cannot trust. it is the hardest prompt we have run and the whole field failed it, each in its own way kimi k3 reasons better than anything else here and it shows exactly where reasoning pays – physics constants, sequences, edge cases, traps the others walked into follow @thehypedotnews for 24/7 ai news, analysis and breakdowns
IT之家·人工智能AI 评分4141 Kimi K3 展示“AI 为 AI 设计芯片”能力:2 天完成构建、优化、验证
月之暗面在 Kimi K3 技术博客中展示了其模型芯片设计能力。K3 在 48 小时内利用开源 EDA 工具,基于 Nangate 45nm 库自主完成了 nano 模型专用芯片的构建、优化和验证。该芯片集成 146 万个标准单元、0.277MB SRAM 及 INT4 MAC 阵列,面积 4 mm²,在 100 MHz 下仿真解码吞吐量超 8700 Token/s。
公众号:月之暗面精选AI 评分8080 Kimi K3:智能的新前沿
Kimi 发布迄今能力最强的开源模型 Kimi K3,拥有 2.8 万亿参数、100 万 token 上下文窗口,原生支持视觉理解。该模型在长程编程、知识工作等场景表现前沿,整体能力仅次于 Claude Fable 5 和 GPT-5.6 Sol。即日起可通过 kimi.com 及官方 App 使用,完整模型权重将于 2026 年 7 月 27 日前发布。
推荐理由:Kimi K3 以 2.8 万亿参数开源,虽自承不及闭源顶尖,但长程编码与知识工作案例扎实,是国产开源模型冲击前沿的关键一步,开发者值得跟进。
公众号:月之暗面精选AI 评分8383 Kimi K3:智能的新前沿
月之暗面推出迄今能力最强的开源模型 Kimi K3,拥有 2.8 万亿参数、100 万 token 上下文窗口,基于 KDA 混合线性注意力机制构建,原生支持视觉理解。它在长程编程、知识工作等场景表现前沿,但整体仍落后于 Claude Fable 5 和 GPT-5.6 Sol。即日起可通过 kimi.com 等渠道使用,完整权重将于 2026 年 7 月 27 日前发布。
推荐理由:K3 把 2.8 万亿参数开源,并展示了从内核优化到芯片设计的连贯长程能力,为评估开源模型在复杂工程任务中的实际上限提供了参照。
公众号:数字生命卡兹克精选AI 评分7575 Kimi 正式发布 2.8 万亿参数大模型 K3,将于 7 月 27 日全面开源
月之暗面发布 Kimi K3,参数量达 2.8 万亿,支持百万上下文,将于 7 月 27 日全面开源。该模型在 AA 智能分数中排名第三,并在 BrowseComp、Automation Bench 和 SpreadsheetBench 2 三项 Agent 评测中取得第一。
推荐理由:国内首个 3 万亿参数开源模型,卡兹克的深度实测表明它在 Agent 和前端审美上表现惊艳,整体能力已能与 GPT-5.6 Sol 掰手腕,虽然推理成本可能不低,但值得开发者尽快体验。
Artificial Analysis@ArtificialAnlysAI 评分5757MarkTechPostAI 评分5858 OpenAI 公布 GPT-Red:内部自动化红队模型在提示注入测试中以 84% 对 13% 击败人类红队成员
OpenAI 训练了内部攻击模型 GPT-Red,通过自我对弈强化学习对抗防御 LLM 群体。在复现的间接提示注入测试中,GPT-Red 以 84% 对 13% 击败人类红队成员,发现了一种新型“虚假思维链”攻击类别,并将 GPT-5.6 Sol 在 OpenAI 最难直接注入基准上的失败率降低 6 倍。OpenAI 承认该模型在多轮和基于图像的攻击上仍有困难。
Moonshot AI:Kimi Blog精选AI 评分8181 Kimi K3 发布:2.8T 参数开源模型,具备原生视觉与百万 token 上下文窗口
月之暗面发布 Kimi K3,一个 2.8T 参数的开源模型,采用 Kimi Delta Attention 和 Attention Residuals 架构,支持原生视觉能力与 100 万 token 上下文窗口。
推荐理由:首个开源 3T 级模型,架构上有 KDA 和 AttnRes 创新,在超长程编码和知识工作上比肩闭源。权重两周后放出,所有做 agent 的都该盯紧。
Kimi.ai@Kimi_MoonshotAI 评分5252
IT之家·人工智能AI 评分6868 Kimi 迄今最强旗舰模型“K3”上线,支持最高 1M 上下文
月之暗面于 7 月 16 日上线旗舰模型 Kimi K3,支持最高 1M 上下文窗口,在编程、游戏/3D 与知识类任务中表现突出。Kimi Code 目前提供 K3 与 K2.7 Code 两个模型共 3 个模型 ID,用户可按需选择不同上下文长度版本。更多参数与价格信息有待官方后续公布。
Noam Brown@polynoamialAI 评分5757引用Edgar Dobriban@EdgarDobribanAI has helped resolve an important question in statistics. In the area of multiple hypothesis testing, the goal of controlling the false discovery rate (FDR) has been introduced in a seminal paper by Benjamini and Hochberg (1995). They also introduced a method (the Benjamini-Hochberg or BH method) and proved it controls the FDR. This method has been widely adopted in modern high-throughput science, including in genomics, astronomy, economics, etc. The paper has has garnered more than 130,000 citations to date. However Benjamini and Hochberg showed FDR control only when the data for the individual tests are *independent*. In practice, these data are often dependent; a good example is data on genetic variants due to linkage disequilibrium. Later work has focused on extending the validity of the BH procedure, e.g., to a form of positive dependence by Benjamini and Yekutieli (2001). The question of when the BH procedure controls the FDR has remained open. Over the last twenty years, many authors, including Reiner-Benaim (2007), Kim and van de Wiel (2008), Benjamini (2010), Sarkar (2023), Sarkar and Zhang (2025), have conjectured that the BH procedure controls the FDR for two-sided tests using any correlated Gaussian data. These authors have presented both theoretical and empirical evidence supporting, but not directly showing, the conjecture. With the help of AI (specifically GPT-5.6 Sol Pro), I have settled the question in the negative: The Benjamini-Hochberg procedure does *not* generally control the false discovery rate at the desired level for correlated two-sided Gaussian tests. This was done by exhibiting a Gaussian factor model for which, at a nominal level alpha=0.01, the false discovery rate is proved to be FDR>0.0104. There is a lot of interesting commentary to be made: 1. This result should be of interest to everybody in the field of statistics. Emmanuel Candes of Stanford University once called the false discovery rate and the Benjamini-Hochberg procedure "one of the two most important developments in statistics after 1950" (the other being James-Stein shrinkage). The present conjecture is probably the most central question about FDR/BH that was unresolved to date. 2. GPT-5.6 one-shot the problem after 90 minutes of reasoning, whereas with 5.5 I was not able to solve it even after iterating with multiple parallel agents for perhaps 20 hours. So the capability improvement is quite real. Exciting times to live in! 3. The argument is not especially surprising, but it does combine an asymptotic approach (standard for FDR analysis, see e.g., Genovese and Wasserman, Efron, etc) with a numerical certificate in a way that would be pretty non-standard in the field. Once we have the specific example, then straightforward simulations also support that the false discovery rate is indeed higher than the nominal value (see attached fig). 4. The current degree of violation over the nominal level is relatively small (0.104 vs 0.1). So the importance of this result is mainly conceptual. The practical implications remain to be determined. Overall, an exciting development! Preprint is available here (https://faculty.wharton.upenn.edu/wp-content/uploads/2017/06/bh.pdf) and will be on arxiv tonight; supporting code is here (https://github.com/dobriban/BH).
Google AI:DEV 作者专属精选AI 评分7272 DiffusionGemma 开发者指南发布
Google AI 发布 DiffusionGemma 开发者指南,该实验性模型基于 Gemma 4 架构,采用计算受限并行生成,在单张 NVIDIA H100 上实现 1000+ tokens/秒的生成速度。模型为 26B 参数的 MoE 架构,推理时仅激活 3.8B 参数,可在 18 GB VRAM 内量化部署。
推荐理由:虽然 DiffusionGemma 是实验性的,但把文本生成从内存带宽瓶颈转向计算瓶颈的思路非常新颖,这篇指南给出了可落地的服务方案和微调手法,做推理优化的值得跟进。
公众号:小红书技术精选AI 评分7777 HYPIC:小红书联合北大、上交提出首个混合注意力大模型位置无关缓存系统
HYPIC 在混合注意力大模型上实现了位置无关缓存,将首 token 延迟平均降低 3.25 倍。在 4 个生产级模型上,同 SLO 下可持续 QPS 提升 1.66 倍,任务质量与完全重算仅相差 1.71 分。
推荐理由:混合注意力模型终于有了可用的位置无关缓存方案,HYPIC 用转移算子缓存和缝合窗口解决了长期兼容难题,对长上下文推理服务的加速意义重大,做推理 infra 的团队可以马上看论文和代码。
The Decoder:AI NewsAI 评分6565 Thinking Machines Lab 发布开源多模态模型 Inkling
Thinking Machines Lab 发布开源多模态模型 Inkling,总参数 9750 亿(活跃 410 亿),原生支持文本、图像、音频及百万 token 上下文。该模型在 Artificial Analysis Intelligence Index 上以 41 分领跑美国开源模型,但事实准确率仅 40%,幻觉率高达 63%。
公众号:小红书技术精选AI 评分7575 小红书联合北大、上交提出 HYPIC,让混合注意力大模型用上位置无关缓存,首 token 延迟降 3.25 倍
小红书联合北大、上交提出 HYPIC,这是首个在混合注意力大模型上实现位置无关缓存的服务系统。在 4 个生产级混合注意力模型、5 个工作负载上,HYPIC 将首 token 延迟(TTFT)平均降低 3.25 倍,同 SLO 下可持续 QPS 提升 1.66 倍,任务质量与完全重算仅相差 1.71 分。该系统通过缓存段累积转移算子实现线性层常数时间状态组合,并用缝合窗口修复全注意力层跨段对齐。
推荐理由:此前位置无关缓存无法用于混合注意力模型,HYPIC 通过缓存转移算子与缝合窗口首次实现,RAG 场景 TTFT 降低 3.25 倍,开源代码为推理系统提供了可复用的加速路径。
IT之家·人工智能AI 评分5656 OpenAI GPT-5.6 离线 IQ 测试首破 130 天才线,多个版本齐获 136 分
GPT-5.6 在 Tracking AI 离线 IQ 测试中拿下 136 分,成为首个突破 130 分“天才线”的 LLM,超过 99% 人类。其 SOL、TERRA 及视觉版等多个变体均达到 136 分,领先于 Claude-5 Fable 的 130 分。开发者实测显示,GPT-5.6 能通过单条 prompt 完成粒子流体模拟、RAG 客服工单系统等复杂任务,且成本远低于竞品。
Rohan Paul@rohanpaul_aiAI 评分5959引用Mira Murati@miramuratiOur first model, Inkling. Trained from scratch, weights are open, fine-tunable on Tinker today.
Apple Machine Learning ResearchAI 评分4040 Apple 提出 CLaRa:用连续潜在推理桥接检索与生成
Apple 机器学习研究团队提出 CLaRa,一种通过连续潜在推理桥接检索与生成的新方法。该方法在检索增强生成(RAG)中引入连续潜在空间,使模型在生成答案前先进行隐式推理,从而缓解长上下文带来的性能下降。CLaRa 在多个知识密集型基准上提升了 LLM 的准确率与效率。
Lilian Weng@lilianwengAI 评分4545Thinking Machines 发布开源权重模型 Inkling,支持文本、图像和音频模态的高效推理。完整权重已开放,可在 Tinker 平台进行微调。
引用Thinking Machines@thinkymachinesToday, we are introducing Inkling. Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available. https://thinkingmachines.ai/news/introducing-inkling/ Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵
LMSYS BlogAI 评分5656 SGLang 与 Miles 为前沿多模态模型 Inkling 提供 Day-0 支持,推理吞吐达 71.7k tok/s
SGLang 与 Miles 为 Thinking Machines Lab 的 975B 参数多模态模型 Inkling 提供 Day-0 支持,其上下文窗口达 1M token。
Claude:BlogAI 评分4141 Base44 为何信任 Claude Fable 5 处理最具挑战性的工程任务
无代码开发平台 Base44 将此前仅限资深工程师处理的系统提示词重构任务交给了 Claude Fable 5。该模型在四小时内独立完成 90%-95% 的重构,并主动发现团队评估中遗漏的缓存命中测试盲点。Base44 产品负责人表示,Claude Fable 5 是首个能像资深工程师一样推理软件构建方式的模型。
TechCrunch:AIAI 评分6464 Thinking Machines Lab 发布首个自研开源模型 Inkling
Thinking Machines Lab 发布其首个自研模型 Inkling,采用混合专家(MoE)架构,总参数 9750 亿,每任务仅激活约 410 亿参数。该模型为开源权重,支持企业通过定制平台 Tinker 进行微调,运行成本约为 Nvidia Nemotron 3 Ultra 的三分之一。公司明确表示 Inkling 并非当前最强模型,而是定位为可适配的企业级起点。
Thinking Machines@thinkymachines精选AI 评分7070推荐理由:多模态推理终于有了开放权重的选项,Inkling不是最强的,但可能是最方便你上手微调的。想试试多模态Agent的,今天就能在Playground玩。
The Decoder:AI NewsAI 评分6868 宾大教授用 GPT-5.6 Sol Pro 在 90 分钟内推翻统计学 30 年未解猜想
宾夕法尼亚大学沃顿商学院教授 Edgar Dobriban 使用 OpenAI 的 GPT-5.6 Sol Pro 在约 90 分钟内推翻了一个存在 30 年的统计学猜想,证明 Benjamini-Hochberg 方法在连续相关数据下无法始终可靠控制错误发现率。其前代 GPT-5.5 在多个智能体协作超过 20 小时后仍未能给出有效解。该结果目前主要具有理论意义,实际影响尚需进一步研究。
Ant Ling@AntLingAGIAI 评分5555推出 Ring-2.5-1T-Zero:将零强化学习扩展到 1 万亿参数模型。 我们直接从基础训练这个巨型模型,无需额外人工标注,实现了具有竞争力的推理性能。
Together AI 研究与产品博客精选AI 评分7676 Thinking Machines Lab 发布多模态 MoE 模型 Inkling,Together AI 提供 Day 0 推理服务
Thinking Machines Lab 发布多模态 MoE 模型 Inkling,Together AI 于发布当日在其 Serverless 平台提供访问,支持 1M 上下文窗口和 OpenAI 兼容 API。
推荐理由:原文来自提供推理服务的合作方,给出了 Inkling 的架构细节、参数规格和初步评测,读者可据此了解新模型的技术取向与可用入口。
Rohan Paul@rohanpaul_aiAI 评分5454
引用Sam Altman@sama5.6 sol growth is insane. the inference team has done heroic work to be able to support demand. we are going to move mountains to continue to scale, but it is possible there are some hiccups soon.
Sam Altman@samaAI 评分56565.6 sol 增长惊人。 推理团队为支撑需求付出了巨大努力。 我们将竭尽全力继续扩展规模,但近期可能会出现一些小问题。
LMSYS BlogAI 评分6161 LMSYS 与 SGLang 团队为 GLM-5.2 NVFP4 推出推理优化,8×B300 单 batch 解码超 500 TPS
LMSYS 与 SGLang 团队针对智谱 GLM-5.2 NVFP4 模型在 Grace Blackwell 硬件上推出多项优化。运行时方面,Spec V2 重叠调度消除 GPU 气泡,端到端 TPS 提升 11%;IndexShare MTP 在 draft 步骤间复用 DSA indexer 的 top-k,长上下文下 draft 步骤成本降低约 1.9 倍。内核方面,TopK-V2 将 TopK 视为选择问题,80K ISL 下平均延迟从 40.7 µs 降至 17.5 µs(2.33× 加速),1M ISL 下从 372.1 µs 降至 36.6 µs(10.17× 加速)。优化后 8×B300 单 batch 解码吞吐超过 500 TPS。
TechCrunch:AIAI 评分4848 Meta 高管 Mosseri 称未来一两年或需为工程师设置 AI token 上限
Instagram 负责人 Adam Mosseri 在播客中表示,未来一两年内,Meta 可能需要对工程师的 AI token 支出设置上限,因为一名优秀工程师的 token 消耗速率可能与其薪资相当。Meta 此前因 AI 成本可能导致 2026 年支出达数十亿美元而关闭了内部 token 消耗排行榜。Mosseri 认为 token 预算应像薪资或运营支出一样管理,并根据公司对工程师“ROI 正向”使用能力的信任程度按人设定上限。他同时预测,随着 AI 模型厂商进入价格战,未来 token 成本将下降。目前 Meta 尚未对任何员工设置 token 上限。
Google AI:DEV 作者专属精选AI 评分6868 DiffusionGemma 发布:文本扩散模型实现 4 倍加速推理
Google 发布实验性开源模型 DiffusionGemma,采用文本扩散技术并行生成 256 token 块,推理速度最高提升 4 倍。该 26B MoE 模型仅激活 3.8B 参数,量化后适配 18GB VRAM 消费级 GPU,在单张 H100 上达 1000+ tokens/s。
推荐理由:Google把扩散模型首次做进大语言模型,生文速度提升4倍,还开源了权重。虽然实验性质量打折,但本地实时交互的开发者终于有个新选项可以玩了。
Inception Labs:Blog精选AI 评分6767 Inception Labs 发布 Mercury 2:首个在 NVIDIA GPU 上每秒解码超 1000 token 的推理扩散语言模型
Inception Labs 发布 Mercury 2,称其为全球首个推理扩散语言模型(dLLM),在 NVIDIA H100 上以 1000+ token/秒并行解码,300 token 的推理链可在约 300ms 内完成,适配语音对话延迟预算。
推荐理由:官方给出扩散架构推理模型在 NVIDIA GPU 上的延迟与定价数据,语音 Agent 开发者可以据此评估是否能替换现有默认模型。