404 Media 曝光 OpenAI 莉莉计划:人工审核 ChatGPT 聊天记录以优化模型
404 Media 披露 OpenAI 内部代号为莉莉计划(Project Lily)的项目,由时薪超 50 美元的提示词审核员查看匿名化后的真实用户聊天记录,评判回复是否切题、是否存在 AI 式话术和谄媚口吻。
推荐理由:报道披露了人工审核流程的运作细节和隐私边界,读者可以据此了解模型优化背后的人力环节与数据风险。
404 Media 披露 OpenAI 内部代号为莉莉计划(Project Lily)的项目,由时薪超 50 美元的提示词审核员查看匿名化后的真实用户聊天记录,评判回复是否切题、是否存在 AI 式话术和谄媚口吻。
推荐理由:报道披露了人工审核流程的运作细节和隐私边界,读者可以据此了解模型优化背后的人力环节与数据风险。
国家网信办通过“网信中国”通报一批执法典型案例,涵盖网页篡改、恶意程序、数据泄露、个人信息违法出境等类别,属地网信办均已责令改正并处罚款或警告。其中两起涉及人工智能:四川某公司小程序因未落实 AI 生成合成内容显式和隐式标识被责令下线,江苏某公司以 API 中转站方式调用大模型接口提供服务但未按规定开展安全评估被警告。
工信部、国家发改委联合印发《电子信息制造业发展“十五五”规划》,提出到 2030 年规模以上企业营业收入突破 30 万亿元、研发投入强度达到 3.5%。规划部署 17 项任务和 9 个专栏,要求提高先进制程能力,突破高端手机核心芯片和 PC 高性能芯片,加强开源鸿蒙等国产操作系统搭载,并推进 RISC-V 研发与产业化。
Amazon Science 介绍其论文《What fits (into few tokens) doesn't overfit》,用可重置的 LLM 研究智能体实验解释为什么机器学习研究社区长期在固定基准上迭代却很少过拟合。
据《商业内幕》报道,谷歌完成对旧金山 AI 编程初创企业 Mechanize 的人才收购,联合创始人塔迈·贝西罗格鲁自 8 月起加入谷歌 DeepMind,另有十多名工程师一同转投。
Dwarkesh Patel 与 John Schulman、Beren Millidge、Charlie O'Neill 对谈递归自我改进(RSI)的最新一期播客。
Google 发布 autofinetune 项目,把 autoresearch 的自主研究循环应用到 LLM 后训练(SFT 和 GRPO),使用 Tunix、Gemma、Cloud TPU,由 Antigravity CLI 和 Gemini Flash 3.7 编排。
据《商业内幕》援引 4 名知情人士报道,Meta 调整应用 AI(AAI)部门人员安排,邀请部分非管理岗员工自愿重返管理岗位。AAI 由 Meta 今年设立,约 7000 名员工被调入,部分人调入后不再担任管理职务;此举部分逆转了 Meta 过去一年裁减中层管理人员的方向,此前 Meta 今年已裁员约 10%。
Together AI 扩展 Together Fine-Tuning 服务,新增对 GLM-5.3、Kimi K2.7、Qwen 3.5 系列等最新开源权重模型的支持,并上线实时实验跟踪、数据集预览验证等能力。
推荐理由:原文给出新模型支持、Expert LoRA 实测对比、自动早停和降价幅度等具体细节,读者可据此评估微调工作流的实际改进。
Google 在 ACL 2026 提出 ToolGrad,用文本“梯度”迭代构建 API 工作流,先产出真实工具调用链再反向标注用户提示词,实现近乎 100% 的数据生成通过率。
We grew from ~0 to $500M ARR, adding $250M last year alone while being EBITDA profitable. 1,300-word post on every growth tactic that worked for us: 1. What got us from 0-$400M ARR in the US works in every country. 2. Retention and Monetisation Hacks. 3. Localization > Translation. 4. Experiment with $1M internal seed checks. 5. Pivoting to only AI content production unlocked 100% ARR growth. Pocket FM is like Netflix for audio-only dramas, with our own pool of one-person studios. 1. Acquisition Playbook for 0-$10M ARR in any country in 6 months We run a 90 sec video trailer of an audio drama as an Ad and ask users to download the app if they're interested in the rest of the story. Our core insight after spending >$100M on acquisition is: If the clickthrough rate (CTR) for an ad goes from 2% to 2.25%, our customer acquisition cost (CAC) decreases by ~ 30%. We remodelled our system around this insight and built an AI-first 2.25% CTR ad manufacturing machine that works in every country. For every new country, we take our hit shows -> use LLMs to extract and most intriguing moments -> Write a 5-min script combining all the best parts. The first 60 seconds has to have a hook every 5 seconds and needs to end with a crazy cliffhanger to force a download mid-scroll. If a marketing video is not hitting our benchmarks (2.5% CTR and 55% 3-second through-play), a creative director gets involved to change the hook or cliffhanger to get the numbers there. AI lets us make 1,000 Ads per show, and in total we do ~17.5k Ads per month. When a business creating scales from 1k to 10k Ads, the normal thing is for CAC to skyrocket. But with what I just shared, we 7-8x'd our User Acquisition budget without increasing our CAC materially. It took us 8 months to figure this out, but then the timeline from 0-$10M in every country got shorter and shorter: US revenue grew to $25M in 19 months. (US is now 78% of total) Germany to 21M in 11 months. France to $10M in 3 months. 2. Retention and Monetisation Hacks. We knew we wanted to create an audio entertainment platform, but there was no standard format. For the first 2-3 years, we tried 10 different formats before landing on the winner. After we got it right with audio drama (8-12min chapters, written for mobile fiction, serialized, episodes have strong hooks and end on cliffhangers), avg daily streaming time went from ~25mins to 150+. Audio drama made us realize that Pocket FM was creating a whole new medium. There was no playbook for anything that we were doing. Everything had to be thought & built from scratch. This is what we did for each major bullet: - Monetization: Users have some free daily minutes to listen; then it's pay per episode. We also added the option for users to unlock episodes by watching ads, which is doing extremely well. Ads scaled from zero to a ~$90M run rate in 12 months. - Engagement & production: You don't become obsessed with an app you open once a week. To have users engage daily, we make the next episode free every day. Also helps them build the habit. - Discovery. Huge problem because people consuming Pocket FM enter the app, tap the show, and lock the screen. We fixed it by doing "playlists" of episodes. Once users's free minutes on a show are done, we ask users if they want to pay. If they say no, we play a new show, one where they haven't used their free mins. And we stitch episodes of different shows together that way, creating natural discovery. 3. Localization > translation. 78% of our revenue is still concentrated in the US. Localisation is fixing this: You might write a show for a Spanish audience where language, jokes, folklore, have a certain flavor; if you merely translate the show for, say, a Norwegian audience, that color is lost and hurts the show in the Norway. Listeners would relate more if the show was written by a Norwegian. That's why, instead of translating, we localize shows to different regions. We use AI to take the spine of stories and adapt their whole cultural layer to the other country. The results: a US show that was localized for a German audience had 50% higher retention than the translated version. Localization + our user acquisition playbook led to: - $10M+ ARR in France within 3 months - $21M+ ARR in Germany within 11 months. And this expands writers' addressable market. We get messages of writers thrilled to have revenue coming from the US, India, EU, LatAm, without them doing much incremental work. 4. Experiment. We give $1M checks to new internal initiatives, and the team has 12-18 months to prove their thesis. If they prove it, we double down. This is how Pocket Saga came about, our AI video microdrama app. It's an AI video equivalent of Pocket FM. Same shows and structure, but as a vertical 2-min mobile video series. We launched it two months ago and it's at ~$15M ARR. Pocket's broader thesis is to help creators tell their stories to as many people as possible. Start with audio drama -> multiple languages or localize to diff countries -> microdrama -> more formats like movies, TV shows, and games. Best of all is that writers get revenue streams not only from countries they wouldn't have tapped into, but also from formats they wouldn't have thought possible. 5. Pivoting to only AI content production unlocked 100% ARR growth. In mid-2024, we pivoted to only AI content production. Our growth took a very direct hit. Pocket was already at $200M ARR, growing 50% YoY, and we flatlined for a whole semester. Six months later, the business exploded. After the switch, we went from ~25k hours of content produced per year to over 2.5M hours, which are also higher quality. Because AI orchestrates the writing and more data is fed into it, more blockbusters come out. Over 90 titles have $1M+ in lifetime earnings and 13 crossed $10M. Quality control is done with LLM as a judge, and LLMs are quite tough. Results are very encouraging: - 12-month revenue retention went from 44% to 76%. - In the past year, we added $250M in net new ARR. __________________________________ Pocket Entertainment (Pocket FM + Pocket Saga) has become the largest AI entertainment platform. We have the largest storytelling catalog with 770,000 titles, 550k creators, and 5.5B hours of playtime with minute by minute retention & engagement data. We are using all of this data to improve every aspect of our business. Our Bet: In the next 3 years we will be able to produce Naruto-like series for $1000. Netflix has to spend $17B to find 100 Blockbusters per year. What happens when you can produce 1M high quality shows for $1B? The streaming wars caused a $300B reallocation of market cap. The AI entertainment wars may be a $1T+ reshuffling of market cap. We are at a unique spot. Unlike other AI creator tools like Runway or Midjourney, we own both the supply and demand side of AI content. We've attracted over 550,000 writers who are producing an annualized 2.5M hours of content every year. This pairs with 137B+ minutes streamed. Because of this, growth is accelerating as we scale further. We have multiple S-curves inflecting at the same time: - AI produces better and more ads -> scale faster in new countries - Writers + AI produce more shows -> more blockbusters - Localisation -> more reach per blockbuster - Audio to video format expansion -> larger TAM -> more creators Every aspect of our business is designed to improve another, and everything is aligned so that the number of blockbusters continues to rise. If you're interested in building at the intersection of ai, tech and entertainment, DM me.
OpenAI 在 ChatGPT Work 中推出新的 Data agent,用户用自然语言即可连接公司数据、分析变化并生成可分享的交互式仪表盘。
推荐理由:官方公布了数据源和 BI 工具接入范围及权限管控方式,读者可据此评估它在自有数据工作流中的落地路径。
数学家 Andreas Thom 指责 OpenAI 在非 sofic 群结果上行为不诚实,质疑他与 ChatGPT 的互动可能进入了训练数据。此前 NYU 教授 Tristan Buckmaster 也质疑 OpenAI 是否受益于其 unpublished 工作;OpenAI 否认访问过特定用户数据,但不排除去标识化数据的间接影响。多位研究者担心此类事件会促使数学界走向更保密。
继 NYU 教授 Tristan Buckmaster 公开质疑后,数学家 Andreas Thom 在 Mastodon 指控 OpenAI 不透明且不诚实,担心他与同事和 ChatGPT 的互动可能进入了训练数据,并促成 OpenAI 上月宣布的 10 项结果之一,该非 sofia 群结果大量依赖 Thom 和 Gábor Kun 的先前工作。
作者 Hugo Vergnes 用租用的 8× B200 在 43 小时内以 $998 训练了 3.8B 参数模型 little-lm,在 65.3B tokens 上达到 CORE 0.384,超过 GPT-2 1.5B 的 0.2565。
作者 wsxiaoys 将开源模型的推理 prefill 实验更新到 v1.1,改用 GPT-5.5 Pro 作为教师模型,在 45 个问题(STEM、非 STEM、合成谜题各 15 个)上测量目标模型被注入教师推理前 1% 后可见答案的重合度。
Cognition 发布最先进编码模型 SWE-2,基于 2.8T 参数的 Kimi K33 后训练,在 FrontierCode 1.1 Main 取得 50.0%,仅比 Fable 5.1 低不到一分且便宜 64%。
推荐理由:官方详细公开了 SWE-2 的训练方法与成本惩罚公式,读者可以借此理解如何用 RL 推移整条成本性能前沿。
Genspark 与 Fireworks Lab 合作,通过 RL 后训练将开源多模态模型 MiniMax M3 打造成 Gen-1 Slides,可端到端规划、撰写并自查幻灯片。
IBM 发布 Granite Time Series PatchTST-FM-r2,约 385M 参数,支持最长 8,192 上下文、99 分位数概率预测和缺失值插补。
Ramp 汇总 70,000 家公司的支出数据发现,8 月支付 AI 产品的客户占 56%,环比仅增长 0.4%,样本中头部 1% 企业的人均 AI 支出下降近 10% 至 $7,205。
Jensen Huang 在接受 Axios 采访时回应“开源模型公司是否应被允许蒸馏闭源模型”,称从 AI 和他人知识中学习是智能的基础,更聪明的 AI 也可以是更安全的 AI。
In a new allegation, the U.S. government has accused 6 Chinese AI firms of using large-scale distillation to copy American model capabilities. The NSA, CISA and FBI published joint advisory AA26-251A, naming DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun and Z .AI as running industrial-scale distillation campaigns against U.S. frontier models since at least late 2024. The agencies say requests moved through a gray market of API proxies called transfer stations, bulk premium subscriptions shared across developer teams, and third-party aggregators that strip account metadata. Moonshot AI allegedly distilled 17 U.S. models, including Anthropic's Claude Fable 5, to train Kimi-K3. They claim DeepSeek's prompts pushed models to write out hidden chain-of-thought steps, which transfers reasoning method rather than finished answers. So they say that DeepSeek's headline training cost only covers the compute it burned. The advisory argues that number is misleading because it leaves out what the training data actually cost, which DeepSeek allegedly obtained by distilling U.S. models rather than producing it through its own research. So the cheap-training story rests on data someone else paid to create. The mitigation section asks U.S. labs to serve suspected distillers subtly degraded responses without telling them. Its detection indicators are behavioral, covering sustained 24/7 usage, new accounts at immediate maximum throughput, and traffic optimized for cache hits. Those patterns also describe an ordinary enterprise agent fleet, leaving each provider to decide which customers receive an undisclosed downgrade.
在 2026 京东全球科技探索者大会上,京东云总裁曹鹏公布 AI 基建进展,京东云已与摩尔线程等打造国产万卡集群,并规划建设 10 万卡集群。数据方面京东云正推进 1,000 万小时数据采集,模型方面已形成覆盖多模态、世界模型和具身模型的 JoyAI 基础模型矩阵。摩尔线程张建中表示该 AI 工厂可用于训练大模型、生产词元和智能体,并希望服务各行业打造具身智能。
LG AI Research 发布面向结构化表格数据的分类与回归基础模型 EXAONE Tabular,完全基于 SCM 合成数据预训练,未使用任何真实表格数据,通过上下文学习免重训直接预测。
数学家 Tristan Buckmaster 公开发声,称 OpenAI 在其与 Levent Alpöge 借助 Claude 和 Codex 运行 GPT-5.6 Sol 在 Navier-Stokes 方程上取得进展后对其施压。
Dwarkesh Patel 发布实验分析,在最高 1e19 FLOPs 的算力预算下训练 2019 至 2025 年各年度代表性模型配方与数据语料,发现数据改进带来 12.0x 算力效率提升,模型改进为 3.7x,数据贡献约为模型的 3.24 倍。
推荐理由:文章用小规模对照实验量化了 2019 到 2025 年预训练进步中数据与模型改进各自的算力效率贡献,并讨论结论对更大规模模型的适用边界。
智元发布原生世界—动作模型GE-Act 2.0,所有参数从随机初始化在具身操作数据上从头训练,不针对评测任务微调或示范。
🚀 Meet MiniCPM5-2B, a 2B-parameter language model bringing high intelligence density to the edge, now open source! It ranks #1 among open-source models under 4B parameters on the @ArtificialAnlys Intelligence Index, with a score of 23. It also scores 20 on the Agentic Index, bringing an early form of general-purpose agent capability to the edge. Across 34 benchmarks, MiniCPM5-2B achieves an average score of 53.9, covering coding, math, long-context understanding, tool use, and agentic tasks. And this release goes beyond the model itself. We’re opening up the data, training recipes, and RL stack behind MiniCPM5-2B. 🤗 Hugging Face: http://huggingface.co/openbmb/MiniCPM5-2B 💻 GitHub: http://github.com/OpenBMB/MiniCPM Modelscope: http://modelscope.cn/models/OpenBMB/MiniCPM5-2B Web: https://openbmb.cn/
9 月 8 日,面壁智能联合 OpenBMB 开源 2B 端侧基座模型 MiniCPM5-2B,支持工具调用、深度搜索、代码生成。
Reducto 发布 r-1,用一次全页解析替代多阶段 agentic OCR 流水线,官方称相较自家旧管线错误率降低 20%,价格从每页 3 至 6 美分降至 1 美分全包。r-1 原生处理表格、阅读顺序、格式和边界框 grounding,需 V3 Parse API 通过 settings.model 开启,暂无开源权重;对标 Amazon Textract 等的评测为厂商自测,未公开数据集。
Simon Willison 转述 Konstantin Ryabitsev 的观察:git.kernel.org 为应付滥用爬虫的“背景辐射”,在 5 个地理分布节点上常年有 14 个 CPU 核心专门把 git 提交渲染成 HTML,CPU 开销超过包括 git clone 在内的所有合法访问。Willison 担忧这对提供大量可爬网页的 Datasette 也有影响。
Axis Robotics 与 UC Berkeley、Georgia Tech、NTU 等机构提出 AXIS,把机器人操作演示采集搬进浏览器,通过 MuJoCo WebAssembly 前端遥操作 Franka Research 3,发布含 207 个任务、50,129 条轨迹、超 6 万种任务或场景变体的数据集,由 7 万多名社区成员贡献。
Insilico Medicine 用生成式 AI 开发的肺纤维化候选药 rentosertib,在 42 人试验数据的新分析中显示可降低预测生物学年龄,结果发表于 Nature Biotechnology。
The demand for Chips is so high, that Malaysia is reportedly considering Huawei chips for a $494 million sovereign AI project, despite explicit US warnings against the hardware. Bloomberg reports that the country is evaluating Huawei’s Ascend 910C accelerators, with state-linked Telekom Malaysia selected as the project’s key operator. The priority is keeping sensitive government, military and intelligence data under Malaysian control. Huawei already supplies technology for Telekom Malaysia’s cloud infrastructure, although its current AI computing service uses Nvidia chips. China is no longer just developing its own AI models, but is increasingly becoming a chip producer that, although lagging significantly behind NVIDIA, is able to produce chips well enough itself.
科大讯飞 9 月 7 日正式发布星火 Spark X2.5 多语言文本生成模型,基于全国产平台训练,采用 MoE 框架,参数为 293B-A30B,支持 256K 上下文。模型全面提升代码和智能体能力,覆盖 200 余种语言,已在讯飞星辰 MaaS 平台上线,输入定价 1.6 元/百万 Token(缓存命中 0.24 元),输出 6 元/百万 Token。
Charlie O'Neill 撰文指出,宣称一切将是 RL 环境的人很少按该信念做出理性行动,如同当年 scaling 和 AGI 信奉者并不真下注。他提出无论 RSI 是否成立都应造高价值数据与环境:若 RSI 成立,单位效用环境价值将指数增长,值得在实验室内做最有针对性、可累积的环境;若不成立,实验室需要模型在所有领域变强,会为有用数据支付高价。
Anthropic 15 亿美元(约合 101.02 亿元人民币)版权和解金进入发放阶段,法院认定训练模型属合理使用,但盗版获取的近 50 万部作品每部赔偿原作者 3,000 美元。
Microsoft 论文提出把昂贵测试时推理摊销为蒸馏技能:收集 35–50 条历史轨迹,由编码智能体提取重复失败模式并编译成 markdown 技能加入非推理模型 system prompt。