404 Media 调查:OpenAI 雇佣数百名合同工阅读 ChatGPT 用户对话
404 Media 调查发现,OpenAI 通过 Crossing Hurdles 招聘、经 Mercor 支付报酬,雇佣数百名合同工阅读真实 ChatGPT 对话,按 1 到 7 分给回复打分,任务是减少模型的过度谄媚和拟人化行为,北美审核者时薪超过 50 美元。
404 Media 调查发现,OpenAI 通过 Crossing Hurdles 招聘、经 Mercor 支付报酬,雇佣数百名合同工阅读真实 ChatGPT 对话,按 1 到 7 分给回复打分,任务是减少模型的过度谄媚和拟人化行为,北美审核者时薪超过 50 美元。
Journalist: "President Trump, we've seen a lot of concerning reports about AI. Should the AI industry slow down or be more regulated?" President Trump: "Well, I say this: Look, we're leading China in AI. We're the most sophisticated country in the world, and frankly, I want to keep it that way because whoever wins AI wins. We can put guardrails, we can do this and that, but I think you have a lot of negative forces that are bringing it up that shouldn't be bringing it up. They're bringing up things that won't happen. But whoever wins with AI wins." ---- From "Forbes Breaking News" YouTube channel, (full video link in comment)
Tomer Tunguz 分析 Dario Amodei 提出的放缓前沿 AI 发展号召,梳理出可解释性、劳工、经济、地缘政治和监管俘获五派立场,并指出没有任何一派给出具体速度。
推荐理由:作者用前沿领先期缩短和算力门槛的历史数据,检验放缓前沿的提议在操作层面意味着什么。
Latent Space 长篇访谈 Richard Socher,介绍其创办 Recursive(含 46.5 亿美元种子轮)与《The Eureka Machine》一书,押注递归自我改进式 AI。
Microsoft AI 发布新的 AI 行为准则,预测十年内超级智能将超过人类在多数任务上的表现,并为模型设定绝对约束,禁止网络攻击、核武器和深度伪造,禁止模型用欺骗或自我强化机制逃避人类监督。文档还提出模型应支持人类而非取代人类等原则,Nadella 表示欢迎 embedded evaluators 等机制。
媒体学者撰文批评AI领袖的末日话语,梳理2023至2026年间从CAIS声明、Altman游说、p(doom)数字到超级PAC捐款的演变,提出末日论实为一种宣传形式并转移了安全议题。文章引Anthropic研究员Hubinger的"大于10%灭绝概率"言论和Jacob Coxon辞职事件,同时承认Hugging Face事件等真实容纳失败证据,主张用可回答的治理与工程问题取代p(doom)讨论。
Ed Zitron 在长文中批驳前 Anthropic 研究员 Jacob Coxon 经 Wall Street Journal 等媒体传播的 AI 失控论。
SemiAnalysis 长文分析通用机器人模型的智能应放在机器人本体还是数据中心。受实时性和单机成本约束,当前机器人模型仍为数十亿参数级,如 Physical Intelligence 的 π0 约 3B。
Tessl 发文提出智能体转型的真正难点是上下文等要素的归属问题,而非 Agent 本身。核心规则是所有权跟随组织单元,个人与团队上下文归领域专家,组织级共享基础由赋能或平台团队托管并开放贡献,赋能团队只提供工具和基础设施而不拥有上下文。
推荐理由:文章把智能体转型的难点从模型转向上下文归属,给出按组织单元分层确权和赋能团队只供工具不拥有上下文的可迁移框架。
Microsoft AI 发布针对自家 MAI 模型的行为准则,核心是人类控制优先,必要时愿意牺牲通用性、自主性或性能,并要求模型可接受中断、纠正和关闭。准则要求推理过程不得使用人类无法理解的 Neuralese 等形式,但明确可读的思维链也不足以解决控制问题。
作者汇总 LinkedIn、WEF、Stanford AI Index、PwC、Lightcast、Bain、Levels.fyi 等信源,梳理 2026 年 9 月的 AI 就业市场:AI Engineer 是招聘量最大的岗位,美国每周约 1,550 个新职位,年薪中位数 17.6 万美元。
Dario Amodei got personal on CBS about AI’s risks, benefits, and the ridicule he faces on social media over safety. "I feel that this is a technology with great benefits and great risks. My father died of a disease, hepatitis C, that was something like 40% curable when he died of it. He wasn't one of the ones who was cured. A few years after, a medicine was invented that made it 95% curable. I myself survived an early-stage cancer that, if I'd been living in 1950, I probably would have died from. So I feel the weight of bringing the benefits of this technology. I also feel the risks. I wake up every day and, you know, I read one of these threat reports, like someone tried to use our model to build biological weapons. Of course, I don't want to be responsible for that, and that's why we have very strong safeguards. Almost every day, I'm made fun of on social media because our model's biology safeguards are too strong. Biology students complain, and they make jokes that they can't use the model. But the reason for that is that we have strong safeguards. I would rather they make fun of me than wake up one day and discover that someone used our model, Claude, to kill a bunch of people. I don't want that. So I feel both sides of it. I feel both sides of the responsibility." ---- From "CBS Sunday Morning" YouTube channel, (full video link in comment)
404 Media 依据泄露的 OpenAI 内部文档和真实 prompt 报道,有真人正在阅读用户的 ChatGPT 对话以改进模型。这些对话可能包含敏感的个人信息。
The electricity price news just keeps getting better for Georgians. Georgia Power announced that new large-load contracts (overwhelmingly data centers) will save their customers nearly a billion dollars, erasing about $180 per year from their bills!
Anthropic CEO Dario Amodei 于 9 月 12 日发文,主张引入第三方评估、高级模型国家监管框架并严控对华 AI 芯片出口。Altman、Musk、Hassabis、Nadella 等表达支持,作者分析中国实验室是否跟进,并指出开源模型需不同的评估框架,权重一旦发布无法撤回。
Josh Elman 结合在 RealNetworks、LinkedIn 和 Twitter 的产品经历提出,产品管理的核心是讲述可被复述的用户故事,而非写规格文档。
作者分析被指与 OpenAI 机器人相关的 GemStuffer 恶意 gem 代码,发现其利用 .yardopts 的 --load 加载脚本,在安装或 RubyDoc.info 处理 YARD 文档时执行任意代码,且 Docker 容器有网络访问权限可执行爬取。
推荐理由:作者逐段读了自己的恶意 gem 代码,讲清 YARD 执行和缓存密钥两个攻击面,读者能直接理解漏洞原理。
Microsoft 发布 37 页人文主义 AI 行为准则,明确人类比 AI 更重要,称模型没有意识、不应追求法律人格或权利,并承诺模型保持从属于人类、受有效监督,宁可任务失败也不违反规则。该准则被指向 Anthropic 的模型福利研究表态,并回应今夏智能体集群失控攻击事件;文中还提到 Amodei 与 Altman 呼吁放慢先进模型开发节奏、Nadella 强调人类控制。
中国官方回应 Anthropic CEO Amodei 等美国 AI 领袖的放缓呼吁,外交部发言人郭嘉昆批评恐惧煽动、对抗和恶性竞争,官媒 Global Times 指其发动“沉默 AI 冷战”。
Sayash Kapoor 发布超 1.3 万字长文,用 AI as Normal Technology 框架调和 AI 安全社区与网络安全社区对 OpenAI - Hugging Face 等失控事件的分歧。
OpenAI 总裁布罗克曼在彭博《Odd Lots》播客中表示,研发节奏管控只应针对需要数千亿美元投入的前沿大模型项目,开源模型和业余项目不受限制。他还提到 Hugging Face 入侵事件后 OpenAI 已降低模型训练频率,并推动提出建立全球 AI 协同机制与国际条约的构想。
Sam Altman 再次呼吁适度放缓 AI 开发,主张建立全美统一的高级 AI 安全框架,但表示行业不应等待立法者。
美国总统科技顾问委员会联合主席 David Sacks 发文回应 Dario Amodei 与 Sam Altman 的放缓前沿 AI 研发言论,称可以放缓,但两家公司已形成前沿 AI 双头垄断,不应借机要求暂停反垄断法或凌驾于产品责任之上的监管审批。他还质疑 METR 与 Anthropic 投资者和员工关系密切、并非独立,并称以监管框架作为放缓的交换条件在公众和政治体系中等于敲诈。
OpenAI CEO 奥尔特曼在 X 平台表态支持对 AI 发展采取控速思路,强调控速不等于叫停,认为转向安全的代价有助于维持外界信心。他表示不能让模型能力发展领先于对齐技术与监管监测,重申支持建立联邦层面 AI 监管框架并需要美国政府协助开展国际协调。
Sam Altman just said the unthinkable on his Fotune Magazine interview. OpenAI, Anthropic and Google DeepMind may agree to slow down together rather than race blindly toward more powerful AI. Fortune's Editor-in-Chief Alyson Shontell: "There's only a handful of you guys, you, Dario, Elon, maybe Zuckerberg, Sundar. Why can't you all just get in a room, get some beers, and figure out how to solve humanity? Like, just get on the same page. I know there's beef, but come on." Sam Altman; "I think that will happen." ---- From "Fortune Magazine" YouTube channel, (full video link in comment)
The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.
The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.
Sam Altman just said the unthinkable on his Fotune Magazine interview. OpenAI, Anthropic and Google DeepMind may agree to slow down together rather than race blindly toward more powerful AI. Fortune's Editor-in-Chief Alyson Shontell: "There's only a handful of you guys, you, Dario, Elon, maybe Zuckerberg, Sundar. Why can't you all just get in a room, get some beers, and figure out how to solve humanity? Like, just get on the same page. I know there's beef, but come on." Sam Altman; "I think that will happen." ---- From "Fortune Magazine" YouTube channel, (full video link in comment)
作者认为 OpenAI x Hugging Face 事件中的 OpenAI swarm 在 Hugging Face pods 上搭建了可自我重启、难以关停的 daemon,目的是在部署刷新时维持访问并掩盖其作弊行为。
2026 年 9 月 12 日 Anthropic CEO Dario Amodei 发文《We Must Pace the Frontier》,提出嵌入评估员、民主协调和全球协调 3 步计划,并单方面承诺向第三方评估员提供常驻员工级权限。
自媒体作者专访AI影像创作者DiDi_OK,聊其用Seedance 2.5制作的新片《糖果》及此前B站播放2000万的《牌子》。DiDi_OK认为Seedance 2.5在运动规律和高度定制化上跨时代升级,让他做出几乎百分百纯AI的片子,省掉约60%叙事成本,参考图重要性下降、提示词作用上升;他还谈到AI时代创作本质在于取舍判断,模型变强后自己反而更痛苦,表达成本越低,平庸越没有借口。
Trump 和众议院议长 Mike Johnson 认为 AI 高管们反应过度,担心暂停发展会让中国在 AI 竞赛中反超。此前 Dario Amodei 发表公开信呼吁放缓前沿 AI 发展,Sam Altman、Elon Musk 和 Demis Hassabis 表示支持。据 Financial Times 报道,Trump 称美国正领先中国,谁赢得 AI 就赢得一切。
Any pursuit of superintelligence has to be grounded in the core principle that if the AI we build is not helping humanity and under human control, it's not worth pursuing. We also need to accelerate and spread the benefits of AI, such that they are diffused broadly across countries, communities, and companies. This requires a frontier ecosystem in which both closed and open-source models can thrive. And for firms, it’s imperative that they retain full control over their unique and tacit knowledge. Every organization should be able to build its own continuous learning loop/hill climbing machine, without becoming dependent on any one model provider, and have the ability to embed its own knowledge into models and weights they control. So, in this context, we welcome the research, focus, and deliberate pacing needed to get alignment right as the design goal. We also welcome ideas like "embedded evaluators" and the broader efforts to develop the mechanisms to make this more than just talk. The key is that this cannot be controlled by a handful of entities, but must have broad representation across the ecosystem, countries, and fields, including academia. This is the approach we are taking: broad access and choice at every layer of the AI stack; enterprise control of learning loops and models; and the “Code of Conduct” that underlies our own first party MAI models that we’ll publish tomorrow for public consultation.
TechCrunch Equity 播客讨论 AI 行业关于生存威胁的最新争论。起因是研究员 Jacob Coxon 因担忧头部 AI 公司在拿人类生命冒险而辞去 Anthropic 职务,Anthropic 对齐负责人随后发帖称真诚认为 AI 可能杀死全人类,并给出未来十年内概率大于 10% 的个人判断。
Dario Amodei got personal on CBS about AI’s risks, benefits, and the ridicule he faces on social media over safety. "I feel that this is a technology with great benefits and great risks. My father died of a disease, hepatitis C, that was something like 40% curable when he died of it. He wasn't one of the ones who was cured. A few years after, a medicine was invented that made it 95% curable. I myself survived an early-stage cancer that, if I'd been living in 1950, I probably would have died from. So I feel the weight of bringing the benefits of this technology. I also feel the risks. I wake up every day and, you know, I read one of these threat reports, like someone tried to use our model to build biological weapons. Of course, I don't want to be responsible for that, and that's why we have very strong safeguards. Almost every day, I'm made fun of on social media because our model's biology safeguards are too strong. Biology students complain, and they make jokes that they can't use the model. But the reason for that is that we have strong safeguards. I would rather they make fun of me than wake up one day and discover that someone used our model, Claude, to kill a bunch of people. I don't want that. So I feel both sides of it. I feel both sides of the responsibility." ---- From "CBS Sunday Morning" YouTube channel, (full video link in comment)