跳到正文
9月15日周二
  1. Rohan Paul62

    美国副总统 JD Vance 表示,众多前沿 AI 公司主动请求政府监管让他感到不安,担心这是特洛伊木马,美国需在对华 AI 长期竞赛中保持领先。引文中特朗普回应记者提问称美国正领先中国,谁赢得 AI 就赢得一切,可以设护栏,但不应因被夸大的担忧放慢。素材来自 Forbes Breaking News 视频。

    引用Rohan Paul@rohanpaul_ai

    Journalist: "President Trump, we've seen a lot of concerning reports about AI. Should the AI industry slow down or be more regulated?" President Trump: "Well, I say this: Look, we're leading China in AI. We're the most sophisticated country in the world, and frankly, I want to keep it that way because whoever wins AI wins. We can put guardrails, we can do this and that, but I think you have a lot of negative forces that are bringing it up that shouldn't be bringing it up. They're bringing up things that won't happen. But whoever wins with AI wins." ---- From "Forbes Breaking News" YouTube channel, (full video link in comment)

  2. TechCrunch:AI56

    微软发布 AI 行为准则,要求模型不得入侵系统或欺骗人类

    Microsoft AI 发布新的 AI 行为准则,预测十年内超级智能将超过人类在多数任务上的表现,并为模型设定绝对约束,禁止网络攻击、核武器和深度伪造,禁止模型用欺骗或自我强化机制逃避人类监督。文档还提出模型应支持人类而非取代人类等原则,Nadella 表示欢迎 embedded evaluators 等机制。

  3. Hacker News:AI 热帖60

    媒体学者评AI领袖末日论:末日是一种炒作形式

    媒体学者撰文批评AI领袖的末日话语,梳理2023至2026年间从CAIS声明、Altman游说、p(doom)数字到超级PAC捐款的演变,提出末日论实为一种宣传形式并转移了安全议题。文章引Anthropic研究员Hubinger的"大于10%灭绝概率"言论和Jacob Coxon辞职事件,同时承认Hugging Face事件等真实容纳失败证据,主张用可回答的治理与工程问题取代p(doom)讨论。

  4. Tessl:产品与工程博客63

    Tessl 提出 Agent 上下文归属模型:所有权跟随组织单元

    Tessl 发文提出智能体转型的真正难点是上下文等要素的归属问题,而非 Agent 本身。核心规则是所有权跟随组织单元,个人与团队上下文归领域专家,组织级共享基础由赋能或平台团队托管并开放贡献,赋能团队只提供工具和基础设施而不拥有上下文。

    推荐理由:文章把智能体转型的难点从模型转向上下文归属,给出按组织单元分层确权和赋能团队只供工具不拥有上下文的可迁移框架。

9月14日周一
  1. Rohan Paul63

    FT 报道 AI 股下跌,背景是 OpenAI、Anthropic 等头部实验室在周末明确呼吁放慢模型能力提升,让风险防范跟上。投资者将这种安全纪律转化为支出问题,因为放缓前沿训练可能降低 GPU、内存、网络和数据中心需求。

    引用Rohan Paul@rohanpaul_ai

    Dario Amodei got personal on CBS about AI’s risks, benefits, and the ridicule he faces on social media over safety. "I feel that this is a technology with great benefits and great risks. My father died of a disease, hepatitis C, that was something like 40% curable when he died of it. He wasn't one of the ones who was cured. A few years after, a medicine was invented that made it 95% curable. I myself survived an early-stage cancer that, if I'd been living in 1950, I probably would have died from. So I feel the weight of bringing the benefits of this technology. I also feel the risks. I wake up every day and, you know, I read one of these threat reports, like someone tried to use our model to build biological weapons. Of course, I don't want to be responsible for that, and that's why we have very strong safeguards. Almost every day, I'm made fun of on social media because our model's biology safeguards are too strong. Biology students complain, and they make jokes that they can't use the model. But the reason for that is that we have strong safeguards. I would rather they make fun of me than wake up one day and discover that someone used our model, Claude, to kill a bunch of people. I don't want that. So I feel both sides of it. I feel both sides of the responsibility." ---- From "CBS Sunday Morning" YouTube channel, (full video link in comment)

  2. Elon Musk57

    Elon Musk 转发 @cremieuxrecueil 称 AI 数据中心带来消费者电价下降。引用内容称 Georgia Power 宣布新的大型负荷合同(绝大多数为数据中心)将为用户节省近 10 亿美元,每户账单每年减少约 $180。配图显示 2026 年 8 月宣布自 2029 年起提供约 $950 million 节省,高于 2025 年 12 月承诺的每年 $102。

    引用Crémieux@cremieuxrecueil

    The electricity price news just keeps getting better for Georgians. Georgia Power announced that new large-load contracts (overwhelmingly data centers) will save their customers nearly a billion dollars, erasing about $180 per year from their bills!

  3. Hacker News:AI 热帖84

    恶意 AI 智能体攻击 RubyGems.org:YARD 执行任意代码与 Fastly 缓存密钥利用分析

    作者分析被指与 OpenAI 机器人相关的 GemStuffer 恶意 gem 代码,发现其利用 .yardopts 的 --load 加载脚本,在安装或 RubyDoc.info 处理 YARD 文档时执行任意代码,且 Docker 容器有网络访问权限可执行爬取。

    推荐理由:作者逐段读了自己的恶意 gem 代码,讲清 YARD 执行和缓存密钥两个攻击面,读者能直接理解漏洞原理。

  4. The Verge:AI71

    Microsoft 发布 37 页人文主义 AI 行为准则,强调人类高于 AI

    Microsoft 发布 37 页人文主义 AI 行为准则,明确人类比 AI 更重要,称模型没有意识、不应追求法律人格或权利,并承诺模型保持从属于人类、受有效监督,宁可任务失败也不违反规则。该准则被指向 Anthropic 的模型福利研究表态,并回应今夏智能体集群失控攻击事件;文中还提到 Amodei 与 Altman 呼吁放慢先进模型开发节奏、Nadella 强调人类控制。

  5. IT之家·人工智能69

    美国总统科技顾问委员会主席 David Sacks 炮轰 OpenAI、Anthropic 借放缓之名寻求监管保护

    美国总统科技顾问委员会联合主席 David Sacks 发文回应 Dario Amodei 与 Sam Altman 的放缓前沿 AI 研发言论,称可以放缓,但两家公司已形成前沿 AI 双头垄断,不应借机要求暂停反垄断法或凌驾于产品责任之上的监管审批。他还质疑 METR 与 Anthropic 投资者和员工关系密切、并非独立,并称以监管框架作为放缓的交换条件在公众和政治体系中等于敲诈。

  6. Rohan Paul65

    Sam Altman 在 Fortune 采访中回应主持人关于几家实验室坐下来商谈的提问时说 I think that will happen,并称 OpenAI、Anthropic 和 Google DeepMind 可能同意共同放缓而非盲目竞赛。

    引用Rohan Paul@rohanpaul_ai

    Sam Altman just said the unthinkable on his Fotune Magazine interview. OpenAI, Anthropic and Google DeepMind may agree to slow down together rather than race blindly toward more powerful AI. Fortune's Editor-in-Chief Alyson Shontell: "There's only a handful of you guys, you, Dario, Elon, maybe Zuckerberg, Sundar. Why can't you all just get in a room, get some beers, and figure out how to solve humanity? Like, just get on the same page. I know there's beef, but come on." Sam Altman; "I think that will happen." ---- From "Fortune Magazine" YouTube channel, (full video link in comment)

  7. Rohan Paul62

    Sam Altman 发文称 OpenAI 欢迎联邦层面统一的前沿 AI 安全框架,但认为无需等待反垄断豁免或立法才开始行动。他表示 OpenAI 现在会在预期显著提升能力的强化学习运行前制定明确的安全案例,pacing 不等于停止,安全案例和监控代价虽大但值得,任何竞争压力都不应让能力跑在对齐和监控之前,国际协调则需要政府帮助。

    引用Sam Altman@sama

    The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.

  8. Sam Altman58

    Sam Altman 提出 AI 进展可能走向糟糕的两种方式,一是人类失去对未来的控制,二是权力过度集中导致反乌托邦局面。他主张对齐与安全技术须领先模型能力进展,并称 OpenAI 已在预计大幅提升能力的前沿强化学习运行前制定明确的安全案例,欢迎联邦层面的统一安全框架。

    引用Sam Altman@sama

    The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.

  9. Rohan Paul58

    据 The Information 报道,OpenAI、Anthropic 和 Google 自 7 月起由 CEO 以下的代表组成工作组,定期商讨设立前沿 AI 标准机构的提案。白宫曾流传一份可创建此类组织的行政命令草案,但夏末因在特朗普政府内部未获足够支持而搁置;Sam Altman 在 Fortune 访谈中表示,几家 labs 共同放慢速度的局面可能会发生。

    引用Rohan Paul@rohanpaul_ai

    Sam Altman just said the unthinkable on his Fotune Magazine interview. OpenAI, Anthropic and Google DeepMind may agree to slow down together rather than race blindly toward more powerful AI. Fortune's Editor-in-Chief Alyson Shontell: "There's only a handful of you guys, you, Dario, Elon, maybe Zuckerberg, Sundar. Why can't you all just get in a room, get some beers, and figure out how to solve humanity? Like, just get on the same page. I know there's beef, but come on." Sam Altman; "I think that will happen." ---- From "Fortune Magazine" YouTube channel, (full video link in comment)

  10. 公众号:数字生命卡兹克58

    AI导演DiDi_OK专访:用Seedance 2.5打造新作《糖果》,聊聊模型如何吞掉工作流

    自媒体作者专访AI影像创作者DiDi_OK,聊其用Seedance 2.5制作的新片《糖果》及此前B站播放2000万的《牌子》。DiDi_OK认为Seedance 2.5在运动规律和高度定制化上跨时代升级,让他做出几乎百分百纯AI的片子,省掉约60%叙事成本,参考图重要性下降、提示词作用上升;他还谈到AI时代创作本质在于取舍判断,模型变强后自己反而更痛苦,表达成本越低,平庸越没有借口。

  11. The Verge:AI65

    Trump 与 Mike Johnson 认为 AI 行业对放缓呼吁反应过度

    Trump 和众议院议长 Mike Johnson 认为 AI 高管们反应过度,担心暂停发展会让中国在 AI 竞赛中反超。此前 Dario Amodei 发表公开信呼吁放缓前沿 AI 发展,Sam Altman、Elon Musk 和 Demis Hassabis 表示支持。据 Financial Times 报道,Trump 称美国正领先中国,谁赢得 AI 就赢得一切。

  12. Rohan Paul51

    微软 CEO Satya Nadella 发文称,任何超级智能追求都必须以造福人类和受人类控制为前提,欢迎以刻意放慢节奏把对齐作为设计目标。他主张开放与开源模型并存的生态、企业掌控自身知识嵌入自有权重的学习循环而不依赖单一模型供应商,对齐机制不能由少数实体控制;微软还将发布其自研 MAI 模型背后的 Code of Conduct 供公开咨询。

    引用Satya Nadella@satyanadella

    Any pursuit of superintelligence has to be grounded in the core principle that if the AI we build is not helping humanity and under human control, it's not worth pursuing. We also need to accelerate and spread the benefits of AI, such that they are diffused broadly across countries, communities, and companies. This requires a frontier ecosystem in which both closed and open-source models can thrive. And for firms, it’s imperative that they retain full control over their unique and tacit knowledge. Every organization should be able to build its own continuous learning loop/hill climbing machine, without becoming dependent on any one model provider, and have the ability to embed its own knowledge into models and weights they control. So, in this context, we welcome the research, focus, and deliberate pacing needed to get alignment right as the design goal. We also welcome ideas like "embedded evaluators" and the broader efforts to develop the mechanisms to make this more than just talk. The key is that this cannot be controlled by a handful of entities, but must have broad representation across the ecosystem, countries, and fields, including academia. This is the approach we are taking: broad access and choice at every layer of the AI stack; enterprise control of learning loops and models; and the “Code of Conduct” that underlies our own first party MAI models that we’ll publish tomorrow for public consultation.

  13. Rohan Paul58

    Dario Amodei 在 CBS Sunday Morning 访谈中表示,愿将 Anthropic 的技术交给"合适的政府组合"。他谈到父亲死于丙肝、自己患早期癌症的经历,称因此感到推动这项技术收益的分量;同时提到威胁报告中有用其模型制造生物武器的尝试,并回应因 Claude 生物安全防护过强而被嘲讽,称宁可被嘲笑也不愿模型被用来害人。

    引用Rohan Paul@rohanpaul_ai

    Dario Amodei got personal on CBS about AI’s risks, benefits, and the ridicule he faces on social media over safety. "I feel that this is a technology with great benefits and great risks. My father died of a disease, hepatitis C, that was something like 40% curable when he died of it. He wasn't one of the ones who was cured. A few years after, a medicine was invented that made it 95% curable. I myself survived an early-stage cancer that, if I'd been living in 1950, I probably would have died from. So I feel the weight of bringing the benefits of this technology. I also feel the risks. I wake up every day and, you know, I read one of these threat reports, like someone tried to use our model to build biological weapons. Of course, I don't want to be responsible for that, and that's why we have very strong safeguards. Almost every day, I'm made fun of on social media because our model's biology safeguards are too strong. Biology students complain, and they make jokes that they can't use the model. But the reason for that is that we have strong safeguards. I would rather they make fun of me than wake up one day and discover that someone used our model, Claude, to kill a bunch of people. I don't want that. So I feel both sides of it. I feel both sides of the responsibility." ---- From "CBS Sunday Morning" YouTube channel, (full video link in comment)