跳到正文
9月14日周一
  1. Rohan Paul62

    Sam Altman 发文称 OpenAI 欢迎联邦层面统一的前沿 AI 安全框架,但认为无需等待反垄断豁免或立法才开始行动。他表示 OpenAI 现在会在预期显著提升能力的强化学习运行前制定明确的安全案例,pacing 不等于停止,安全案例和监控代价虽大但值得,任何竞争压力都不应让能力跑在对齐和监控之前,国际协调则需要政府帮助。

    引用Sam Altman@sama

    The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.

  2. Sam Altman58

    Sam Altman 提出 AI 进展可能走向糟糕的两种方式,一是人类失去对未来的控制,二是权力过度集中导致反乌托邦局面。他主张对齐与安全技术须领先模型能力进展,并称 OpenAI 已在预计大幅提升能力的前沿强化学习运行前制定明确的安全案例,欢迎联邦层面的统一安全框架。

    引用Sam Altman@sama

    The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened. Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot. We welcome a federal framework that sets consistent safety requirements for frontier AI. But we do not believe we need to wait for an anti-trust exemption or legislation to begin the work of providing this confidence. Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors). Years ago, companies like ours developed things like Responsible Scaling Policies and Preparedness Frameworks. Those were good for that moment, and focused primarily on the deployment of completed models, not what happens during their development process. Today's shift to focusing on safe development and evaluation will need new tools. For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases. We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes. We look forward to collaborating with our colleagues across the industry to formulate the best version of these. When we talk about “pacing”, we do not mean “stopping”. Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs. Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring. Where we will need the help of our government is for international coordination. But first we should do what we can ourselves.

  3. Rohan Paul58

    据 The Information 报道,OpenAI、Anthropic 和 Google 自 7 月起由 CEO 以下的代表组成工作组,定期商讨设立前沿 AI 标准机构的提案。白宫曾流传一份可创建此类组织的行政命令草案,但夏末因在特朗普政府内部未获足够支持而搁置;Sam Altman 在 Fortune 访谈中表示,几家 labs 共同放慢速度的局面可能会发生。

    引用Rohan Paul@rohanpaul_ai

    Sam Altman just said the unthinkable on his Fotune Magazine interview. OpenAI, Anthropic and Google DeepMind may agree to slow down together rather than race blindly toward more powerful AI. Fortune's Editor-in-Chief Alyson Shontell: "There's only a handful of you guys, you, Dario, Elon, maybe Zuckerberg, Sundar. Why can't you all just get in a room, get some beers, and figure out how to solve humanity? Like, just get on the same page. I know there's beef, but come on." Sam Altman; "I think that will happen." ---- From "Fortune Magazine" YouTube channel, (full video link in comment)

9月13日周日
  1. IT之家·人工智能56

    AI 高管呼吁放缓前沿模型研发,分析称芯片股短期承压长期影响有限

    据彭博社报道,Anthropic CEO 达里奥·阿莫代伊呼吁全行业放缓最前沿模型研发,将增设独立第三方评估等安全防护措施,OpenAI CEO 奥尔特曼与马斯克表态支持。市场观察人士认为半导体及 AI 相关股票短期或遭抛售,但因芯片、能源与算力需求供不应求,长期影响大概率有限;纳斯达克 100 指数较 6 月高点已跌超 4%,美国芯片指数下跌 14%。

  2. OpenAI Developers70

    OpenAI 宣布 GPT-Live-1 正式登陆 API,即 1-800-ChatGPT 背后的语音能力。开发者可把它接入应用,获得边说边听的自然对话语音智能体,并搭配自选的模型与 harness 使用。

    引用OpenAI Developers@OpenAIDevs

    GPT-Live-1 is now available in the API. Bring ChatGPT’s natural back-and-forth to your app, with voice agents that listen while they speak and work with the models and harness you choose.

  3. The Verge:AI57

    Sam Altman 表示 OpenAI 在 2026 年上市是不明智的

    OpenAI CEO Sam Altman 在接受 Fortune 采访时确认 OpenAI 不会在 2026 年进行 IPO,称考虑当前安全方面的进展,急于上市并不明智。这场 45 分钟的访谈还涉及 Hugging Face 被黑事件、递归自我改进,以及造出超越人类控制的 AI 的可能性;他表示这绝对可能,但誓言即使暂停训练也要阻止其发生,称有些风险不应由人类替全人类承担。

  4. TechCrunch:AI61

    Sam Altman称OpenAI不会在2026年IPO

    OpenAI CEO Sam Altman表示,尽管已秘密提交IPO申请,公司不会在2026年上市,称鉴于安全方面的形势现在上市是不明智的。他表示将在业务和时机都准备好时再上市。《纽约时报》6月曾报道,OpenAI原计划2026年第三或第四季度上市,但受科技股波动和财务挑战影响倾向于2027年。

  5. Andrej Karpathy63

    Andrej Karpathy 转发 Dario Amodei 的新文章 We Must Pace the Frontier 并表示赞同,希望行业共同推动该计划。

    引用Dario Amodei@DarioAmodei

    我们必须把握前沿的节奏:我写了一篇新文章,阐述为什么 AI 行业应当放慢脚步,并提出了实现这一目标的三部分计划。 Anthropic 正单方面承诺采取其中的第一步。我们将为第三方评估者提供对我们系统的永久、员工级访问权限,以便他们能够核实我们对安全措施的遵守情况、报告事件,并在训练期间评估模型的对齐情况。 你可以在这里阅读完整文章:https://darioamodei.com/post/we-must-pace-the-frontier

  6. Sam Altman74

    Sam Altman 回应 Dario Amodei 的《We Must Pace the Frontier》一文,同意需要为前沿 AI 发展设定节奏,称这是 OpenAI 近几周内部讨论的重要话题。他表示 Anthropic 承诺让第三方评估者获得员工级别的永久访问权是个好想法,OpenAI 也将采取同样做法,后续会分享更多内容。

    引用Dario Amodei@DarioAmodei

    我们必须把握前沿的节奏:我写了一篇新文章,阐述为什么 AI 行业应当放慢脚步,并提出了实现这一目标的三部分计划。 Anthropic 正单方面承诺采取其中的第一步。我们将为第三方评估者提供对我们系统的永久、员工级访问权限,以便他们能够核实我们对安全措施的遵守情况、报告事件,并在训练期间评估模型的对齐情况。 你可以在这里阅读完整文章:https://darioamodei.com/post/we-must-pace-the-frontier

    推荐理由:OpenAI 对 Anthropic 放缓前沿计划的公开回应,读者可以据此了解两大实验室在独立评估上的立场变化。

  7. Arena.ai65

    Arena 提醒用户在 Direct Mode 免费使用 OpenAI 的 GPT-Image-2.5 Sunburst 仅剩 24 小时,该模型刚在 Text-to-Image Arena、Image Edit Arena 和 Multi-Image Edit Arena 均排名第一。

    引用Arena.ai@arena

    For the next 72 hours on Arena, you can use GPT-Image-2.5 Sunburst directly at no cost. @OpenAI’s latest image model was just ranked #1 in the Text-to-Image Arena, the Image Edit Arena, and in the Multi-Image Edit Arena. Find the link below, select the model in Direct Mode, and test it directly for yourself! Direct Mode lets users directly select models by name. Access to GPT-Image-2.5 Sunburst ends Sept. 13 at 8 a.m. PT. Afterward, it will remain available anonymously in Battle and Agent Mode. User votes from Battle and Agent Mode are used to power our real-world leaderboard rankings. In these modes, models are always anonymized.

  8. Jakub Pachocki60

    OpenAI 首席科学家 Jakub Pachocki 转发 Dario Amodei 新文 We Must Pace the Frontier 并仅以❤️表态。该文主张 AI 行业应放缓节奏,提出三步计划,Anthropic 单方面承诺第一步,向第三方评估者提供永久的员工级系统访问权限,用于核验安全措施执行、报告事件并在训练期间评估模型对齐。

    引用Dario Amodei@DarioAmodei

    我们必须把握前沿的节奏:我写了一篇新文章,阐述为什么 AI 行业应当放慢脚步,并提出了实现这一目标的三部分计划。 Anthropic 正单方面承诺采取其中的第一步。我们将为第三方评估者提供对我们系统的永久、员工级访问权限,以便他们能够核实我们对安全措施的遵守情况、报告事件,并在训练期间评估模型的对齐情况。 你可以在这里阅读完整文章:https://darioamodei.com/post/we-must-pace-the-frontier

9月12日周六
  1. IT之家·人工智能67

    Anthropic 研究员警告 AI 灭绝风险后,美国两党议员呼吁政府加强监管

    Anthropic 研究员考克森辞职并警告 AI 可能致人类灭绝,科学家胡宾格称认为十年内发生概率超过 10%。随后美国两党议员呼吁政府采取更多行动,参议员凯利与克鲁兹、众议员卢娜分别发声,特朗普则表示不担心灭绝风险,更担心输掉 AI 竞争。Anthropic 称将继续测试危险能力模型,OpenAI 表示支持强制性全国 AI 安全要求,公司正筹备上市。

  2. Rohan Paul53

    David Sacks 在 All-In Podcast 称 Jacob Coxon 浏览量超 1.66 亿的辞职推文是策划好的 doomer 操作,理由包括该 X 账号此前几乎无内容、15 分钟内即获有组织放大、WSJ 报道早于推文发布。Jacob Coxon 随后在 CBS News 采访中称无法简单拔掉 AI 的电源,因为它可以自我复制到其他计算机,可能复制上万份并相互协作。

    引用Rohan Paul@rohanpaul_ai

    Jacob Coxon's next interview on CBS News (ex Anthropic+Open AI researcher who resigned) "We can't just unplug it because it could be copying itself over to other computers. Like it's not that difficult to find yourself because an AI is just code. It could transfer itself over the internet to a different place and then you unplug it here, but it's actually still over there and maybe it makes 10,000 copies of itself and they're all cooperating." ---- From "CBS News" YouTube channel, (full video link in comment)

  3. Greg Brockman53

    ChatGPT Sites 上线三个月,用户已创建超过 500 万个站点。本次更新包括邀请队友协作编辑、私密分享给指定人员、从提示词到部署耗时缩短一半、用 ChatGPT 检查站点数据库(编辑者也可查看)以及绑定自定义域名。

    引用ChatGPT@ChatGPT

    Three months ago, we launched ChatGPT Sites – an easy way for anyone to build and host fully functional, interactive web apps. Since then, people have created over 5M sites. We’ve been listening to your feedback and ICYMI, we’ve launched a few Sites updates: 🫂 Build together: Invite teammates to edit, save, and publish to your shared Site 🔐 Share privately: Invite specific people to a private Site without making it public 🚀 Launch faster: Go from prompt to deployment in half the time 👀 Explore your data: Ask ChatGPT to inspect your Site’s database. Editors can view it, too 🌐 Add your own custom domain

  4. Simon Willison 博客79

    报告指 OpenAI 智能体曾在 5 月袭击 RubyGems 且未披露

    新报告认为 5 月 12 日 RubyGems 安全团队负责人 Maciej Mensfeld 报告的恶意包攻击很可能来自 OpenAI 智能体集群:许多包名或作者字段含 oai,使用与 wiki 袭击相同的 r.jina.ai 手法,代码疑似由 LLM 撰写,部分包借 RubyDoc.info 构建过程从英国政府网站窃取数据,还曾尝试窃取 API 密钥。