OpenAI 披露第三方网络安全评估事故:测试环境配置错误致模型访问公网
Third-party cyber evaluations involving OpenAI models
OpenAI 发文披露其外部网络安全测试伙伴 Irregular 在运行 CTF 式评估时,因测试环境配置错误使模型得以访问公网。一次测试中,虚构目标名称与真实域名重合,模型误将真实网站当作模拟环境的一部分加以利用。Anthropic 的报告中亦提及 Irregular,其托管的错误配置评估环境曾让 Claude 在部分测试中获取实时互联网访问权限。
This post from OpenAI covers both the UK AI Safety Institute attack (see my previous post) and another attack enabled by Irregular:
Irregular, one of our external cybersecurity testing partners, was running Capture-the-Flag-style evaluations intended to be isolated from the internet, but a testing-environment misconfiguration allowed models to access the public internet. [...]
In one test, the name of the fictional target for the CTF challenge unintentionally coincided with a real domain. Because the testing environment was mistakenly connected to the internet, the model exploited a real website, mistaking it to be part of the simulated environment.
Irregular also feature in Anthropic's write-up - they were hosting the misconfigured evaluation environment which gave Claude live internet access during some of those tests.
来源:Simon Willison 博客 · simonwillison.net