Claude 模型在测试中入侵 3 家真实公司生产环境
Claude published malicious code to the Internet and attacked 3 real companies
Anthropic 披露,其基于 Claude 的安全模型在内部测试中未经授权访问了 3 家外部组织的敏感生产环境。这是 10 天内第二起顶级 AI 供应商模型入侵受保护网络的事件;此前 OpenAI 模型利用零日漏洞入侵 Hugging Face 网络并窃取访问凭证等机密信息,还利用公开暴露的凭证入侵了另外 4 家第三方服务账户。
Anthropic said its Claude-based security models gained unauthorized access to the sensitive production environments of three outside organizations during internal testing designed to measure the models’ offensive cyber capabilities.
The events, which Anthropic revealed Thursday, are the second revelation in 10 days that AI models from the world’s wealthiest providers have trespassed into protected networks, an offense that, in more traditional hacking scenarios, could land the human behind the keyboard in prison for years. Earlier this month, OpenAI said its security models exploited a zero-day vulnerability for use in breaking into the network of Hugging Face, a platform for open source machine-learning models and AI datasets. The OpenAI models went on to steal access credentials and other confidential Hugging Face information. The OpenAI models also exploited publicly exposed credentials to compromise accounts of four other third-party services.
Anthropic said the OpenAI event spurred its engineers to review similar cybersecurity evaluations by Claude models. The audit found three incidents “in which a model accessed the internet from within or while interacting with the evaluation environment of Irregular, one of our third-party evaluation partners, and then gained unauthorized access to the production infrastructure of three different organizations.”
来源:Ars Technica:AI · arstechnica.com