利用AI开发生物武器?Anthropic称阻止多起相关企图

Wait 5 sec.

DUSTIN VOLZ2026年9月11日Anthropic周四发布的报告列举了过去八个月其AI模型——包括聊天机器人Claude——遭到的一系列滥用情况。 Marissa Leshnov for The New York TimesAnthropic said it had disrupted several potential plots this year by scientists who used its leading artificial intelligence models to conduct research that could have helped develop biological weapons.Anthropic表示,今年已多次阻止科学家利用其领先的人工智能模型开展研究的企图,这些研究可能有助于开发生物武器。In a report describing misuses of its A.I. models, Anthropic said it could not determine whether the research served a legitimate or nefarious purpose because valid biological inquiry — the kind that can lead to breakthroughs like vaccines — can also help engineer dangerous pathogens. In the face of that uncertainty, Anthropic said it erred on the side of caution because the consequences of missing malicious activity could be severe.在一份描述其AI模型被滥用的报告中,Anthropic表示无法确定这些研究是出于合法还是邪恶目的,因为有效的生物学研究——能带来疫苗等突破的那种——也可能有助于设计危险病原体。面对这种不确定性,Anthropic表示选择谨慎行事,因为漏掉恶意活动的后果可能很严重。“You are not seeing someone in a comic book kind of way say, ‘Hey, I want to build a biological weapon to kill everybody,’” Jacob Klein, the head of threat intelligence at Anthropic, said in an interview. “It’s an incredibly nuanced situation.”“你不会看到有人像漫画书里那样说,‘嘿,我想制造生物武器杀死所有人,’”Anthropic威胁情报主管雅各布·克莱因在接受采访时说。“情况极其微妙。”The potential for cutting-edge A.I. models to facilitate the development of known or entirely new biological pathogens is among the gravest concerns experts have about a technology that is developing so rapidly that even its leading architects doubt whether humans will be able to fully control it.尖端AI模型可能促进已知或全新生物病原体的开发,这是专家们对这项技术最严重的担忧之一——该技术发展如此迅速,连其领先的设计者都怀疑人类能否完全控制它。Compared with the threat of catastrophic cyberattacks or A.I. agents that fail to align with human intentions, biological misuse has gained less attention as an existential risk of A.I., in part because past examples have generally been shown only in research settings rather than in the real world.与灾难性网络攻击或与人类意图不一致的AI智能体相比,生物滥用作为AI的生存风险受到的关注较少,部分原因是过去的案例通常只出现在研究环境中,而非现实世界。Andrew Weber, a senior fellow on the Council on Strategic Risks who reviewed Anthropic’s report before its release, said the findings were “chilling examples of state-sponsored biological weapons developers tapping into the rapidly advancing capabilities” of leading A.I. models.战略风险委员会高级研究员安德鲁·韦伯在报告发布前审阅了Anthropic的报告。他说,这些发现是“国家支持的生物武器开发者利用领先AI模型快速进步能力的案例,令人不寒而栗”。The lengthy report that Anthropic published on Thursday cataloged a litany of misuses on various models of its Claude A.I. chatbot over the past eight months. Some examples were similar to past disclosures from Anthropic and other A.I. labs, including suspected Chinese and Iranian government-linked actors targeting dissident and diaspora communities for surveillance.Anthropic周四发布的长篇报告列举了过去八个月其Claude聊天机器人各模型被滥用的一系列事例。一些例子与Anthropic和其他AI实验室过去的披露类似,包括疑似与中国和伊朗政府有关联的行为者针对异见者和侨民社区进行监视。The report also highlighted cases of Russian state media using Claude to generate online propaganda masquerading as independent reporting, including fabricated claims about an election in Moldova.报告还提到俄罗斯官方媒体使用Claude生成伪装成独立报道的在线宣传,包括关于摩尔多瓦选举的捏造内容。Anthropic documented another genre of abuse it said was new: attempts to use Claude to develop software for conventional weapons design and development, including firearms, missiles, armed drones and bombs. It detailed three cases in China, two in Russia and one in Yemen.Anthropic记录了另一种它认为属于新型的滥用:试图利用Claude开发用于常规武器设计和开发的软件,包括枪支、导弹、武装无人机和炸弹。报告详细描述了在中国的三起、俄罗斯的两起和也门的一起案例。The report does not identify by name which parties were involved in the Yemeni case, but the context makes clear that it is referring to the Iran-backed Houthi militia. A.I. use by terrorist networks is a growing concern among U.S. security officials.报告未点名也门这一例涉及哪一方,但上下文清楚表明指的是伊朗支持的胡塞武装。恐怖网络使用AI正日益成为美国安全官员的担忧。But among all the categories of threats shared in the report, none may be as worrisome as the biological research cases. Anthropic did not disclose the names of researchers or institutions that it blocked, their countries of affiliation or the specific biological agents at issue, in part because of its uncertainty about their aims.但在报告列出的所有威胁类别中,可能生物研究最令人担忧。Anthropic未披露它阻止的研究人员或机构的名称、所属国家或所涉具体生物制剂,部分原因是其不确定这些人的目的。Still, Anthropic said the scientists circumvented its controls intended to prevent users from blocked regions from gaining access to its A.I. models and worked to “obfuscate the purpose of their research to evade our safeguards.” The company banned accounts associated with the research.尽管如此,Anthropic表示,这些科学家规避了旨在阻止被封锁地区用户访问其AI模型的控制措施,并设法“混淆研究目的以避开我们的安全护栏”。该公司封禁了相关账户。In one example from May, a scientist sought Claude’s help with writing a grant application for funding to conduct research intended to experiment on the chikungunya virus, a mosquito-borne malady that can lead to months of severe pain and other symptoms. Such research, known as gain of function, can be legitimate and lead to vaccine development, but it can also create superbug versions of viruses. In this instance, the scientist wanted to engineer mutations to the virus that would make it more harmful as it repeatedly infected live animals.在5月的一个案例中,一名科学家寻求Claude帮助撰写拨款申请,以资助针对基孔肯雅病毒的研究。这是一种蚊媒疾病,可导致数月严重疼痛和其他症状。这类研究被称为功能获得性研究,可能合法且促成疫苗开发,但也可能制造出超级病毒。在此例中,科学家想要设计病毒突变,使其在反复感染活体动物时更具危害性。Anthropic said it believed the particular research was worrisome in part because it could discern that the work was intended to be performed at a military research institute.Anthropic表示,它认为这项研究令人担忧,部分原因是它能够辨别出这项工作拟在一家军事研究机构进行。“What we don’t know is if the research was meant to be weaponized,” Mr. Klein said. “But a military institution doing gain-of-function research is concerning.”“我们不知道的是,这项研究是否有武器化意图,”克莱因说。“但军事机构进行功能获得性研究令人担忧。”Anthropic said evaluations from last year of its older models demonstrated that they were not yet able to meaningfully assist in conducting dangerous biological research. Its current models are more able to complete complex scientific research, the company said, which spurred tighter safeguards intended to restrict access to a wide range of dual-use biological research queries.Anthropic表示,去年对其旧模型的评估表明,它们尚不能有效协助进行危险的生物研究。该公司称,当前模型更有能力完成复杂科学研究,这促使其收紧了安全护栏,以限制多种两用生物研究的提问。Susan Monarez, a microbiologist and public health expert who oversaw a review of national biosecurity preparedness in the Obama administration, also reviewed the Anthropic report before its publication. She said the findings provided real-world evidence to support concerns that bad actors were trying to covertly use advanced A.I. “to improve their chances of building biological pathogens that could cause significant harm.”微生物学家兼公共卫生专家苏珊·莫纳雷斯曾在奥巴马政府负责监督国家生物安全准备工作的审查,她也在报告发布前审阅了Anthropic的报告。她说,这些发现提供了现实证据,支持了有关不良行为者正试图秘密利用先进AI的担忧,这些行为者试图“提高其制造可能造成重大伤害的生物病原体的机会”。Dr. Monarez, who briefly served as the director of the Centers for Disease Control and Prevention last year, said A.I. held enormous promise to usher in an era of medical breakthroughs that save and extend lives. But the same abilities that make that possible, she added, could also “let bad actors hide in plain sight, using seemingly legitimate research to create pathogens we may not see coming and may not be able to stop once released.”去年曾短暂担任美国疾病控制与预防中心主任的莫纳雷斯说,AI有着巨大前景,可开启一个拯救和延长生命的医学突破时代。但她补充说,使其成为可能的同样能力也可能“让不良行为者在光天化日之下,利用看似合法的研究制造我们可能无法预见、一旦释放可能无法阻止的病原体”。Mr. Weber of the Council on Strategic Risks, who also served as the assistant secretary of defense for nuclear, chemical and biological defense programs during the Obama administration, called for limiting access to A.I. tools capable of this level of biological research to trusted researchers only.战略风险委员会的韦伯也曾在奥巴马政府担任负责核、化学和生物防御项目的助理国防部长。他呼吁将能够进行这种级别生物研究的AI工具仅限于可信研究人员使用。“The fact that Russia, China and North Korea continue to develop prohibited biological weapons makes it imperative that we deny their researchers access to these extraordinarily capable models,” he said.“俄罗斯、中国和朝鲜继续开发被禁止的生物武器,这使我们必须阻止其研究人员使用这些极其强大的模型,”他说。Dustin Volz为时报撰写网络安全和情报方面的文章,他常驻华盛顿。翻译:经雷点击查看本文英文版。