Anthropic may just have avoided the next pandemic:Foils scientists’ attempt to create viruses using AI

Anthropic said Thursday it has blocked efforts by bad actors to use its artificial intelligence models for malicious activity such as cyberattacks, surveillance, and research that could have led to biological weapons, reported PTI. Biological weapons like viruses, bacteria, etc have the potential to cause pandemic. Anybody can use AI for cyberattacks: Anthropic As AI models grow more powerful, elaborate cyberattacks no longer require sophisticated skills and even lone individuals can create threats that would not have been possible even a year ago, Anthropic said. The company said it has added stronger safeguards in its latest models to restrict biological research that could also be used to make weapons. AI misuse: The cases we share here aren’t typical misuse, but rather examples of the most notable and novel threat activity we’ve identified to date, Anthropic said in its third report since March 2025 describing AI misuse. The report includes snippets of the malicious code and AI prompts Anthropic said it found and it urged governments and AI competitors to identify and prevent similar abuse. We’re publishing this work because we believe we have a responsibility to disclose malicious misuse of our services. As models become increasingly capable, their risks will increase, unless AI developers and society’s defenders act to make them safer, the company said. Anthropic planning IPO this fall The lengthy report by the AI startup, which is planning an initial public offering this fall, was published two days after one of its researchers announced he’s resigning over concerns that Anthropic and its competitors are not acting responsibly in AI development. He echoed concerns raised inside and outside of the industry about the technology’s potential to elude human control. Among the findings in the company’s report are unnamed actors attempting to use its models for research that could have led to biological weapons. Scientists use our AI to research on Chikungunya virus: Anthropic The work discussed in the application involved gain-of-function research (that is, research that genetically alters an organism to create a new or enhanced biological property) on the chikungunya virus. This gain-of-function research was aimed at the virus transmissibility and immune evasion properties, the report said.
Chikungunya is a mosquito-borne virus that causes debilitating symptoms such as severe pain and fever. The request involved a grant proposal for research seeking to enhance mutations to make the virus progressively more harmful. While such research could certainly be used to develop better vaccines and treatments, Anthropic said, it could also be used to make the pathogen more dangerous.