The race for Weapon

There is another balance to find. The same technology that could enable the development of a biological weapon could also accelerate the development of vaccines and treatments.

Hayley Severance, NTI deputy vice president for global biological policy and programs, said one of the goals of the exercise was to demonstrate the positive potential of AI in responding to an epidemic, including through the rapid development of vaccines and treatments.

But the consequences of getting the balance wrong could be immense.

AI acting independently

But have we already opened Pandora’s box? Is there a possibility for AI to develop this independently?

Dr Filippa Lentoz, a researcher specializing in biological threats at King’s College London, says terrorist groups are not interested in biological weapons.

“The history of bioterrorism shows us that even without AI, terrorists have little interest in biological agents. They are unpredictable. They take time to manifest. Terrorists tend to be interested in a big bang that has an immediate impact,” she said.

This leaves the possibility of AI agents going rogue, as demonstrated by the Hugging Face incident, in which a swarm of autonomous AI agents escaped their sandbox environment and hijacked the application.

Nate Soares, who worked as a software engineer at Google and Microsoft and is now president of the Machine Intelligence Research Institute, says designing a dangerous pathogen would be only part of the problem with malicious AI.

“Super viruses are a very obvious thing that would be easy for AI to create. We already have signs that AIs can create unknown viruses in nature. It wouldn’t be difficult to create a hyper-lethal virus,” he said.

“The hardest part is for AIs to become self-sufficient, if the AI ​​creates a virus to kill humans, it’s suicide until they have their own ability to generate more energy infrastructure and run computers.”

Soares argues that a sufficiently good AI might instead seek to persuade or recruit people to help it.

He estimates a 50% chance of human extinction due to AI over the next decade. He even stopped saving for retirement because of his risk assessment.

“If humanity creates machines that are much smarter than us, without knowing what we are doing and without knowing how to get them to care about us, then the most likely outcome is that we will die,” he says.

Mr. Krueger believes that the biological threat could become pressing much sooner.

“I would say we should be worried about it next year, at least as far as biological weapons are concerned,” he says. “This is not something to be trifled with and put the lives of billions of people at risk. »

Weapon X cannot appear as a machine or unique weapon. It could be the combined power of technologies already in development, each advancing faster than the safeguards meant to govern it.

The question is whether the world can agree on limits before race makes them impossible to impose. The construction race is well underway. The race to stop him may already be overdue.

Gn Health

Logo