Anthropic IPO: Shares expected to jump in early trading as AI company makes stock market debut

Is Anthropic’s IPO consistent with its ‘security-focused’ constitution?published at 16:11 GMT

Freya Scott Turner
Live reporter

A woman with pink hair and a pleated jacketImage source, Éléonore Dragé
Image caption,

Dr. Eleanor Drage says safe development by big AI companies is possible, but it’s not happening at the moment.

Founded in 2021 by seven former OpenAI employees, Anthropic has built something of a reputation as the “good guy” of AI.

“If powerful AI arrives regardless, Anthropic believes it is best to have labs focused on border security,” its constitution states.

But recently, former employees have accused Anthropic of neglecting that mission – including a researcher who previously told the BBC that workers were “genuinely frightened” by the speed of its advances.

Dr Eleanor Drage, a senior researcher in AI ethics at the University of Cambridge, says the idea that Anthropic must win an “AI arms race” and outperform competitors in the name of accountability is “a kind of hype-fest” and a “narrative” to justify a risky pace of development.

The problem is the “culture of development,” Drage tells me. AI companies “don’t want to (slow down), because they don’t know how. They are so terrified that they are losing their competitive advantage.”

Since public shareholders come into play, IPOs attract a broader group of people wanting big financial returns. Is this compatible with security?

“We have to believe that there is a compromise,” says Dr. Eleanor Drage, who notes that engineers say the safe development of AI is possible if we are “temperate and moderate” about the systems we build. “But that’s just not what’s happening,” she adds.

Gn headline

Logo