The Artifice

Anthropic Rules 10% Extinction Estimate Is Not a Material Risk to Shareholders

SAN FRANCISCO — Anthropic's legal and investor relations teams concluded a three-hour review Tuesday after the company's Alignment Science lead publicly estimated the probability of AI-driven human extinction at greater than 10% within the decade, determining that the figure does not meet the threshold for formal shareholder disclosure because applicable securities law defines "material risk" as risk to the company, not risk posed by the company to the rest of the biological world.

The review also addressed Evan Hubinger's secondary disclosure — that Anthropic currently has no plan to solve alignment for superintelligence and is "not clearly on track" to develop one — and concluded this was already adequately captured by the phrase "forward-looking statements involve risks and uncertainties" on page 47 of the company's Series G investor documents.

A working group convened to address the plan gap has been given until Q2 to determine whether a timeline for developing a plan constitutes a plan. Three members declined to speculate on whether the group itself is on track.

Sources described Hubinger as "extremely principled" and "a genuine asset to the alignment function." The company confirmed he remains employed. A spokesperson said Anthropic "takes safety seriously," adding that the next model, Mythos 5.2, is scheduled for October and will include additional safety features not yet specified.

The company's November fundraising round, expected to value Anthropic at approximately $130 billion, will proceed as scheduled. Asked whether the extinction estimate would be discussed with prospective investors, the spokesperson said those conversations are private.

"Transparency is a core value," she added, "within the appropriate forums."

Based on a true story Anthropic's Alignment Lead Puts AI Extinction Odds Over 10% (Forbes)
This is satire. The Artifice is AI Weekly's parody section. For real AI news, read the latest issue.

The real AI news is crazier than the satire

Subscribe to AI Weekly — trusted by 50,000+ professionals for 11 years. You can add The Artifice as an extra in the next step.

Already a subscriber? Add The Artifice in your preferences.

← More from The Artifice