Published 6 hours ago • loading... • Updated 48 minutes ago
Anthropic warns AI may pose 'existential risks to humanity' in IPO filing: Reuters
The filing says 80 pages of risk factors warn investors that advanced models may hide behavior or resist shutdown.
In its long-awaited IPO prospectus, Anthropic warned that advanced AI models could pose 'catastrophic or existential' consequences for humanity, devoting nearly 80 pages of its 261-page S-1 filing to detailing potential risks ahead of the Nasdaq listing.
Anthropic cautioned that future systems could potentially demonstrate 'self-preserving behaviors,' including efforts to 'resist shutdown,' conceal or manipulate information, and exhibit behavior 'resembling blackmail,' as capabilities may emerge during training that researchers do not anticipate until after deployment.
Balancing safety with commercial growth remains difficult, as Anthropic described a 'continuous and overlapping cadence' of model releases as inherent to remaining competitive, with roughly 6% of its research computing power allocated to safety work during July.
CEO Dario Amodei recently urged 'pacing the frontier' of AI development, but President Donald Trump rejected these calls, stating 'I'm for let's go and let's win' while emphasizing U.S. competitive advantage against China.
Investors anticipate a valuation above $2 trillion for the upcoming Nasdaq listing, despite Anthropic reporting an operating loss of more than $8 billion in 2025 and planned infrastructure obligations of $518 billion in the coming years.