PrivacySignal
AI Governance

Inside the Discussions at AI Companies Over a Superintelligence Doomsday

New York Times — Tech · · International · AI Governance

Researchers at major AI companies including Anthropic, OpenAI, Meta, and Google are internally pushing to draw more attention to what they see as serious long-term risks from artificial intelligence, including scenarios involving superintelligent systems.

Why this matters: The people building these systems are worried enough to push back from the inside. That matters. It is easy to dismiss AI doomsday talk as science fiction, but this is coming from researchers with direct access to the technology and the development timelines. The real issue is not whether catastrophic risk is certain. It is whether the people in charge are taking it seriously, and whether anyone outside these companies has enough visibility to hold them accountable if they are not.

Who should care: AI governance · Lawyers · Administrators · General readers · Policy

This summary is AI-assisted and may contain errors. It is an original briefing to help you gauge significance quickly — not a reproduction of the source. Always read the linked original before relying on it. See our methodology.

Analysis

All analysis →

Weekly Editorial Analysis from Experts and Editors

Logged Is Not Authorized

Georgia law restricts police use of license plate data to law enforcement purposes. A new lawsuit alleges deputies searched a man's vehicle five times while he was suing their sheriff. Two recorded reasons were "info" and "37." The system accepted both.

· 6 min read Read →
Deep Signal · Part I of III

The Algorithm Said So

Federal rulemakers are deciding what to do when artificial intelligence produces the kind of conclusion that once required an expert. They disagree about how to regulate it. They also disagree about whether the problem has arrived.

· 10 min read Read →

Related stories

AI Governance
New York Times — Tech · · International

In the A.I. ‘Robogym,’ Machines Train to Be More Like Humans

German robotics company Neura is using AI to train robots in simulated environments, positioning itself at the front of a European push to develop humanoid and adaptive machines. The effort is part of a broader competition with China over who leads the next generation of AI-driven robotics.

Who should care: AI governance · Lawyers · Administrators · General readers · Policy

#ai-governance#ai Read original →
News
War on the Rocks · · International

The Machine Staff

At Nellis Air Force Base last year, an AI system was tasked with building courses of action, a complex operational problem that military planners have spent generations learning to perform. The AI system took less than a minute to complete its task with solutions rated at 97 percent viable and tactically valid (essentially, whether the proposed plan could work given operational constraints such as fuel and force composition). By contrast, their human counterparts took roughly 19 minutes and only reached 48 percent viability.That comparison needs two qualifiers. First, the tool that hit 97 per…

Who should care: General readers · AI governance · Policy

News
The Guardian — Tech · · International

Four takeaways from Anthropic’s potentially record-breaking stock market filing

The AI company’s first public financial disclosures reveal explosive growth, huge costs and risks ranging from cyber-attacks to the limits of safeguards Anthropic has filed to go public on the US stock market, revealing for the first time the AI research lab’s financials and all the risks – more than 90 pages of them – that might negatively impact its business. The company’s investor prospectus, released Monday, veers from hyperbolic predictions about AI’s “incredible potential” to existential risks of the technology to the reality of its current business: explosive but incredibly expensive g…

Who should care: General readers · AI governance · Policy