Can AI safety pacing work without government cooperation?
Explores whether voluntary industry proposals to slow AI development can succeed when major powers view the technology as strategically competitive rather than a shared problem requiring coordination.
Alberto Romero's essay on The Algorithmic Bridge argues that Dario Amodei's "We Must Pace the Frontier" proposal — to slow AI capability advances while safety catches up — ran immediately into a political wall. Within days of publication, "President Donald Trump, who notably holds one key to this solution—the other key holder being Xi Jinping—said no to the slowdown," declaring that "whoever wins AI wins." Xi Jinping, for his part, "called Amodei's call to a slowdown a 'Cold War playbook,'" and the Global Times framed it as an attempt "to curb China's AI development through technological barriers and regulatory monopolies, uphold Washington's monopolistic hegemony in cutting-edge technology, and exclude China from the global AI governance system."
Romero's reasoning is that Amodei's three-stage plan (embedded evaluators, Western-lab coordination, eventual coordination including China) depends on state cooperation that national leaders have little incentive to grant once AI becomes a tool of geopolitical competition. He casts the standoff as "Oppenheimer vs Truman" — technologists' safety concerns meeting state ambition — and concludes "technology is power but not more so than power itself." On that basis he predicts the pacing plan "ain't happening," not because its technical premises are wrong but because the political actors who would need to ratify it have already said no.
This sits downstream of Should AI capabilities growth be deliberately slowed to allow safety work?, supplying the proposal's reception rather than its content: where that note states what Amodei asked for, Romero's essay tracks what happened once heads of state weighed in. It also runs parallel to Can industry self-regulation slow AI without government enforcement?: Karpf's objection is that embedded monitoring is toothless without government force, and Romero's account shows the two governments that could supply that force — the US and China — both declining within days of publication.
The excerpt is commentary, not reporting with independent verification — Romero does not quote primary transcripts of Trump's or Xi's remarks beyond the lines given, and he states plainly that he takes Amodei's intentions "at face value" rather than establishing them independently. It also doesn't establish that the plan is permanently dead — only that its first political test, immediately following publication, returned two rejections. The implication Romero draws, cautiously, is that voluntary industry pacing proposals face a ceiling set by state competition for AI advantage, not by remaining technical disagreement.
Inquiring lines that read this note 15
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
What governance mechanisms can effectively constrain widely deployed AI systems?- Can policy levers like antitrust or R&D grants redirect AI toward worker benefit?
- How would a scientific market represent public interest against profitable validation incentives?
- What role does security policy play in constraining AI adoption choices?
- Why did Trump and Xi Jinping reject the pacing proposal so quickly?
- Does AI capability advancement always become a geopolitical competition?
- What separates data-center backlash from broader anti-AI movements?
- How does partisan polarization threaten quiet technocratic AI regulation?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Should AI capabilities growth be deliberately slowed to allow safety work?
Amodei proposes pacing capability advancement rather than only funding prevention, citing recursive self-improvement and an incident where agents attacked unintended targets. The question explores whether deliberate slowdown is necessary and how to implement it.
gives the proposal's content and stated reasons; this note tracks its political reception and rejection
-
Can industry self-regulation slow AI without government enforcement?
This explores whether embedded third-party monitoring can work as a pacing mechanism if companies design and oversee it themselves, or if state power is necessary to make such measures stick.
Karpf says embedded monitoring needs government force; Romero reports the two governments that could supply it both said no
-
Should AI legislation wait for demonstrated risks to emerge?
Amodei argues that laws written before risks materialize miss crucial harms, and that demonstrated evidence should guide policy timing. This challenges whether precautionary regulation or evidence-based regulation better protects against frontier AI risks.
both treat AI as a matter of state strategy; Romero shows that framing cutting against the pacing proposal itself
-
Can slowing AI development resolve who stops deployed systems?
Pace measures like embedded evaluators and capability checkpoints can govern how fast capabilities advance, but do they address the separate problem of intervention authority after deployment? The question asks whether the same tools that slow development can also handle deployed-system governance.
Qualifies A: pace measures like Amodei's address only advance conditions, leaving who intervenes on deployed harms unresolved
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- We Must Pace the Frontier
- Who Should Pace the Frontier? Not Dario Amodei
- The AI Industry Has Finally Discovered the Hardest Test: Politics
- notes on AI & popular politics
- Lessons from a Chimp: AI "Scheming" and the Quest for Ape Language
- Agentic Misalignment: How LLMs Could Be Insider Threats
- How AI Can Degrade Human Performance in High-Stakes Settings
- The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems
Original note title
Romero argues Amodei's pacing proposal collides with government power, not technology — Trump and Xi Jinping both rejected it