We Need AI Treaties. This is How We Get Them
Your Undivided Attention
Jun 18
We Need AI Treaties. This is How We Get Them
We Need AI Treaties. This is How We Get Them

Your Undivided Attention
Jun 18
Unprocessed episode, you can be the first!
Shownote
Shownote
In the middle of the twentieth century, the existential threat posed by nuclear
weapons seemed inevitable. The number of countries with nukes was climbing
rapidly, and the idea of stopping the nuclear arms race seemed like a pipe
dream.
But that’s exactly what happened. Over the course of 60 years, nations around
the world agreed to nuclear red lines, slowdowns, and even disarmament. How did
this happen? Largely because of technology.
The biggest obstacle to agreeing on nuclear red lines was that adversaries
couldn't trust any promise the other made. They needed to know the number of
warheads, the amount of enriched uranium, or whether a nuclear device was for a
weapon or a power plant. None of that was possible until we built the tech
needed to verify those things.
Today, we're in a similar situation with AI. For adversaries like the United
States and China to agree on reasonable AI red lines on issues like bioweapons,
cyber hacking, or the risk of recursive self-improvement, they first need to be
able to trust each other. We urgently need to build the verification technology
that would make that trust possible.
In this episode, Tristan sits down with two experts in this field to discuss the
kinds of verification technology we need for AI, the challenges of building it,
and the world it could unlock if we do. Tim Fist
[https://ifp.org/author/tim-fist/] is the Director of Emerging Technology Policy
at the Institute for Progress, and Janet Egan
[https://www.cnas.org/people/janet-egan] is Senior Fellow and Deputy Director
for the Technology and National Security Program at the Center for New American
Security.
Your Undivided Attention is produced by the Center for Humane Technology. You
can find a transcript of this episode on our Substack
[https://centerforhumanetechnology.substack.com/].
RECOMMENDED MEDIA
Anthropic’s open letter warning about recursive self-improvement and calling for
a pause in development.
[https://www.anthropic.com/institute/recursive-self-improvement]
The website for the Center for AI Standards and Innovation (CAISI)
[https://www.nist.gov/caisi]
Further reading on the different mechanisms of verification for international AI
governance.
[https://aigi.ox.ac.uk/publications/verification-for-international-ai-governance/]
RECOMMENDED YUA EPISODES
America and China Are Racing to Different AI Futures
[https://www.humanetech.com/podcast/america-and-china-are-racing-to-different-ai-futures]
Can We Govern AI? with Marietje Schaake
[https://www.humanetech.com/podcast/can-we-govern-ai]
The Crisis That United Humanity—and Why It Matters for AI
[https://www.humanetech.com/podcast/the-crisis-that-united-humanity-and-why-it-matters-for-ai]
Daniel Kokotajlo Forecasts the End of Human Dominance
[https://www.humanetech.com/podcast/daniel-kokotajlo-forecasts-the-end-of-human-dominance]
Correction: Tim referred to the CargoScan technology as being jointly developed
by the US and the USSR. It was actually developed solely in the US and
administered in Soviet nuclear facilities.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com
[https://pcm.adswizz.com] for information about our collection and use of
personal data for advertising.
Highlights
Highlights
Chapters
Chapters
Transcript
Transcript