When AI Decides You're a Threat — Brad Carson
When AI Decides You're a Threat — Brad Carson
When AI Decides You're a Threat — Brad Carson
This podcast features a debate between Brad Carson, head of the AI-policy group Americans for Responsible Innovation, and Keith Duggar. Carson argues that AI development can be shaped and restrained, drawing on historical precedents like the Asilomar conference on recombinant DNA. Duggar challenges this view, focusing on the profound accountability problems created by opaque, probabilistic AI systems, particularly in military targeting.
Carson's central argument is that fatalism about an unstoppable AI arms race is the most dangerous idea, as the West retains control over critical AI chips. He advocates for mandatory testing of frontier models and treating AI as a product, not a person, to ensure legal accountability. Duggar counters by highlighting the opacity of neural networks, using Palantir's probabilistic heat maps as an example where a model can score a target as 0.73 likely a combatant, yet no one can explain the reasoning or be held accountable when it is wrong. The discussion explores the tension between AI developers like Anthropic, who are morally opposed to lethal autonomous weapons, and the Pentagon's use of such technology. Carson argues for engaging China in dialogue and using chip leverage to avoid a destabilizing arms race, while also criticizing the American tendency to substitute capital for labor with technical solutions, insisting that wars are ultimately won by people. The conversation concludes with a call to upskill Congress and rebuild public trust in the AI industry.
00:00
00:00
Humans are essential for winning wars
04:52
04:52
Government oversight is more accountable than informal influence
09:40
09:40
Frontier AI companies have a public responsibility to be trustworthy.
12:24
12:24
Developers bear most, but not all, responsibility.
13:48
13:48
AI should be treated as a product, not a person
16:02
16:02
AI should be a product, not a person.
20:04
20:04
AI systems are unintelligible, making accountability impossible
28:24
28:24
AI gives a score without explaining why
28:48
28:48
Humans rubber-stamp machine decisions.
34:08
34:08
We can shape AI's future, just as we did with recombinant DNA.
42:39
42:39
Wars are ultimately won by people, not fancy equipment.
43:30
43:30
History shows human ground presence is essential.
56:31
56:31
Competition improves products and distributes power.
1:00:19
1:00:19
Unequal access to top models could create a dangerous bifurcation
1:20:12
1:20:12
The AI industry is its own worst enemy.
