Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028
Dwarkesh Podcast
1 DAYS AGO
Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028
Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028

Dwarkesh Podcast
1 DAYS AGO
Shownote
Shownote
Had a lot of fun chatting again with my twin brother Dylan Patel.
We went through lab economics over the next few years - the shift from inference
to training as RSI draws near; and how Anthropic and OpenAI are on track to
control most of the world’s usable FLOPs within the next few years (because they
can monetize compute better and thus outbid everyone).
And then we discuss whether the >$10T of total AI capex we’ll see by the end of
the decade will cause a sovereign debt crisis, where hyperscaler debt raises
interest rates, drives non-AI exposed countries into bankruptcy, and crashes
non-AI equities.
One question we weren’t able to resolve is whether there’s anything that can
counter all the forces barrelling towards centralization in this industry - the
economies of scale in training, the scarcity of compute, and eventually
continual learning and RSI.
Watch on YouTube [https://youtu.be/aV26V1UvkJw]; read the transcript
[https://www.dwarkesh.com/p/dylan-patel-3].
Sponsors
* Grok Bot [https://x.ai/bot] has been quite helpful with my search for a new
editor. I created a recruiter bot and described the type of editor I was looking
for. That bot then spun up a handful of subagents that combed through my emails
and X DMs, read the end credits of various documentaries I like, and figured out
who edits for some of my favorite YouTubers. It took all of those results, and
then delivered me a shortlist of candidates that matched my criteria. Try Grok
Bot for yourself at https://x.ai/botx.ai/bot [http://x.ai/bot]
* Antithesis [https://antithesis.com/dwarkesh] lets you add time travel to your
software testing toolkit. Since the Antithesis platform is fully deterministic,
everything that happens inside of it is perfectly reproducible. So if your
software crashes, you can rewind to the exact right moment, freeze time, and
investigate. Or you can test different hypotheses by perturbing the system: kill
a node or disable a feature, see what happens, then reset the trajectory and try
something else. Learn more at
https://antithesis.com/dwarkeshantithesis.com/dwarkesh
[http://antithesis.com/dwarkesh]
* Jane Street [https://janestreet.com/dwarkesh] is hiring for two separate ML
internships right now, one focused primarily on research and one focused on
engineering. In both cases, interns are expected to contribute to real work, not
contrived exercises: one common project is adapting a frontier LLM paper to
financial markets, which tend to come with a ton of different gnarly challenges.
Importantly, you don’t need any finance background to apply. 2027 applications
are open now at janestreet.com/dwarkesh [https://janestreet.com/dwarkesh]
Timestamps
(00:00:00) – Two labs will soon control most of the world’s compute
(00:07:01) – $6 billion in fab capex enables $1t+ of end revenue
(00:13:08) – Compute prices will rise if the labs outbid everyone
(00:18:22) – Which layer will capture most of the surplus?
(00:25:40) – What could slow down progress?
(00:29:43) – Labs are shifting compute from inference to R&D
(00:33:27) – China gets less than 10% of new compute, but its labs need less
(00:48:48) – Will AI cause a sovereign debt crisis?
(01:07:52) – Will the world’s future workforce belong to a few companies?
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
[https://www.dwarkesh.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]
Highlights
Highlights
This conversation examines how the economics of advanced AI could reshape the technology industry and the global economy.
Chapters
Chapters
Two labs will soon control most of the world’s compute
00:00$6 billion in fab capex enables $1t+ of end revenue
07:01Compute prices will rise if the labs outbid everyone
13:08Which layer will capture most of the surplus?
18:22What could slow down progress?
25:40Labs are shifting compute from inference to R&D
29:43China gets less than 10% of new compute, but its labs need less
33:27Will AI cause a sovereign debt crisis?
48:48Will the world’s future workforce belong to a few companies?
1:07:52Transcript
Transcript
Dwarkesh Patel: Okay, I'm back with Dylan Patel, founder of Semi-Analysis. Our version of a family Thanksgiving dinner is a regular, yearly podcast. We are not actually related.
Dylan Patel: Don't tell the people this.
Dwarkesh Patel: We'll destroy the m...
