Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.468]
Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.468]
Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.468]
In this episode, Patrick O'Shaughnessy revisits Dylan Patel of SemiAnalysis to dissect the rapidly escalating dynamics of AI token supply and demand — a conversation grounded in real-world usage, infrastructure constraints, and strategic implications for businesses and labs alike.
Dylan Patel describes explosive, near-unbounded demand for frontier AI tokens, driven by users’ strong preference for the latest models—exemplified by SemiAnalysis’s AI spend surging from tens of thousands to $7 million annually, now exceeding 25% of payroll. Claude Mythos represents the largest capability leap in two years, operating at an L6 software engineer level while improving token efficiency. Demand is accelerating further with robotics poised as the next major token consumption wave. On the supply side, severe bottlenecks span memory (DRAM), logic chips, wafer fab equipment, and even CPUs—now sold out industry-wide—amid TSMC’s record $100B capex plan straining downstream suppliers. While scaling laws still hold, compute scarcity is inflating margins for top labs and forcing tough trade-offs: firms must deploy more tokens to capture value or risk permanent competitive disadvantage. Tokenomics remains elusive in practice—real usage consistently outpaces estimates—and rising public backlash warns AI leaders to shift messaging toward tangible benefits and away from hype to avoid imminent protests.
02:29
02:29
Frontier models have near-unbounded willingness to pay for tokens
03:14
03:14
Current AI spend is over 25% of salary expense, and could exceed 100% by year-end
10:04
10:04
Investment firms buy data instead of building it because purchasing is cheaper and faster than internal development
11:44
11:44
Access to the most intelligent tokens is crucial for businesses to generate value, and some may be priced out
14:53
14:53
The speaker begged an Anthropic co-founder for access to Claude Mythos
15:36
15:36
Claude Mythos is potentially the biggest step up in model capabilities in two years
20:54
20:54
Ken Griffin got early access to advanced AI models, giving him a significant market advantage
23:45
23:45
The concept of a software-only singularity is a blip, as the majority of the world is physical
26:03
26:03
Claude Mythos is a larger model proving scaling laws still work
29:42
29:42
Failing to use more tokens to generate and capture economic value risks falling into the permanent underclass as model capabilities rise.
31:33
31:33
Memory margins have skyrocketed, and companies are making large prepayments.
35:57
35:57
TSMC may spend $100 billion on CapEx in 2028, risking downstream supply chain shortages
36:45
36:45
CPUs are crucial for reinforcement learning environments, where they grade the model's attempts, and for deploying models, as the output from GPUs or ASICs goes through apps running on CPUs
40:17
40:17
Actual token usage often exceeds estimates
42:20
42:20
Predict large-scale protests against AI in three months due to growing public fear and backlash
![Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.468]](https://image.scripod.com/https://megaphone.imgix.net/podcasts/ceb34422-3ec7-11f1-97a5-8bd036d5980c/image/e8a75bd4ab83f059c746a594afd471a8.jpg?ixlib=rails-4.3.1&max-w=3000&max-h=3000&fit=crop&auto=format,compress)