scripod.com

Why People Are Paying 10x More for AI | Sid Sheth, d-Matrix

Eye On A.I.

1 DAYS AGO
Eye On A.I.

Eye On A.I.

1 DAYS AGO

Shownote

The AI chip market looks monolithic from the outside - NVIDIA dominates, and everyone else is fighting for scraps. But d-Matrix's CEO Sid Sheth argues that the market is quietly splitting into two distinct tiers, and the one that's exploding right now is t...

Highlights

In this episode, d-Matrix CEO Sid Sheth joins Craig Smith to challenge the assumption that NVIDIA's dominance defines the entire AI chip market. He argues that the industry is splitting into two distinct tiers, with a rapidly growing segment focused on low-latency inference that GPU-based systems are structurally unable to serve. The conversation explores this 'premium token economy,' where speed and interactivity are the product, and also offers a candid look at how AI is reshaping executive decision-making, from generating complex M&A plans in minutes to acting as a debate partner that pushes back on ideas.
03:25
Low-latency inference creates a premium token economy.
27:06
AI assistants have evolved from echo chambers to debate partners.
29:47
AI serves as an overlay on existing infrastructure

Chapters

The Premium Token Economy: Why Speed is the New Product in AI Inference
00:00
From Echo Chamber to Debate Partner: How AI is Transforming Executive Decision-Making
14:58
The Infrastructure Shift: Why Racks, Data Centers, and Strategic Manufacturing Choices Define the Next Wave
29:47

Transcript

Sid Sheth: People talk about organizations being entirely run by agents, right? How far are we from that? Eventually, I could run large portions of most companies. Craig S. Smith: Do you see emerging companies, startups that are agent first? The New York ...