Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]
Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]
Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]
Shownote
Shownote
My guest today is Neil Movva [https://x.com/neilmovva], founder of Sail. Sail is
building what Neil calls a token factory, an inference company designed for a
specific kind of future, one where AI agents run in the background for hours or
days at a time rather than answering a human in real time.
In that world, latency matters less and cost matters more, and Neil has built
the whole company around driving the cost of a token as low as it can possibly
go.
What makes this conversation special is that it is one of the most detailed
tours I have ever done through the full stack of intelligence, the software, the
chips, and the power, and how all three connect.
Along the way we cover the trade-off between speed and cost that lives inside
every GPU, his scavenger strategy for buying the chips and power nobody else
wants, his contrarian view on Nvidia, and why the premium the frontier labs
charge for being three to six months ahead may not last.
Please enjoy my conversation with Neil Movva.
For the full show notes, transcript, and links to mentioned content, check out
the episode page her
[https://colossus.com/episode/from-transistor-to-token/]e.
-----
Become a Colossus member to get our quarterly print magazine and private audio
experience, including exclusive profiles and early access to select episodes.
Subscribe at colossus.com/subscribe [https://colossus.com/subscribe].
-----
Ramp’s [https://ramp.com/invest] mission is to help companies manage their
spend in a way that reduces expenses and frees up time for teams to work on more
valuable projects. Go to
[https://ramp.com/250-signup-bonus?utm_source=podcast&utm_medium=paid-podcast&utm_campaign=podcast-colossus-250&utm_content=invest]
ramp.com/invest [https://ramp.com/invest] to sign up for free and get a $250
welcome bonus.
-----
Trusted by thousands of businesses, Vanta [https://vanta.com/invest]
continuously monitors your security posture and streamlines audits so you can
win enterprise deals and build customer trust without the traditional overhead.
Invest Like the Best listeners get a special offer of $1,000 off Vanta when you
go to vanta.com/invest [https://vanta.com/invest].
-----
WorkOS [https://workos.com/] is the infrastructure B2B and AI-native companies
use to sell to enterprise. It covers everything enterprise security requires:
SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Trusted by 2,000+
fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel.
-----
Rogo [https://rogo.ai/invest] is the AI platform for finance. They're building
agents for Wall Street that are trained to understand how bankers and investors
actually do work: from diligence and modeling, to turning analysis into
deliverables. To learn more, visit rogo.ai/invest [https://rogo.ai/invest].
-----
Ridgeline [https://www.ridgelineapps.com/] has built a complete, real-time,
modern operating system for investment managers. It handles trading, portfolio
management, compliance, customer reporting, and much more through an all-in-one
real-time cloud platform. Visit ridgeline.ai
[https://www.ridgelineapps.com/].
-----
Editing and post-production work for this episode was provided by The Podcast
Consultant [https://thepodcastconsultant.com/].
Timestamps:
(00:00:00) Welcome to Invest Like The Best
(00:02:20) Neil Movva
(00:03:22) Building a Token Factory
(00:05:32) The Rise of Long-Running Agents
(00:08:47) Deep Research and Cybersecurity
(00:15:12) The Full Stack of Intelligence
(00:20:03) Throughput Versus Latency
(00:24:58) The Future of AI Chips
(00:33:19) Why Transformers Work
(00:36:43) The Future of Data
(00:44:05) The Market for AI Chips
(00:47:56) Is the AI Boom Different?
(00:51:08) Reinventing the Data Center
(00:56:43) Scavenging Power
(01:01:04) Where Compute Is Most Inefficient
(01:07:02) Open Versus Closed Models
(01:10:37) A Trillion Tokens a Day
(01:12:42) The Contrarian Case on NVIDIA
(01:14:38) Advice for AI Hardware Founders
Highlights
Highlights
This episode examines how AI infrastructure may evolve as systems shift from instant responses to sustained, autonomous work. Neil Movva explains the technical and economic challenges involved in making that future practical.
Chapters
Chapters
Welcome to Invest Like The Best
00:00Neil Movva
02:20Building a Token Factory
03:22The Rise of Long-Running Agents
05:32Deep Research and Cybersecurity
08:47The Full Stack of Intelligence
15:12Throughput Versus Latency
20:03The Future of AI Chips
24:58Why Transformers Work
33:19The Future of Data
36:43The Market for AI Chips
44:05Is the AI Boom Different?
47:56Reinventing the Data Center
51:08Scavenging Power
56:43Where Compute Is Most Inefficient
1:01:04Open Versus Closed Models
1:07:02A Trillion Tokens a Day
1:10:37The Contrarian Case on NVIDIA
1:12:42Advice for AI Hardware Founders
1:14:38Transcript
Transcript
Speaker 4: Ramp is the only platform built to make your finance team leaner, faster, and better, saving businesses 5% annually on average. So you can stay focused on growth. Ramp customers grow revenue 3.2 times faster than the average American business. V...

![Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]](https://image.scripod.com/https://megaphone.imgix.net/podcasts/d56fad4c-876e-11f1-9151-5f1834daf707/image/de9954428adab72e672734106004bdcb.jpg?ixlib=rails-4.3.1&max-w=3000&max-h=3000&fit=crop&auto=format,compress)