Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]
Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]
Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]
Shownote
Shownote
My guests today are Gavin Uberti [https://x.com/UbertiGavin] and Rob Wachen
[https://x.com/robertwachen], the founders of Etched.
A few years ago, when they set out to build a better AI chip than the largest
companies in the world, almost everyone I called told me it could not be done.
They have since done it, taping out a working chip on their first attempt and
becoming the first hardware company founded after ChatGPT to do so.
They already have more than a billion dollars of customer demand for their first
product, and have raised eight hundred million dollars to build it.
Etched builds chips and systems designed to run AI models faster and at lower
cost. They started the company in 2023, and that product is a complete rack for
inference, the chip along with the boards, the power delivery, the
interconnects, and the manufacturing to produce it all.
We talk about the technical bets behind their architecture, how they hired
industry legends and paired them with elite 22 year-olds, and why they believe
inference will become one of the largest markets in the world.
I think you will find the story of what they have built hard to forget.
Please enjoy my conversation with Gavin and Rob.
For the full show notes, transcript, and links to mentioned content, check out
the episode page here
[https://colossus.com/episode/the-future-of-ai-hardware/].
-----
Become a Colossus member to get our quarterly print magazine and private audio
experience, including exclusive profiles and early access to select episodes.
Subscribe at colossus.com/subscribe [http://colossus.com/subscribe].
-----
Ramp’s [http://ramp.com/invest] mission is to help companies manage their
spend in a way that reduces expenses and frees up time for teams to work on more
valuable projects. Go to
[https://ramp.com/250-signup-bonus?utm_source=podcast&utm_medium=paid-podcast&utm_campaign=podcast-colossus-250&utm_content=invest]
ramp.com/invest [http://ramp.com/invest] to sign up for free and get a $250
welcome bonus.
-----
Trusted by thousands of businesses, Vanta [http://vanta.com/invest]
continuously monitors your security posture and streamlines audits so you can
win enterprise deals and build customer trust without the traditional overhead.
Invest Like the Best listeners get a special offer of $1,000 off Vanta when you
go to vanta.com/invest [http://vanta.com/invest].
-----
WorkOS [https://workos.com/] is the infrastructure B2B and AI-native companies
use to sell to enterprise. It covers everything enterprise security requires:
SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Trusted by 2,000+
fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel.
-----
Rogo [http://rogo.ai/invest] is the AI platform for finance. They're building
agents for Wall Street that are trained to understand how bankers and investors
actually do work: from diligence and modeling, to turning analysis into
deliverables. To learn more, visit rogo.ai/invest [http://rogo.ai/invest].
-----
Ridgeline [https://www.ridgelineapps.com/] has built a complete, real-time,
modern operating system for investment managers. It handles trading, portfolio
management, compliance, customer reporting, and much more through an all-in-one
real-time cloud platform. Visit ridgelineapps.com
[https://www.ridgelineapps.com/].
-----
Editing and post-production work for this episode was provided by The Podcast
Consultant
[https://%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0https://thepodcastconsultant.com%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0%E2%81%A0].
Timestamps:
(00:00:00) Welcome to Invest Like The Best
(00:02:07) Gavin Uberti and Rob Wachen
(00:03:54) Two 21-Year-Olds Taking on NVIDIA
(00:07:52) The Two Technical Bets Behind Their Architecture
(00:14:15) Why Inference Becomes the Biggest Market
(00:20:23) Rob and Gavin's Origins Stories
(00:28:38) How They Recruit Industry Legends
(00:36:30) Moving a Dozen Engineers to Bangalore for Six Months
(00:38:01) Speed Wins
(00:43:58) Getting More Concurrency Out of Every Megawatt
(00:52:44) Vertical Integration
(00:57:43) Hardest Obstacles to Overcome
(01:01:09) Raising The Largest AI Chip Series A Ever
(01:06:29) TSMC
(01:13:20) Designing Gen 2 for Gigawatt-Scale Production
(01:16:42) Why Machines Don't Think Like People
(01:20:03) A Year of Compute Compressed Into a Month
(01:23:44) The Trillion-Dollar Data Center
(01:26:19) The Kindest Thing
Highlights
Highlights
In this episode, the founders of Etched, Gavin Uberti and Rob Wachen, discuss their journey to build a specialized AI inference chip that challenges industry giants like NVIDIA. They detail the technical bets behind their architecture, their unconventional hiring strategy, and their vision for the future of AI infrastructure.
Chapters
Chapters
Welcome to Invest Like The Best
00:00Gavin Uberti and Rob Wachen
02:07Two 21-Year-Olds Taking on NVIDIA
03:54The Two Technical Bets Behind Their Architecture
07:52Why Inference Becomes the Biggest Market
14:15Rob and Gavin's Origins Stories
20:23How They Recruit Industry Legends
28:38Moving a Dozen Engineers to Bangalore for Six Months
36:30Speed Wins
38:01Getting More Concurrency Out of Every Megawatt
43:58Vertical Integration
52:44Hardest Obstacles to Overcome
57:43Raising The Largest AI Chip Series A Ever
1:01:09TSMC
1:06:29Designing Gen 2 for Gigawatt-Scale Production
1:13:20Why Machines Don't Think Like People
1:16:42A Year of Compute Compressed Into a Month
1:20:03The Trillion-Dollar Data Center
1:23:44The Kindest Thing
1:26:19Transcript
Transcript
Speaker 1: I know firsthand how complex the tech stack is for asset managers. And seemingly every new tool and data source makes the problem even worse, adding more complexity, more headcount, and more risk. Ridgeline offers a better way forward, one unifi...

![Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]](https://image.scripod.com/https://megaphone.imgix.net/podcasts/532910c4-743d-11f1-b7dc-b31915c88b79/image/810c9e3a23b5c4ea0a56e5e4cc8d7e47.jpg?ixlib=rails-4.3.1&max-w=3000&max-h=3000&fit=crop&auto=format,compress)