scripod.com

Jonathan Ross, Founder of Groq

David Senra

6 DAYS AGO
David Senra

David Senra

6 DAYS AGO

Shownote

Jonathan Ross is the founder of Groq and the inventor of the Google Tensor Processing Unit (TPU), now a senior executive at NVIDIA following the company's $20 billion partnership with Groq. Before Groq, Ross built something that didn't exist: a custom AI ...

Highlights

Jonathan Ross, founder of Groq and inventor of the Google TPU, discusses his journey from creating a custom AI chip at Google to leading a major partnership with NVIDIA. He shares insights on leadership, the importance of fast inference for AI, and the challenges of building a company against conventional wisdom.
00:25
Combining GPUs and LPUs defeats various bottlenecks.
01:46
Current payment systems are not built for the micropayments that will skyrocket
03:30
A personalized daily brief summarizes news based on his interests.
05:55
AI shifts success from answering to asking the right questions
08:23
Leadership is having followers.
13:30
Set a simple, clear goal for everyone
14:34
Minimize constraints to foster innovation
19:06
Good founders ask insightful questions that make experts reconsider their assumptions.
19:44
His decisions were correct but lacked conviction.
22:23
West Coast VCs follow each other like lemmings
23:50
Extra money is no longer an advantage for startups.
26:48
Combining LPUs and GPUs optimizes LLM inference
30:08
Faster inference enables deeper search and creativity.
34:57
Reality Quotient involves recognizing reality and choosing the dominant game to play.
35:55
Align the entire organization around one dominant metric.
37:11
Make changes feel like no change at all.
41:06
Doing things differently is the only way to have an advantage.
42:54
People only understood the value of fast inference after trying it themselves.
46:32
Intent invites feedback without pessimism
51:07
80% participated, many taking large pay cuts
54:19
Focus on positive traits to avoid hiring problems.
58:46
Loss feels more painful than gain
1:00:37
Humiliation as a motivator for superhuman performance
1:03:13
Manufactured discontent is necessary for innovation
1:05:02
AI can cure diseases and slow aging.
1:07:11
Code creation is becoming nearly free.
1:10:04
Education should focus on asking questions, not answering them.

Chapters

The $20 Billion NVIDIA Deal Closed In 3 Weeks
00:00
Why GPUs And LPUs Are Better Together
00:25
When AI Talks To AI, Speed Wins
01:46
Always Start With A Hobby Project
03:30
Ask The Right Questions, Not Answer Them
05:55
There Are Infinite Ways To Be A Leader
08:23
I Was One Of The World's Worst Leaders
13:00
Fewer Constraints, More Room To Surprise You
14:34
At NVIDIA There Is No Politics
16:31
You Have To Learn Confidence
19:44
East Coast VCs Think, West Coast VCs Follow
22:23
The Keynesian Beauty Contest Of Silicon Valley
23:50
The Autonomy That Created The NVIDIA Deal
26:48
Making A Model Smarter By Making It Faster
30:07
Reality Quotient Beats Intelligence Quotient
34:52
Find The Dominant Game And Play It
35:44
A Founder's Job Is Full-Time Change Management
37:11
Return On Luck: Seize It Better Than Anyone
38:34
You Can't Sell Speed, You Have To Let People Try It
42:54
I Intend To: Intentional Leadership
46:32
Groq Bonds: Trading Salary For Survival
51:07
Hire For Negatives, Grow For Positives
54:13
Loss Aversion And Booking The Win Early
58:46
How Michael Jordan Weaponized Humiliation
1:00:37
Manufactured Discontent Drives Everything
1:03:13
Every Day Without Compute Has A Real Cost
1:05:02
Code Was Rationed, Now It's Nearly Free
1:07:07
Teach Kids To Ask Questions, Not Answer Them
1:10:04

Transcript

Speaker 1: Let's start with this $20 billion, rumored $20 billion partnership that you have with NVIDIA. Can you talk about the structure of the deal and how it came about? So the most interesting part about it is the call where the idea was first floated ...