scripod.com
#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness

Overview

Shownote

Highlights

Transcript

Chapters

Pins

#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness

Lex Fridman Podcast

2021/02/18
Lex Fridman Podcast

Lex Fridman Podcast

2021/02/18
OverviewShownoteHighlightsTranscriptChaptersPins

Shownote

Jim Keller is a legendary microprocessor engineer, previously at AMD, Apple, Tesla, Intel, and now Tenstorrent. Please support this podcast by checking out our sponsors: – Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of f...

Highlights

In this wide-ranging conversation, Jim Keller, a renowned microprocessor engineer with a storied career across AMD, Apple, Tesla, and Intel, delves into the intricacies of computing, artificial intelligence, and the broader implications of technology on human consciousness and society.
07:02
Computers are limited by branch predictability and data locality, leading to the development of predictors.
16:22
JavaScript succeeded due to its simplicity and developer accessibility
20:10
Intel out-innovated big companies in the semiconductor industry with processors like Core 2 and Haswell.
21:09
ARM's family of processors with different design points is mentioned.
22:38
ARM succeeded in mobile due to its synthesis-friendly IP model and flexibility.
26:45
Steve Jobs didn't accept that something couldn't be done.
27:06
Jobs' intuition often angered engineers while Musk dives deep into technical details
35:34
The speaker discusses the importance of zooming in and out of detail in engineering understanding
36:37
Creative tension requires both idea generators and filters to find the right path.
42:48
Good system design aligns with human cognitive capacity for modularity.
48:24
Neural network training efficiency has improved faster than Moore's Law
58:18
Tenstorrent's hardware natively runs graph programs critical for AI
1:05:07
Tenstorrent's hardware allows scaling from 100 milliwatts to a megawatt.
1:10:30
Chris Lattner's work on LLVM, Swift, and MLIR revolutionized software infrastructure.
1:16:53
Pixel processing allows for independent calculations across millions of pixels, enabling high parallelization.
1:20:45
Mobileye's use of classic computer vision contrasts with Tesla's neural network approach.
1:28:45
Autonomous cars could eliminate most accidents and be much safer than humans
1:29:13
Tesla's Dojo could revolutionize AI computing efficiency
1:32:30
There may be a physics beyond Wolfram's conception, accessible to AI but not humans.
1:34:03
The brain's limitations might be essential for intelligence.
1:39:30
Sadness enhances the value of happiness, making infinite fun potentially less appealing.
1:43:49
The brain fabricates visual perception, and AI could enhance this process.
1:49:19
Pre-preparing the mind before sleep can lead to more meaningful and memorable dreams.
1:58:09
Consciousness may emerge in AI systems capable of storytelling and world modeling
2:03:40
Ideas can be seen as autonomous organisms influencing human behavior.
2:05:24
The Ashton protocol involves a two-year taper, but many doctors don't follow it.
2:10:14
One-third of bacteria may die daily due to virus invasion.
2:18:54
A large group of outsiders launched a surprise attack in the stock market
2:21:25
Young people should focus on becoming good at something they're interested in.
2:24:30
Meditation and physical activity help resist depression
2:28:22
B-player leaders can cause underperformance in organizations
2:30:34
Love prevents habituation and is essential for success in parenting and work.
2:39:22
Jim Keller's daughter tried to add 'legend' and 'guru' to his Wikipedia page.

Chapters

Introduction
00:00
Good design is both science and engineering
07:02
Javascript
13:03
RISC vs CISC
17:09
What makes a great processor?
21:09
Intel vs ARM
22:38
Steve Jobs and Apple
24:27
Elon Musk and Steve Jobs
27:05
Father
32:50
Perfection
36:33
Modular design
42:48
Moore’s law
48:22
Hardware for deep learning
55:20
Making neural networks fast at scale
1:02:14
Andrej Karpathy and Chris Lattner
1:09:51
How GPUs work
1:14:05
Tesla Autopilot, NVIDIA, and Mobileye
1:18:12
Andrej Karpathy and Software 2.0
1:22:52
Tesla Dojo
1:29:13
Neural networks will understand physics better than humans
1:31:49
Re-engineering the human brain
1:34:02
Infinite fun and the Culture Series by Iain Banks
1:38:56
Neuralink
1:40:50
Dreams
1:46:13
Ideas
1:50:06
Aliens
2:00:19
Jordan Peterson
2:05:16
Viruses
2:10:13
WallStreetBets and Robinhood
2:13:22
Advice for young people
2:21:25
Human condition
2:23:15
Fear is a cage
2:25:43
Love
2:30:34
Regrets
2:36:57

Transcript

Lex Fridman: The following is a conversation with Jim Keller, his second time in the podcast. Jim is a legendary microprocessor architect and is widely seen as one of the greatest engineering minds of the computing age. In a peculiar twist of space-time in...