#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness
Lex Fridman Podcast
2021/02/18
#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness
#162 – Jim Keller: The Future of Computing, AI, Life, and Consciousness
Lex Fridman Podcast
2021/02/18
In this wide-ranging conversation, Jim Keller, a renowned microprocessor engineer with a storied career across AMD, Apple, Tesla, and Intel, delves into the intricacies of computing, artificial intelligence, and the broader implications of technology on human consciousness and society.
Keller discusses the evolution of processor design, touching on RISC vs. CISC architectures, the rise of ARM, and the limitations of Moore’s Law. He explores the future of AI hardware, emphasizing the need for new paradigms beyond traditional GPUs. The conversation expands into the nature of intelligence, the potential of neural networks to model physics, and the implications of brain-computer interfaces. Keller also reflects on leadership, personal growth, and the importance of love and meaning in life, offering insights drawn from his experiences working with visionaries like Steve Jobs and Elon Musk.
07:02
07:02
Computers are limited by branch predictability and data locality, leading to the development of predictors.
16:22
16:22
JavaScript succeeded due to its simplicity and developer accessibility
20:10
20:10
Intel out-innovated big companies in the semiconductor industry with processors like Core 2 and Haswell.
21:09
21:09
ARM's family of processors with different design points is mentioned.
22:38
22:38
ARM succeeded in mobile due to its synthesis-friendly IP model and flexibility.
26:45
26:45
Steve Jobs didn't accept that something couldn't be done.
27:06
27:06
Jobs' intuition often angered engineers while Musk dives deep into technical details
35:34
35:34
The speaker discusses the importance of zooming in and out of detail in engineering understanding
36:37
36:37
Creative tension requires both idea generators and filters to find the right path.
42:48
42:48
Good system design aligns with human cognitive capacity for modularity.
48:24
48:24
Neural network training efficiency has improved faster than Moore's Law
58:18
58:18
Tenstorrent's hardware natively runs graph programs critical for AI
1:05:07
1:05:07
Tenstorrent's hardware allows scaling from 100 milliwatts to a megawatt.
1:10:30
1:10:30
Chris Lattner's work on LLVM, Swift, and MLIR revolutionized software infrastructure.
1:16:53
1:16:53
Pixel processing allows for independent calculations across millions of pixels, enabling high parallelization.
1:20:45
1:20:45
Mobileye's use of classic computer vision contrasts with Tesla's neural network approach.
1:28:45
1:28:45
Autonomous cars could eliminate most accidents and be much safer than humans
1:29:13
1:29:13
Tesla's Dojo could revolutionize AI computing efficiency
1:32:30
1:32:30
There may be a physics beyond Wolfram's conception, accessible to AI but not humans.
1:34:03
1:34:03
The brain's limitations might be essential for intelligence.
1:39:30
1:39:30
Sadness enhances the value of happiness, making infinite fun potentially less appealing.
1:43:49
1:43:49
The brain fabricates visual perception, and AI could enhance this process.
1:49:19
1:49:19
Pre-preparing the mind before sleep can lead to more meaningful and memorable dreams.
1:58:09
1:58:09
Consciousness may emerge in AI systems capable of storytelling and world modeling
2:03:40
2:03:40
Ideas can be seen as autonomous organisms influencing human behavior.
2:05:24
2:05:24
The Ashton protocol involves a two-year taper, but many doctors don't follow it.
2:10:14
2:10:14
One-third of bacteria may die daily due to virus invasion.
2:18:54
2:18:54
A large group of outsiders launched a surprise attack in the stock market
2:21:25
2:21:25
Young people should focus on becoming good at something they're interested in.
2:24:30
2:24:30
Meditation and physical activity help resist depression
2:28:22
2:28:22
B-player leaders can cause underperformance in organizations
2:30:34
2:30:34
Love prevents habituation and is essential for success in parenting and work.
2:39:22
2:39:22
Jim Keller's daughter tried to add 'legend' and 'guru' to his Wikipedia page.
