scripod.com

Jim Keller: Moore’s Law, Microprocessors, Abstractions, and First Principles

Lex Fridman Podcast

Shownote

Jim Keller is a legendary microprocessor engineer, having worked at AMD, Apple, Tesla, and now Intel. He’s known for his work on the AMD K7, K8, K12 and Zen microarchitectures, Apple A4, A5 processors, and co-author of the specifications for the x86-64 ins...

Highlights

In this episode of the Artificial Intelligence podcast, Lex Fridman sits down with Jim Keller, a pioneering microprocessor engineer with a storied career spanning companies like AMD, Apple, Tesla, and Intel. Known for his deep technical insight and innovative thinking, Keller delves into a wide range of topics that bridge computer architecture, artificial intelligence, and the nature of intelligence itself.
07:00
Modern computers analyze instruction dependency graphs to execute out of order for performance optimization.
17:53
Modern AI explores noisy algorithms due to noisy input data.
20:47
The speaker draws an analogy between computer architecture and organizational design.
28:55
Successful long-term planning often requires redoing systems rather than incremental improvements.
32:57
Despite decades of predictions about its demise, Moore's Law continues due to countless innovations with diminishing returns that together maintain an exponential trend.
55:51
AI systems may represent a new stage in human evolution through encoded consciousness
1:00:05
The simulation concept breaks under scrutiny but remains intriguing.
1:03:00
Shrinking transistors has ripple effects beyond just cost.
1:19:41
Factory work is more complex than it appears and can be deeply satisfying.
1:21:07
First-principles thinking strips away assumptions to solve problems from the ground up.
1:28:33
Superintelligence may create interesting possibilities without necessarily inheriting human dark aspects.
1:32:39
The guest prefers the optimism and anxiety of the unknown over reliving the past

Chapters

Introduction
00:00
Difference between a computer and a human brain
02:12
Computer abstraction layers and parallelism
03:43
If you run a program multiple times, do you always get the same answer?
17:53
Building computers and teams of people
20:43
Start from scratch every 5 years
22:41
Moore’s law is not dead
30:05
Is superintelligence the next layer of abstraction?
55:47
Is the universe a computer?
1:00:02
Ray Kurzweil and exponential improvement in technology
1:03:00
Elon Musk and Tesla Autopilot
1:04:33
Lessons from working with Elon Musk
1:20:51
Existential threats from AI
1:28:33
Happiness and the meaning of life
1:32:38

Transcript

Lex Fridman: The following is a conversation with Jim Keller, legendary microprocessor engineer who has worked at AMD, Apple, Tesla, and now Intel. He's known for his work on AMD K7, K8, K12, and Zen micro architectures, Apple A4 and A5 processors, and co-...