scripod.com
Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI

Overview

Shownote

Highlights

Transcript

Chapters

Pins

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI

Dwarkesh Podcast

2025/02/12
Dwarkesh Podcast

Dwarkesh Podcast

2025/02/12
OverviewShownoteHighlightsTranscriptChaptersPins

Shownote

This week I welcome on the show two of the most important technologists ever, in any field. Jeff Dean is Google's Chief Scientist, and through 25 years at the company, has worked on basically the most transformative systems in modern computing: from MapRe...

Highlights

This podcast delves into the transformative journey of two pivotal figures in technology, Jeff Dean and Noam Shazeer, who have spent over two decades at Google shaping the landscape of modern computing and artificial intelligence. Their contributions range from foundational systems like MapReduce and BigTable to groundbreaking advancements in neural networks and large language models.
02:42
The importance of AI in Google's early strategy
11:45
Quantization Impact on AI Models
14:40
Speeding Up Translation from Hours to Milliseconds
23:29
Scaling Neural Networks for Advancement
26:42
Organizing and creating new info in multimodal ways.
36:02
Potential Productivity Boost
42:22
Importance of Algorithmic Improvements
58:09
Specialized hardware for inference tasks.
1:16:02
AI Deployment Requires Safeguards
1:28:15
Importance of Cheap Hardware for AI Models
2:00:38
Considering trade-offs in sharing research
2:09:53
Exploring New Areas and Humility

Chapters

From PageRank to the Dawn of AI: A Journey Through Time
00:00
Joining Google in 1999: The Early Days of AI Exploration
05:35
Building Blocks of Innovation: How Hardware Shapes AI
14:40
Neural Networks Revolutionize Translation: From Hours to Milliseconds
23:29
The Rise of Multimodal AI: Organizing Complex Information
26:42
Coding with Intelligence: AI's Impact on Software Development
36:02
Scaling Up: The Computational Challenges of AI Models
42:22
Safety First: Navigating Risks and Ensuring Human Oversight
58:09
Chat-Based Interfaces: Paving the Way for Interactive AI
1:03:46
Modularizing AI: Enhancing Capabilities Through Segmentation
1:28:15
Extracting Insights: Pre-Training Techniques and Model Innovations
2:00:38
Internal Chatbots and Beyond: The Evolution of Conversational AI
2:06:55

Transcript

Dwarkesh Patel: Today, I have the honor of chatting with Jeff Dean and Noam Shazeer. Jeff is Google's chief scientist, and through his 25 years at the company, he has worked on basically the most transformative systems in modern computing. From MapReduce, ...