scripod.com

Jeff Dean: The 1% Rule for Building in AI

In this insightful conversation, Google's Chief Scientist Jeff Dean sits down with YC's Diana Hu at Startup School 2026 to explore the evolution of AI, from the foundational decisions that made Google search fast to the cutting-edge hardware and strategies shaping the future of machine learning. Dean shares the thought experiments behind the TPU, introduces his '1% Rule' for founders, and discusses the importance of context engineering, persistence, and developing a keen sense of taste in a rapidly changing field.
Jeff Dean begins by reflecting on his past predictions, noting that AI progress has been faster than expected, and forecasts that by 2027, ML systems will automate their own improvement. He draws a parallel between Google's 2001 decision to move its search index into RAM and the current need for specialized inference hardware to make agent-based systems viable, tracing the TPU's origin to a 2013 napkin calculation about speech recognition costs. Dean introduces 'context engineering' as a critical, accessible skill for building systems around models, and shares a practical example of writing a 'Performance Hints' skill with Sanjay Ghemawat. He then presents his '1% Rule' for founders: tackle problems where current models succeed only 0-1% of the time, emphasizing the importance of small teams, clear specifications, and having good taste in problem selection. Dean advises founders to focus on specialized domains or products with unique data access, and discusses how to develop taste through thought experiments and questioning assumptions. He highlights his current interest in using AI to automate the scientific method, citing a neural network that approximates quantum chemistry simulations 300,000 times faster. Finally, he stresses the value of persistence despite rejections, and points to data-efficient algorithms and continual learning as promising areas for future progress.
07:23
07:23
Identify bottlenecks and solve problems from first principles.
14:34
14:34
Building systems around models is accessible to everyone.
31:19
31:19
The scarce skill is having good taste in choosing problems.
38:34
38:34
Questioning assumptions can lead to entirely new design methodologies.
49:12
49:12
Persistence matters despite rejections.