scripod.com

Google Part III: The AI Company

Acquired

2025/10/06
Acquired

Acquired

2025/10/06

Shownote

Google faces the greatest innovator's dilemma in history. They invented the Transformer — the breakthrough technology powering every modern AI system from ChatGPT to Claude (and, of course, Gemini). They employed nearly all the top AI talent: Ilya Sutskever, Geoff Hinton, Demis Hassabis, Dario Amodei — more or less everyone who leads modern AI worked at Google circa 2014. They built the best dedicated AI infrastructure (TPUs!) and deployed AI at massive scale years before anyone else. And yet... the launch of ChatGPT in November 2022 caught them completely flat-footed. How on earth did the greatest business in history wind up playing catch-up to a nonprofit-turned-startup? Today we tell the complete story of Google's 20+ year AI journey: from their first tiny language model in 2001 through the creation Google Brain, the birth of the transformer, the talent exodus to OpenAI (sparked by Elon Musk's fury over Google’s DeepMind acquisition), and their current all-hands-on-deck response with Gemini. And oh yeah — a little business called Waymo that went from crazy moonshot idea to doing more rides than Lyft in San Francisco, potentially building another Google-sized business within Google. This is the story of how the world's greatest business faces its greatest test: can they disrupt themselves without losing their $140B annual profit-generating machine in Search? Sponsors: Many thanks to our fantastic Fall ‘25 Season partners: * J.P. Morgan Payments [https://bit.ly/JPMPgoogle3pod] * Sentry [https://bit.ly/acquiredsentry] * WorkOS [https://bit.ly/workos25] * Shopify [https://bit.ly/ShopifyACQ25] Links: * Sign up for email updates [https://www.acquired.fm/email] and vote on future episodes! * Geoff Hinton’s 2007 Tech Talk at Google [https://youtu.be/AyzOUbkUf3M?si=sLQJsEwq-JEOQmIN] * Our recent ACQ2 episode with Tobi Lutke [https://www.acquired.fm/episodes/how-to-live-in-everyone-elses-future-with-shopify-ceo-tobi-lutke] * Worldly Partners’ Multi-Decade Alphabet Study [https://worldlypartners.com/businesshistory] * In the Plex [https://www.amazon.com/Plex-Google-Thinks-Works-Shapes/dp/1416596585] * Supremecy [https://www.amazon.com/Supremacy-ChatGPT-Race-Change-World/dp/1250337747] * Genius Makers [https://www.amazon.com/Genius-Makers-Mavericks-Brought-Facebook/dp/1524742678] * All episode sources [https://docs.google.com/document/d/1B7MSmQDqaTtcxWskoVwN0V5N292So_9lKiArzRUgTFU/edit?usp=sharing] Carve Outs: * We’re hosting the Super Bowl Innovation Summit! [https://bit.ly/SBISFall25] * F1: The Movie [https://www.imdb.com/title/tt16311594/] * Travelpro suitcases [https://travelpro.com] * Glue Guys Podcast [https://open.spotify.com/show/18n6FcVMR5J0hSeboeETPc?si=b876358f752a474d] * Sea of Stars [https://seaofstarsgame.co] * Stepchange Podcast [https://www.stepchange.show/data-centers] More Acquired: * Get email updates [https://www.acquired.fm/email] and vote on future episodes! * Join the Slack [http://acquired.fm/slack] * Subscribe to ACQ2 [https://pod.link/acquiredlp] * Check out the latest swag in the ACQ Merch Store [https://www.acquired.fm/store]! ‍Note: Acquired hosts and guests may hold assets discussed in this episode. This podcast is not investment advice, and is intended for informational and entertainment purposes only. You should do your own research and make your own independent decisions when considering any financial transactions.

Highlights

Google invented the foundational technology behind today’s AI revolution and assembled the brightest minds in the field long before competitors emerged. Yet despite its early lead, the company was blindsided by the rapid rise of ChatGPT—a product built on Google's own breakthroughs. This is the story of how internal inertia, strategic hesitation, and the weight of a $140B search empire left a tech giant scrambling to catch up in the very game it created.
09:04
Compressing data is equivalent to understanding it
20:39
Jeff Dean re-architected the algorithm to run in parallel, reducing translation time to 100 milliseconds
29:34
Geoff Hinton's 2007 tech talk at Google catalyzed the company's investment in deep learning.
39:00
Neural network learns to recognize cats from unlabeled YouTube videos using 16,000 CPU cores
44:57
AlexNet reduced image classification error rates from 25% to 15% in 2012
54:35
Google won the bid for DeepMind at $44 million during a NeurIPS conference auction
1:12:10
AI could pose a threat even on Mars
1:32:14
Ilya Sutskever was intrigued by the vision and became OpenAI's founding chief scientist
1:41:23
Google's $130 million GPU order gave NVIDIA confidence in neural networks
1:59:18
The Transformer architecture is elegant, scalable, and fundamentally different from prior neural network approaches.
2:23:32
ChatGPT's launch was accidental and overwhelmed servers within days
2:32:45
Sundar Pichai issues a 'code red' at Google after ChatGPT's success.
3:27:39
Google has all four key aspects of AI: application, model, cloud, and chips.

Chapters

How Google’s Vision for AI Began Long Before the World Cared
00:00
The Quiet Beginnings of Language Models That Changed Everything
14:43
How One Man Rebuilt Maps and Opened Google’s Door to AI Pioneers
27:01
The Tech Talk That Sparked Google Brain and the Deep Learning Revolution
32:47
When a Neural Network Learned to See Cats — and Changed AI Forever
41:47
How a 10% Drop in Image Errors Ignited the Global AI Race
48:29
Why Did Google Buy DeepMind? The Bidding War That Shaped AI’s Future
1:00:09
What Happened After Google Acquired DeepMind — and Why It Mattered
1:21:02
How OpenAI Was Born From Fear, Idealism, and a Dinner With Musk
1:35:15
Inside Google’s Secret Chip That Was Built to Power the AI Age
1:47:24
The Brilliant Idea Google Invented — Then Almost Ignored
2:02:00
How ChatGPT Shocked the World and Forced Google Into Panic Mode
2:26:24
Can Google Reinvent Itself Before AI Eats Its Own Lunch?
2:39:28

Transcript

Ben Gilbert: I went and looked at a studio, well, a little office that was going to turn into a studio nearby, but it was not good at all. It had dropped ceilings, so I could hear the guy in the office next to me. You would be able to hear him talking on e...