scripod.com

Nvidia Part III: The Dawn of the AI Era (2022-2023)

Acquired

2023/09/06
Acquired

Acquired

2023/09/06
The rise of artificial intelligence has reshaped the tech landscape, and at the heart of this transformation stands a company that quietly built the engine powering the revolution. What began as a niche advantage in graphics processing has evolved into a foundational platform for the next era of computing.
NVIDIA's journey into the AI era was catalyzed by the 2012 AlexNet breakthrough, which demonstrated the power of GPUs in deep learning. As Google and Facebook integrated AI, OpenAI emerged to counterbalance centralized control. The 2017 Transformer architecture unlocked generative AI, with NVIDIA strategically positioning itself through CUDA, full-stack systems, and key acquisitions like Mellanox. Its Hopper and Grace technologies address data bottlenecks, enabling trillion-parameter models via solutions like DGX SuperPods. Record earnings, soaring developer adoption, and 70% gross margins reflect its shift from hardware vendor to platform leader. Despite competition and export restrictions, NVIDIA’s ecosystem moat—built on software lock-in, TSMC access, and vertical integration—makes displacement unlikely in the near term. While questions remain about AI's long-term utility and potential overhype, NVIDIA’s role in redefining data centers ensures it remains central to the future of computing.
09:19
09:19
AlexNet's success in 2012 marked the Big Bang moment for modern AI
29:00
29:00
Ilya counters Jensen's view by equating accurate prediction with understanding through a detective-novel analogy.
1:08:25
1:08:25
NVIDIA monopolizes TSMC's CoWoS capacity, creating a multi-year supply bottleneck for AI chips.
1:11:22
1:11:22
The DGX GH200 SuperPod can train a trillion-parameter GPT-4 class model.
1:45:03
1:45:03
NVIDIA's gross margin has climbed from 24% pre-CUDA to 70% last quarter and is forecasted to reach 72% next quarter.
1:53:55
1:53:55
Jensen Huang starts his day at 5 am, seven days a week, and views work as relaxing.
2:05:15
2:05:15
Switching from NVIDIA, especially for model training on LLMs, is difficult.
2:17:05
2:17:05
Jensen compares the current AI moment to the iPhone moment.
2:28:17
2:28:17
A crisis of confidence in AI utility could slow corporate spending in the next 12-18 months
2:39:44
2:39:44
Most current workloads are not accelerated, but could be with better tools.
2:42:36
2:42:36
NVIDIA is more like Microsoft than Intel, controlling both the software stack and hardware ecosystem.
2:53:36
2:53:36
Moana represents a return to form for Disney animation after the Pixar acquisition.