scripod.com

Why Cerebras CEO Andrew Feldman Built The World's Largest Computer Chip

Odd Lots

May 21
Odd Lots

Odd Lots

May 21
In this episode, the hosts delve into the world of AI hardware with the CEO of a company that just went public, known for its unconventional, dinner-plate-sized chips. The conversation explores how this unique design challenges the status quo of AI processing, from blazing-fast inference to navigating supply chain constraints.
The discussion centers on Cerebras and its wafer-scale chip, which is 58 times larger than a typical chip and offers up to 1,000 times faster AI inference than GPUs by using a different memory architecture. CEO Andrew Feldman explains that the chip was built from scratch for inference, avoiding key industry bottlenecks like HBM memory and TSMC's 3nm process. He argues that open-source AI models are significantly cheaper per unit of intelligence than closed-source ones, though slightly less capable. Feldman also notes that Nvidia's CUDA software moat is shrinking, as leading models no longer rely on it for inference. The conversation covers the company's relationship with major customer G42, the strategic importance of semiconductors, and the challenges of building US fabs. Finally, Feldman reflects on the company's IPO, creating over 800 millionaires, and the balance between long-term innovation and quarterly pressures.
00:00
00:00
AI questions are consuming our thoughts.
05:33
05:33
58 times larger than typical chips
14:54
14:54
Cerebras chips are 15 times faster than competitors.
27:46
27:46
Nvidia's CUDA moat is shrinking
41:29
41:29
China is an industrial enemy.
48:19
48:19
Creating over 800 millionaires is a source of immense pride.