scripod.com

Ep 92: xAI Co-Founder Unpacks the Future of Model Development

In this episode, Igor Babuschkin, co-founder of River AI and former xAI co-founder, shares his journey through DeepMind, OpenAI, and xAI, offering a candid look at the AI landscape. He discusses his motivations for leaving xAI, the vision behind River AI, and his perspectives on the future of AI agents, enterprise adoption, and the competitive dynamics shaping the industry.
Igor Babuschkin explains his departure from xAI to found River AI, driven by a desire to distribute AI's benefits and address power concentration. River AI focuses on three bets: a reinforcement learning API, personalized AI agents, and local hardware for running frontier models. He argues that personal AI, which learns from individual user signals, will be the next major application, moving beyond coding and math into everyday life. On the enterprise side, he predicts a shift toward companies training their own models as open-source improves, leveraging proprietary data for competitive advantage. He also discusses the challenges facing proprietary labs, including GPU and data constraints, and expresses skepticism about RL generalizing across domains. Igor highlights the dominance of Chinese open-weight models, calling for a top US open model, and reflects on his time at xAI, including the rapid construction of the Colossus data center and the strategic acquisition of Cursor. He identifies the lack of training methods for long-horizon, non-verifiable tasks as a key bottleneck, and emphasizes the need for alignment research to keep humans relevant as AI advances.
00:00
00:00
Personal AI on local hardware is the next frontier.
03:54
03:54
AI will transform all computing and daily life.
07:49
07:49
AI bifurcates into super AIs and everyday personal AIs.
10:29
10:29
Distribute AI's benefits and control to address power concentration.
15:28
15:28
Local hardware offers control, lower latency, and privacy.
20:42
20:42
Agents will adapt like recommendation systems.
24:43
24:43
Companies will train their own models to protect their competitive advantage.
31:00
31:00
Companies with proprietary data can build their own models.
41:31
41:31
Pre-trained models should be open-source, as they are built on humanity's collective knowledge.
44:19
44:19
Musk's focus and first-principles thinking drove rapid progress.
50:18
50:18
Cursor acquisition gives xAI real-world data and RL environments.
52:16
52:16
Models are capable enough to judge outcomes.
59:59
59:59
Open-source models near the danger threshold enable broader participation in developing control tools.
1:01:29
1:01:29
Inequality is the most immediate AI risk.