Mira Murati's 975B Open Model, Ramin Hasani on Post-Transformer AI, and Demis' AI FINRA | EP #271
Moonshots with Peter Diamandis
2 DAYS AGO
Mira Murati's 975B Open Model, Ramin Hasani on Post-Transformer AI, and Demis' AI FINRA | EP #271
Mira Murati's 975B Open Model, Ramin Hasani on Post-Transformer AI, and Demis' AI FINRA | EP #271

Moonshots with Peter Diamandis
2 DAYS AGO
In this episode, the panel dives into the latest frontier of AI, from a massive new open-weight model to a radical departure from transformer architecture. They debate the practicality of government regulation, the potential for AI to improve itself, and how biological inspiration is creating more efficient systems. The conversation also touches on the future of patents, AI's superior performance in medicine, and a surprising breakthrough in reversing a key marker of aging.
The discussion begins with a critical look at proposed AI regulations, including a FINRA-like body for testing frontier models and a White House policy to limit US releases to the level of China's best open model, which the panel finds impractical. The focus then shifts to Mira Murati's 975-billion-parameter open model, Inkling, and the strategic value of reinforcement fine-tuning for customizing AI in sensitive industries. Ramin Hasani challenges the feasibility of recursive self-improvement in current fixed-weight models, predicting a future where models surpass human understanding. The conversation explores Liquid AI's worm-inspired neural networks, which pack more information into smaller units and are already deployed in Mercedes-Benz cars. Finally, the panel discusses Palmer Luckey's critique of the patent system, AI outperforming doctors on medical benchmarks, and a breakthrough in reversing glycation damage, a previously permanent aging process.
11:05
11:05
Regulatory capture could stifle open-weight models and innovation.
25:53
25:53
Open-weight models prioritize customization over leaderboard dominance.
50:07
50:07
Fine-tuning a 2 billion parameter model would take 350 years
1:15:25
1:15:25
A worm with 302 neurons inspired our liquid neural networks.
1:52:56
1:52:56
A previously permanent aging category becomes reversible.
