scripod.com

Fei-Fei Li on Spatial Intelligence and Robotics

The a16z Show

1 DAYS AGO
The a16z Show

The a16z Show

1 DAYS AGO
In this podcast, Fei-Fei Li and Yunzhu Li discuss the acquisition of SceniX by World Labs, focusing on the challenge of giving machines a true understanding of the physical world. They explore how simulation and real-world data can advance robotics and spatial intelligence.
The conversation centers on the real-to-sim-to-real pipeline, which uses simulation to enable counterfactual reasoning and systematic data generation for robotics. Fei-Fei Li explains that World Labs' base model, Marble, generates 3D worlds from prompts, while SceniX addresses data scarcity through simulation. Yunzhu Li contrasts video-only approaches with 3D simulation, emphasizing the need for consistent world models. The discussion highlights the complementary roles of simulation and real-world data: simulation offers efficiency, safety, and scalability, while real-world data ensures accuracy. The speakers describe a digital infrastructure that is model- and embodiment-agnostic, enabling robust robot performance. They also debate the optimal robot form for general tasks and express measured optimism about the rapid evolution of robotics and AI. The integration of SceniX into World Labs expands their capabilities bi-coastally, offering validated pipelines for training and evaluation in key verticals.
12:39
12:39
Simulation models don't need to be perfect, only capturing essential structures.
33:52
33:52
Measured optimism about robotics and AI evolution
40:28
40:28
Real-to-sim-to-real pipelines create immediate value.