scripod.com
Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World | Ilya Sutskever

Overview

Shownote

Highlights

Transcript

Chapters

Pins

Chat GPT's Creator Explains The Shocking Truth About How AI Understands the World | Ilya Sutskever

Eye On A.I.

1 DAYS AGO
Eye On A.I.

Eye On A.I.

1 DAYS AGO
OverviewShownoteHighlightsTranscriptChaptersPins

Shownote

Craig Smith sits down with Ilya Sutskever - Co-Founder and Chief Scientist at Safe Superintelligence Inc. & former chief scientist at OpenAI and one of the primary minds behind GPT-3, GPT-4, and the deep learning revolution that preceded it - for a convers...

Highlights

Ilya Sutskever traces the ideas behind modern AI, from neural networks and ImageNet to transformers and GPT, then explains why prediction can produce world understanding, how reinforcement learning may reduce hallucinations, and how AI could reshape democracy.
08:40
Transformers changed the trajectory
14:48
Prediction requires understanding the world.
23:39
Multimodality is useful, not mandatory
28:44
Language models encode the processes behind language
31:27
Hallucinations can be treated as unacceptable behavior
34:34
Learning more from less data could unlock many possibilities
38:48
AI could enable high-bandwidth democracy

Chapters

From early curiosity to the foundations of GPT
00:00
Why prediction can produce understanding
11:23
Multimodality, representations, and reducing hallucinations
20:57
Efficiency, infrastructure, and a higher-bandwidth democracy
32:25

Transcript

Craig S. Smith: This conversation with Ilya was recorded while he was still chief scientist at OpenAI, before the boardroom drama that briefly ousted Sam Altman and ultimately led to Ilya's departure in 2024. Since then, he's launched Safe Superintelligenc...