1,000 tokens per second: the case against predicting one word at a time (Kumar, VP of Engineering at Inception)
The Infra Pod
Aug 24
1,000 tokens per second: the case against predicting one word at a time (Kumar, VP of Engineering at Inception)
1,000 tokens per second: the case against predicting one word at a time (Kumar, VP of Engineering at Inception)

The Infra Pod
Aug 24
Unprocessed episode, you can be the first!
Shownote
Shownote
What if the entire LLM industry has been solving language generation the slow way — one token at a time? In this episode of The Infra Pod, hosts Tim Chen (GP at Essence VC) and Ian Livingstone (CEO of Keycard) sit down with Kumar, VP of Engineering at ...
Highlights
Highlights
Chapters
Chapters
Transcript
Transcript