scripod.com
Gimlet's Cross-Vendor Inference Cloud

Highlights

Transcript

Chapters

Pins

Gimlet's Cross-Vendor Inference Cloud

Semi Doped
OverviewShownote
Unprocessed episode, you can be the first!

Shownote

Gimlet Labs runs an inference cloud built on heterogeneous silicon. Their software traces a PyTorch workload, segments it into its component parts, and schedules each piece onto the best-suited hardware — connecting chips from different vendors on a single...

Highlights

Chapters

Transcript