Inference is becoming more important than pre-training in AI chips, including how pre-fill and decode work and why more compute is shifting toward serving models.  Today we walk through Etched’s ASIC system for transformer inference, its claims around eff...