scripod.com

Every Muse User Gets 2 CPUs and 8GB in Meta's Cloud. Your Phone Already Has That

Semi Doped

2 DAYS AGO
Semi Doped

Semi Doped

2 DAYS AGO
Semi Doped examines why service providers, rather than chipmakers or model labs, may drive AI inference onto phones and other edge devices. The hosts connect Meta’s economics, Qualcomm’s hardware and software strategy, and the rise of personal agents that route work between local devices and the cloud.
The episode argues that the next push for edge AI will be economically driven. Model labs benefit from cloud inference, while service providers such as Meta could reduce the cost of always-available agents by using the compute, memory, sensors, and personal context already present on users’ devices. The hosts contrast this strategy with the failed hardware-first AI PC campaign, explore how natural-language agents could replace fixed apps and interfaces, and present the edge device as a context-aware layer that decides where work should run. Qualcomm’s acquisition of Modular is discussed as a possible software foundation for deploying agents across diverse hardware. The episode closes by arguing that Google has the assets to lead but is being outpaced by Meta’s consumer product execution.
00:05
00:05
App companies decide where inference runs
05:21
05:21
Agents running anywhere
07:37
07:37
The AI PC push became a race to nowhere
10:24
10:24
The phone is already an AI portal
16:58
16:58
Service providers have the incentive to move AI to the edge
20:38
20:38
Local context should not always go to the cloud
32:22
32:22
AI should provide the format you want
34:23
34:23
The edge becomes a context translation layer
36:36
36:36
Fast-thinking models belong at the edge
42:28
42:28
Mojo could help AI run anywhere
44:48
44:48
The user—not the device or cloud—is at the center of the AI ecosystem
48:59
48:59
Meta is in the lead.