scripod.com

#252 - GPT 5.6, Grok 4.5, Nemotron-Labs-Diffusion, AI 2040

Last Week in AI

Shownote

Our 252th episode with a summary and discussion of last week's big AI news! Recorded on 07/11/2026 Hosted by Andrey Kurenkov [https://twitter.com/andrey_kurenkov] and Jeremie Harris [https://www.linkedin.com/in/jeremieharris/] Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai [hello@gladstone.ai] Read out our text newsletter and comment on the podcast at https://lastweekin.ai/ [https://lastweekin.ai/] In this episode: * OpenAI publicly rolled out GPT-5.6 (including Sol and Luna) and rebranded its desktop agentic coding product as ChatGPT Work, amid disputed claims about whether the US government effectively green-lit and delayed the release and concerns about inconsistent, ad hoc frontier-model oversight and jailbreakability. * New model releases intensified pricing and capability competition: SpaceX AI’s Grok 4.5 launched as a very low-cost, Opus-class coding model with minimal safety documentation, while Meta released Muse Spark 1.1 with aggressive pricing, large coding/cyber benchmark gains, and a lengthy safety evaluation. * Meta also previewed Muse Video and rolled out Muse Image before quickly backtracking after backlash over easy generation of images of public Instagram accounts; separately, Chinese open-source models grew to over 30% of weekly OpenRouter tokens as cost pressure increased, alongside discussion of risks like potential insider threats. * Infrastructure, policy, and safety developments included Meta exploring selling AI compute as a cloud business, US energy regulators pressing grid operators on large-load data-center connections, Anthropic publishing a “global workspace” interpretability method for verbalizable internal representations, reports that China may restrict overseas access to top models, and AI 2040 proposing US–China coordination to slow progress until alignment improves. Timestamps (note - these don't take into account dynamically inserted ads and therefore may be off by a couple of minutes): * (00:00:10) Intro / Banter * (00:01:33) News Preview * Tools & Apps * (00:02:03) OpenAI rolls out GPT-5.6 after government greenlight — and announces ‘ChatGPT Work’ | The Verge [https://www.theverge.com/ai-artificial-intelligence/963464/openai-gpt-5-6-codex-chatgpt-work] + The new ChatGPT superapp takes aim at Claude Desktop [https://www.pcworld.com/article/3188176/the-new-chatgpt-superapp-takes-aim-at-claude-desktop.html] + OpenAI is shutting down its Atlas web browser [https://mashable.com/tech/openai-shut-down-atlas-browser] + OpenAI’s latest AI model likely has similar cyber vulnerabilities to one that led to U.S. export controls on Anthropic’s Fable, British agency says [https://fortune.com/2026/07/10/openai-gpt-5-6-sol-jailbreaks-cyber-attacks-similar-to-security-flaw-that-led-u-s-government-to-force-anthropic-to-disable-fable-5/] * (00:15:41) SpaceXAI, Cursor Launch Grok 4.5 AI Model for Finance, Legal Applications - Bloomberg [https://www.bloomberg.com/news/articles/2026-07-08/spacexai-cursor-unveil-grok-ai-model-for-legal-finance-tasks] + SpaceXAI’s Grok 4.5 Undercuts Anthropic and OpenAI on Coding Agent Pricing [https://devops.com/spacexais-grok-4-5-undercuts-anthropic-and-openai-on-coding-agent-pricing/] * (00:20:29) Meta says its new AI model is ready to compete on coding | The Verge [https://www.theverge.com/ai-artificial-intelligence/963193/meta-muse-spark-model-api] * (00:27:21) Introducing Muse Image and Muse Video [https://ai.meta.com/blog/introducing-muse-image-muse-video-msl/] + https://www.nytimes.com/2026/07/10/technology/meta-muse-images-instagram-removal.html [https://www.nytimes.com/2026/07/10/technology/meta-muse-images-instagram-removal.html] * (00:29:01) Chinese AI models gain ground with U.S. companies as costs surge [https://www.cnbc.com/2026/07/07/chinese-ai-models-costs-us-openai-anthropic.html] +Anthropic and OpenAI Face a New Threat from China [https://www.bloomberg.com/opinion/articles/2026-07-08/anthropic-and-openai-face-a-new-threat-from-cheap-chinese-ai] * Applications & Business * (00:35:21) Meta Is Planning a Cloud Business to Sell AI Computing Power - Bloomberg [https://www.bloomberg.com/news/articles/2026-07-01/meta-is-building-a-cloud-business-to-sell-excess-ai-compute] * (00:46:32) US energy regulator sets ultimatum for data centres [https://www.ft.com/content/5055a170-69d9-4eb6-ad93-be953bbad263?syn-25a6b1a6=1&shem=isphe,] + Grid operator PJM orders emergency steps to avoid large-scale US power outages [https://www.reuters.com/business/energy/grid-operator-pjm-orders-emergency-steps-avoid-large-scale-us-power-outages-2026-07-02/?shem=isphe,] * Projects & Open Source * (00:51:40) Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding [https://arxiv.org/abs/2607.05722] * (00:57:44) Tencent Releases Hy3: An Open 295B Mixture-of-Experts (MoE) Model with 21B Active Parameters and 256K Context - MarkTechPost [https://www.marktechpost.com/2026/07/06/tencent-releases-hy3-open-295b-moe-model/] * Policy & Safety * (00:58:30) Verbalizable Representations Form a Global Workspace in Language Models [https://transformer-circuits.pub/2026/workspace/index.html] * (01:09:29) Beijing is looking at curbing overseas access to China's top AI models, sources say [https://www.reuters.com/world/beijing-is-looking-curbing-overseas-access-chinas-top-ai-models-sources-say-2026-07-07/] * (01:12:53) The ex-OpenAI employee behind ‘AI 2027’ recommends a rosier path - The Washington Post [https://www.washingtonpost.com/technology/2026/07/09/ex-openai-employee-behind-ai-2027-has-new-peppier-prediction/] + AI 2040: Plan A [https://ai-2040.com/] See Privacy Policy at https://art19.com/privacy [https://art19.com/privacy] and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info [https://art19.com/privacy#do-not-sell-my-info].

Highlights

This episode covers a busy week in AI, featuring the rollout of GPT-5.6, new competitive models from SpaceXAI and Meta, and significant policy and safety discussions. The hosts analyze the implications of these developments, including pricing wars, regulatory inconsistencies, and emerging risks from Chinese open-source models.
00:10
Jeremie will cover more details on recent AI news
01:34
The episode covers GPT-5.6, Grok 4.5, Muse Spark 1.1
08:12
Undisclosed internal deployments pose the same risks as external ones.
18:48
Token prices are dropping significantly
23:12
Meta's Cybench score jumped from 65% to 93%.
27:22
One model is cheaper than Grok 4.5
34:41
Safety institutes are crucial for detecting sleeper agents.
43:58
Intense competition in cloud computing for AI workloads
46:35
Increased compute supply could drive down token costs
54:12
6x faster per forward pass than comparable models
58:00
Pre-training sets priors before dual-track activation.
1:07:35
Model forced thinking about suppressed concepts
1:09:30
Middle layers form a shared reasoning space
1:12:58
China may end open-source AI releases.

Chapters

Intro / Banter
00:00
News Preview
01:33
Tools & Apps
OpenAI rolls out GPT-5.6 after government greenlight — and announces ‘ChatGPT Work’ | The Verge + The new ChatGPT superapp takes aim at Claude Desktop + OpenAI is shutting down its Atlas web browser + OpenAI’s latest AI model likely has similar cyber vulnerabilities to one that led to U.S. export controls on Anthropic’s Fable, British agency says
02:03
SpaceXAI, Cursor Launch Grok 4.5 AI Model for Finance, Legal Applications - Bloomberg + SpaceXAI’s Grok 4.5 Undercuts Anthropic and OpenAI on Coding Agent Pricing
15:41
Meta says its new AI model is ready to compete on coding | The Verge
20:29
Introducing Muse Image and Muse Video + https://www.nytimes.com/2026/07/10/technology/meta-muse-images-instagram-removal.html
27:21
Chinese AI models gain ground with U.S. companies as costs surge + Anthropic and OpenAI Face a New Threat from China
29:01
Applications & Business
Meta Is Planning a Cloud Business to Sell AI Computing Power - Bloomberg
35:21
US energy regulator sets ultimatum for data centres + Grid operator PJM orders emergency steps to avoid large-scale US power outages
46:32
Projects & Open Source
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
51:40
Tencent Releases Hy3: An Open 295B Mixture-of-Experts (MoE) Model with 21B Active Parameters and 256K Context - MarkTechPost
57:44
Policy & Safety
Verbalizable Representations Form a Global Workspace in Language Models
58:30
Beijing is looking at curbing overseas access to China's top AI models, sources say
1:09:29
The ex-OpenAI employee behind ‘AI 2027’ recommends a rosier path - The Washington Post + AI 2040: Plan A
1:12:53

Transcript

Andrey Kurenkov: Hello, and welcome to the Last Week in AI podcast, where you can hear and chat about what's going on with AI. As usual, in this episode, we will summarize and discuss some of last week's most interesting AI news. I'm one of your regular co...