Inference Infrastructure
Compute, chips, energy, datacenters, serving infrastructure.
Monthly frequency: 2026-05: 7 · 2026-06: 7 · 2026-07: 3 · 2026-08: 28 · 2026-09: 29 · 2026-10: 27
Deepseek crushed everyone — Matthew Berman2026-10-28
How Anthropic ships the #1 LLM in the World — with Katelyn Lesse and Angela Jiang — Latent Space2026-10-27
Why transistors stopped being flat — Dwarkesh Patel2026-10-23
Amazon’s Trainium Takes a Strike at the Training King — SemiAnalysis2026-10-23
Who is local AI really for? — Matthew Berman2026-10-23
AI’s bottleneck isn’t compute. It’s geometry. — Dwarkesh Patel2026-10-22
Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal — Latent Space2026-10-22
What will computer chips look like in 2045? — Dwarkesh Patel2026-10-22
Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal — Latent Space2026-10-22
Sam Altman on What Personal AI Still Needs — Matthew Berman2026-10-21
Sam Altman on Why AI Needs a New Kind of Hardware — Matthew Berman2026-10-21
The Huawei-DeepSeek Symbiosis — SemiAnalysis2026-10-21
Sam Altman: RSI, AI Consciousness, OpenAI's New Hardware, Compute, and more! — Matthew Berman2026-10-21
Latest open artifacts (#25): DeepSeek V4.1 Flash 1017, American-made models, and new regulatory controls in the US & China — Nathan Lambert2026-10-20
The Programmable Data Center — Evan Conrad, SF Compute — Latent Space2026-10-20
How a US Tariff Helped Push Japan to War - Sarah Paine — Dwarkesh Patel2026-10-19
Datacenters 2027: The Year of Acceleration, +50GW in a Single Year — SemiAnalysis2026-10-19
How DeepSeek Uses Less Memory — Matthew Berman2026-10-18
ASML Is Building a Hybrid Bonding Tool! — SemiAnalysis2026-10-15
Redesigning source control at Anthropic — Simon Willison2026-10-13
Meta just dropped something insane... (Muse Wonder) — Matthew Berman2026-10-13
I expect rapid progress but not towards general superintelligence — Nathan Lambert2026-10-09
Beijing Will Not Pace the Frontier: China’s Speed-First AI Safety Regime — SemiAnalysis2026-10-08
Anthropic Subscriptions Offer 5x+ More Value Than OpenAI — SemiAnalysis2026-10-05
Anthropic's $500 billion data center bet #ai — Nate B. Jones2026-10-03
Which GPU Clouds Are Actually Good? | ClusterMAX 3.0 — Latent Space2026-10-02
Recursive Language Models — Alex Zhang, MIT PhD — Latent Space2026-10-02
Inside OpenAI DevDay: Superhuman Computer Use, Decisions API, and the AI Cloud — Ari & Nikunj — Latent Space2026-09-30
OpenAI COOKED — Matthew Berman2026-09-30
How GLM5.3 Sparse Attention Affects HBM Memory Usage — SemiAnalysis2026-09-28
Intel Panther Lake Teardown — SemiAnalysis2026-09-26
The $10 Trillion Token Economy — Alex Atallah, OpenRouter & Anjney Midha, AMP — Latent Space2026-09-25
The Chinese AI Infrastructure Boom: Introducing the SemiAnalysis China Datacenter Model — SemiAnalysis2026-09-25
Why world models matter #nvidia #ai #physicalai #robots — Nate B. Jones2026-09-25
The Endgame of AI Video Is a World Model — Anastasis Germanidis, Runway Co-founder — Latent Space2026-09-25
Computation and Data Movement for Inference — SemiAnalysis2026-09-21
NVIDIA PAIR Connects Your Computers for Local AI — Matthew Berman2026-09-18
A Worm With 302 Neurons Inspired Their Architecture — Ramin Hasani, Liquid AI — Latent Space2026-09-18
Engrams Embedding Entendre: Codesign for Efficient DRAM/SSD Offloading — SemiAnalysis2026-09-18
Jev Sorts 150,000 Skittles in 5 Seconds — Matthew Berman2026-09-18
Doom in Real Time — Matthew Berman2026-09-16
Everyone Says Datacenter Moratoriums Are Killing the US Buildout. We disagree — SemiAnalysis2026-09-15
Intelligence is Everywhere: Why the AI 'Race' is Already Over — Nate B. Jones2026-09-14
Vera Rubin NVL72 Agentic Inference: 67x better Performance per Dollar — SemiAnalysis2026-09-14
A Brain Too Big to Carry — On-Device vs Datacenter Inference — SemiAnalysis2026-09-14
Long Live the Short King: Why 4-hi HBM Wins — SemiAnalysis2026-09-13
Why China's Compute Is Worth Less Than America's - Dylan Patel — Dwarkesh Patel2026-09-13
DeepSeek Is INSANELY Fast — Matthew Berman2026-09-13
So you want to use OpenRouter? — Simon Willison2026-09-11
Deepseek did it again... — Matthew Berman2026-09-11
Nvidia’s Backstop Universe – Heads I Win, Tails Who Loses? — SemiAnalysis2026-09-11
AI researchers debate how close we are to recursive self-improvement — Dwarkesh Patel2026-09-11
Where Does the Money Actually Go in AI? - Dylan Patel — Dwarkesh Patel2026-09-10
What is So Hard About Behind-The-Meter Power For Datacenters? Part 1 — SemiAnalysis2026-09-10
Where Does a Robot Think – On-Device vs Datacenter Inference — SemiAnalysis2026-09-09
When will average people feel AI’s impact? — Nathan Lambert2026-09-09
Apple's New Mac Line is Built Around Local AI. The Bet Is You'd Rather Own Than Rent. — Nate B. Jones2026-08-31
We're Worried About the Wrong Kind of Centralization - Dylan Patel — Dwarkesh Patel2026-08-30
Most Neoclouds Suck At Security — SemiAnalysis2026-08-30
Prompt caching: this is what most builders ignore #AI #promptcaching #Claude #APIbuilders #tokens — Nate B. Jones2026-08-30
Cancel your subscriptions, Ox-Alpha is here! (GLM 5.3 Flash) — Matthew Berman2026-08-29
Two Labs Are About to Take Half the World's New Compute - Dylan Patel — Dwarkesh Patel2026-08-29
Why Jane Street Makes More From Claude Than Anthropic Does - Dylan Patel — Dwarkesh Patel2026-08-28
AI will have infinite speed, your computer will not — Matthew Berman2026-08-28
This feels illegal... — Matthew Berman2026-08-27
Why Isn’t China Further Behind in AI? - Dylan Patel — Dwarkesh Patel2026-08-27
Qwen3.8-Flash-Next — Simon Willison2026-08-26
AI Doesn't Need to Be Good at Politics to Change Everything - Ryan Greenblatt — Dwarkesh Patel2026-08-26
🔬 The Physical World Is More Forgiving Than You Think — Anima Anandkumar, Caltech — Latent Space2026-08-26
Why AI labs are shelving their best models - Dylan Patel — Dwarkesh Patel2026-08-25
Your Mac can get a job — Matthew Berman2026-08-25
Dylan Patel – Two labs will soon control most of the world's workforce — Dwarkesh Patel2026-08-25
How to Understand the Next Wave of AI Before Everyone Else | Tibo Interview — Matthew Berman2026-08-24
AI doesn't need to be good at everything. Just R&D - Ryan Greenblatt — Dwarkesh Patel2026-08-19
AI Isn't A Bubble. That's How NVIDIA's $500 Billion Push Ends Up In Your Retirement. — Nate B. Jones2026-08-16
AI News: ChatGPT Ultrafast, Grok 4.6, 3 New Open-Source Models, and more! — Matthew Berman2026-08-14
xAI actually did it... (Grok 4.6) — Matthew Berman2026-08-13
They Thought the Model Was Broken — Matt McPartlon & Neil Patil, Chai Discovery — Latent Space2026-08-11
Mark Zuckerberg just called out Dario (and Anthropic) — Matthew Berman2026-08-11
8 Predictions for the Era of Continual Learning — Dwarkesh Patel2026-08-07
What is Google even doing? — Matthew Berman2026-08-07
Open-source is WINNING — Matthew Berman2026-08-04
Why smarter AI models could drive up compute prices 10x — Dwarkesh Patel2026-08-03
Leopold Aschenbrenner's Warning Signal Apple Completely Missed — Nate B. Jones2026-08-03
You NEED to do this (HUGE AI SAVINGS) — Matthew Berman2026-07-23
China's making their own chips now — Matthew Berman2026-07-15
OpenAI Just Offered The Government $42 Billion. This Is The Real Reason. — Nate B. Jones2026-07-06
Apple just raised prices... — Matthew Berman2026-06-27
What does the next training paradigm look like? — Dwarkesh Patel2026-06-26
Google Lost $2.7 Billion In Talent This Week. The Real Reason Isn't Money. — Nate B. Jones2026-06-22
Apple’s Worst Nightmare #apple #google #gemini — Nate B. Jones2026-06-19
Your $20 AI Plan Costs Them Thousands. That's Not The Bubble. — Nate B. Jones2026-06-15
OpenAI Just Filed For Its IPO. The Real Story Isn't The Trillion Dollars. — Nate B. Jones2026-06-14
The better AI gets, the smaller its share of the economy might get – Alex Imas and Phil Trammell — Dwarkesh Patel2026-06-04
Cursor just beat EVERYONE. — Matthew Berman2026-05-26
The Infrastructure Nightmare Nobody Is Talking About — Nate B. Jones2026-05-25
Why the AI boom is about to hit a wall — Nate B. Jones2026-05-24
Chip design from the bottom up – Reiner Pope — Dwarkesh Patel2026-05-22
Composer 2.5 and I INTERVIEWED THE CEO OF ALPHABET — Matthew Berman2026-05-21
Google CEO: Agents, Open Source, Race to AGI, Cybersecurity, Chips, China — Matthew Berman2026-05-20
These 5 Infrastructure Giants Secretly Rule AI — Nate B. Jones2026-05-20