What Landed
Nate B. Jones published two related pieces. The first argues the AI capacity constraint is HBM and chip packaging, not GPU count: the top four AI chip designers consumed 90% of global packaging and HBM supply in 2025 while using only 12% of advanced logic die capacity, which is why Microsoft's $190B capex still leaves it supply constrained. The second argues AI vendor memory systems are deliberately engineered switching-cost weapons: accumulated user context is not portable across models, and that context is also unreadable by external agents, forcing enterprises to use a vendor's own agent layer to extract value from data they generated.
Why It Matters
Both pieces reframe AI vendor relationships as infrastructure dependencies rather than software subscriptions. For an enterprise buyer, "elastic compute" is no longer a safe assumption: capacity terms (reserved vs. best-efforts, fallback provisions, per-workflow token forecasting) now belong in procurement and architecture review, not just legal. Separately, any deployment that lets a vendor own the memory/context layer is accumulating exit cost that compounds monthly, independent of model quality, which directly threatens multi-vendor or best-of-breed strategies. Neither claim is new in substance, but the packaging/HBM data point (90% concentration) is a concrete number worth citing, and the memory lock-in argument gives a name to a risk BlueAlly should already be flagging in agent architecture discussions.
Worth Raising With Customers
- Ask vendors directly whether AI contracts specify reserved vs. best-efforts capacity and what the written fallback is if primary supply is constrained for weeks — most customers have never asked this.
- For any agent workflow, forecast token consumption per workflow type, not per seat; autonomous/looping agents consume capacity nothing like a chatbot.
- Before deepening investment in a vendor's memory/context features, evaluate context portability (self-hosted RAG, MCP, open protocols) now, while switching cost is still low.