WorkThe story, in brief
The Inference Shift
Speed doesn't matter anymore. Here's why the entire AI infrastructure stack is about to pivot.
The KeyNews take
Why it matters
A contrarian take on how agentic AI fundamentally changes inference optimization priorities—shifting focus from latency to throughput and cost. This reframes infrastructure investment decisions for builders and investors betting on agent-first architectures.
The key facts
4 to knowAgentic inference requires different optimization than current inference
Latency becomes irrelevant when humans are out of the loop
Infrastructure compute priorities will shift from speed to efficiency/throughput
Implies major capex/hardware strategy implications for cloud providers and chip makers
Go to the source
Stratechery (Ben Thompson)stratechery.com
Publisher excerpt: Agentic inference is going to be different than the inference we use today, and it will change compute infrastructure because speed won't matter when humans aren't involved.