ChipsThe story, in brief

Beyond the limits of air: Why liquid cooling is becoming a strategic imperative for AI

132 kW per rack today. 1 MW tomorrow. Air cooling is dead—and the math of liquid cooling just changed the economics of AI infrastructure.

Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
The infrastructure powering AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Liquid cooling is shifting from niche to strategic necessity as GPU power density explodes. For practitioners building or deploying AI at scale, this isn't optional—it's a 18–24 month ROI play that unlocks denser racks, lower OpEx, and competitive advantage. The buildout architecture is changing.

The key facts

9 to know
  1. Modern GPU racks draw 132 kW; next-gen architectures projected to reach 240 kW per rack, eventually 1 MW per rack

  2. Liquid cooling reduces energy consumption by up to 40%; 1 MW data center saves hundreds of thousands in annual OpEx

  3. Typical liquid cooling payback period: 18–24 months; 3-year TCO advantage: 15–25% over air-cooled systems

  4. Liquid cooling enables 3–4× rack density compression (condense 3–4 air-cooled racks into 1 liquid-cooled rack)

  5. PUE improvement: liquid cooling drives PUE to 1.15 or lower vs. industry average 1.6 for air-cooled facilities

  6. Carbon footprint reduction: HPE demonstrates up to 87% reduction with liquid cooling

  7. HPE introduced first 100% fanless direct liquid cooling system

  8. Air-cooled facilities spend up to 40% of energy budget on cooling alone

  9. NVIDIA Blackwell series and next-generation GPUs driving power density spike

Go to the source

CIOcio.com

Publisher excerpt: In the rapidly evolving information technology landscape, the data center of the future has arrived ahead of schedule. As AI workloads move to become core business drivers, the underlying infrastructure is hitting a thermal wall. For CIOs, the transition from traditional air cooling to liquid…
Read original report
Back to today's editionMore chips news

The wider picture

View all
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips01

Why confidential computing is essential for enterprise AI

As enterprises push AI into sensitive domains (healthcare, finance, government), protecting data during processing — not just at rest or in transit — is shifting from a nice-to-have security feature to a prerequisite for deployment. HPE and NVIDIA are positioning confidential computing as foundational infrastructure for sovereign AI.

CIO
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips02

The supercomputing DNA of the AI factory

The AI factory buildout is shifting from cloud-only to hybrid on-premises deployments. HPE's Cray heritage + NVIDIA acceleration is becoming the architecture standard for organizations seeking sovereign AI, and real customers (research labs, F1, enterprises) are already scaling it.

CIO
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips03

Exclusive: CoreWeave launches Remote Key Encryption to keep customer keys off its cloud

Enterprise security requirements have stalled AI adoption in regulated industries. CoreWeave is addressing the key-custody problem that auditors flag, likely unlocking a new class of compliance-cleared deployments on its infrastructure.

SiliconAngle