ChipsThe story, in brief

Faster Training and Inference: Habana Gaudi®2 vs Nvidia A100 80GB

Intel's Habana Gaudi2 outpaces NVIDIA A100 on training speed. Here's what that means for your compute strategy.

Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
The infrastructure powering AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Direct hardware competition to NVIDIA's GPU dominance is emerging. Gaudi2 benchmarks show viable alternatives for training and inference workloads, signaling a shift in AI infrastructure options for enterprises.

The key facts

11 to know
  1. Habana Gaudi2 vs NVIDIA A100 80GB benchmark comparison

  2. Training and inference performance metrics published

  3. Published December 2022 (archived benchmark data)

  4. Infrastructure/chip capability comparison

  5. Potential cost/efficiency implications for compute procurement

  6. Habana Gaudi2 benchmarked against NVIDIA A100 80GB

  7. Comparison focuses on training and inference speed

  8. Published Dec 14, 2022 (older benchmarking data)

  9. Source: HuggingFace official blog (credible)

  10. No pricing or capex impact data provided

  11. Benchmark-only content lacks deployment context

Go to the source

Hugging Face Bloghuggingface.co

Read original report
Back to today's editionMore chips news

The wider picture

View all
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips01

Why confidential computing is essential for enterprise AI

As enterprises push AI into sensitive domains (healthcare, finance, government), protecting data during processing — not just at rest or in transit — is shifting from a nice-to-have security feature to a prerequisite for deployment. HPE and NVIDIA are positioning confidential computing as foundational infrastructure for sovereign AI.

CIO
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips02

Beyond the limits of air: Why liquid cooling is becoming a strategic imperative for AI

Liquid cooling is shifting from niche to strategic necessity as GPU power density explodes. For practitioners building or deploying AI at scale, this isn't optional—it's a 18–24 month ROI play that unlocks denser racks, lower OpEx, and competitive advantage. The buildout architecture is changing.

CIO
Paper-cut illustration of an amber microchip with circuit paths extending into a row of data-center cabinets.
AI illustration by KeyNews
Chips03

Singapore’s Nexstrom wants to bring 2D semiconductors to chip fabs

2D materials promise better performance-per-watt for next-gen AI accelerators. Nexstrom's equipment funding signals the transition from lab to foundry—a potential shift in the compute buildout.

TechCrunch Startups