ChipsSeptember 9, 2026via InfoQ AI/ML
Presentation: Fixing the AI Infra Scale Problem by Stuffing 1M Sandboxes in a Single Server
Why it matters
As AI workloads fragment into smaller, stateful tasks (agents, function calling, prompt caching), density and cold-boot latency become hard constraints on cloud-compute economics. Unikraft's sandbox architecture — millisecond boots, hardware isolation, Kubernetes-native — addresses a real infrastructure bottleneck practitioners face when scaling agentic workloads.
Key signals
- 1M sandboxes per single server (extreme density claim)
- Sub-10ms cold boot latency maintained at scale
- Stateful scale-to-zero capability
- Hardware-level security isolation primitives
- Linux kernel optimizations for microVM performance
- Snapshotting for state persistence
- Kubernetes integration
- Presented by Felipe Huici (Unikraft lead)
- Sub-10ms cold-boot latency maintained at scale
- 1M sandboxes achievable per single server
- Unikraft microVM architecture with isolation primitives
- Linux kernel optimizations and snapshotting techniques
- Kubernetes integration with hardware-level security
- Target: extreme density for sandboxing AI workloads
The hook
1M sandboxes per server. Unikraft's microVM approach solves the AI infra density problem that's been quietly strangling cloud economics.
Felipe Huici explains how Unikraft achieves millisecond cold boots, stateful scale-to-zero, and extreme density for sandboxing AI workloads. He discusses isolation primitives, Linux kernel optimizations, and snapshotting tricks, demonstrating how to maintain sub-10ms performance at scale while integ…