Thursday, March 26, 2026

Start of archive·May 16

Top story

Simon Willison

My minute-by-minute response to the LiteLLM malware attack

This malware attack on LiteLLM exposes critical vulnerabilities in AI infrastructure supply chains that could compromise enterprise AI deployments across thousands of companies relying on popular middleware tools.

LiteLLM is a widely-used AI middleware tool

The briefs

This demonstrates AI's potential to dramatically accelerate enterprise software rewrites and maintenance, turning multi-month projects into single-day sprints with massive cost savings.

$500K/year cost savings

Defense AI is attracting massive capital as autonomous weapons systems move from concept to procurement. Shield AI's 140% valuation jump in one year signals investor conviction that AI-powered military applications are the next big defense spending wave.

Shield AI valuation: $12.7B (up 140% YoY)

The AI infrastructure boom is creating a massive market opportunity for industrial suppliers. Power and thermal equipment constraints mean new entrants can disrupt a legacy-dominated market, directly impacting who wins in the AI economy's hardware layer.

$7 trillion in data center capital deployment

Vertical models optimized for specific domains are replacing general-purpose LLMs as the competitive moat. Intercom's move signals that AI product leaders are betting on specialization, not scale, to win with enterprises.

Intercom launches Fin Apex—new vertical model for customer service agents

Major government adoption of enterprise AI agents signals mainstream deployment beyond tech/finance sectors. DOL's move to Agentforce demonstrates real-world scaling of agentic AI for high-volume, mission-critical citizen services.

U.S. Department of Labor integrating Salesforce Agentforce

Google's latest voice model iteration addresses two critical pain points in conversational AI: latency and naturalness. This is a direct capability upgrade in a competitive space where voice interaction quality increasingly defines product differentiation.

Gemini 3.1 Flash Live released

GitHub's reliability issues are forcing AI companies to reconsider their development infrastructure choices at a critical moment when AI-native development is exploding. This could reshape the entire developer tooling landscape.

GitHub availability issues persisting for months

Apple Research identifies a critical theoretical flaw in State Space Models' long-context capabilities—the main reason they're pitched as Transformer alternatives—but demonstrates tool-use can restore the advantage. This matters for any company betting on SSM-based inference.

State Space Models have fixed-size memory and linear computational complexity vs Transformers

Amazon Polly's new bidirectional streaming API removes a critical bottleneck in conversational AI—users no longer wait for full text generation before audio synthesis begins. This is a direct infrastructure play for companies building voice-enabled LLM products.

Amazon Polly launches Bidirectional Streaming API for real-time TTS