ToolsThe story, in brief

Perplexity Introduces Photon: A Rust-Based Retrieval Engine That Cuts p99 Latency From 800 ms to 65 ms

800ms to 65ms. Perplexity's new Rust engine cuts p99 latency by 92%—and ships in production today.

Paper-cut illustration of a coral software window opening into a three-dimensional drafting space.
New tools for building and creating with AI.AI illustration by KeyNews
The KeyNews take

Why it matters

Perplexity replaced its forked open-source retrieval stack with Photon, a custom Rust-based engine now handling all production search traffic. The latency gains (p99: 800ms → 65ms; single-call: 160ms reported) are material for API consumers and warrant adoption review by teams building on search-grounded AI products.

The key facts

11 to know
  1. p99 latency reduced from 800ms to 65ms

  2. Engine written in Rust; replaces forked open-source engine

  3. Powers new Fast Search mode in Perplexity Search API

  4. Single-call latency reported at 160ms

  5. Handles all production traffic for Perplexity Search

  6. Date: September 30, 2026

  7. Single-call latency: 160ms (partial number in excerpt)

  8. Engine written in Rust, replaces previously forked open-source engine

  9. Handles all production traffic retrieval and ranking

  10. New Fast Search mode available in Perplexity Search API

  11. In-house proprietary engine (not third-party)

Go to the source

MarkTechPostmarktechpost.com

Publisher excerpt: Perplexity has released Photon, an in-house retrieval and ranking engine written in Rust. It replaces an open-source engine Perplexity had forked for its AI-native search stack. Photon now handles retrieval and ranking for all production traffic. It also powers a new Fast Search mode in the…
Read original report
Back to today's editionMore tools news

Keep reading

Related stories

More from Tools