Close Menu
NCIJ Network NCIJ Network
    What's Hot

    EU deal: ‘Move on!’ Former PMs pile in with advice for Andy Burnham, but will he listen?

    November 22, 2026

    Closer EU ties will give UK say on Brussels decisions, says Ed Miliband | Brexit

    November 22, 2026

    Google AI Previews Tool Retrieval in the Gemini API for Large Tool Libraries

    November 22, 2026
    Facebook X (Twitter) Instagram
    Trending
    • EU deal: ‘Move on!’ Former PMs pile in with advice for Andy Burnham, but will he listen?
    • Closer EU ties will give UK say on Brussels decisions, says Ed Miliband | Brexit
    • Google AI Previews Tool Retrieval in the Gemini API for Large Tool Libraries
    • The Defenders of Mexico’s Scorpion Reef
    • Best Personal AI Agents in 2026: OpenClaw, Hermes Agent, Gemini Spark and More, Compared on Memory, Security and Cost
    • A study of 30,000 people reveals which antidepressants may work best
    • A truism for our political leaders: until work again involves respect and decent levels of pay, this crisis will continue | John Harris
    • Labour MPs sign up for leadership course to counter rightwing populism | Labour
    • About
      • Our Team
      • Editorial Policy
      • Editorial Independence
      • International Support
    • Trust & Standards
      • AI Usage Policy
      • Conflict of Interest Policy
      • Corrections Policy
      • Ethics Policy
      • Fact-Checking Policy
      • Source Protection
    • Get Involved
      • Guide for Sources
      • Support Independent Journalism
    • Legal
      • Cookie Policy
      • Privacy Policy
      • Terms of Use
    Facebook X (Twitter) Instagram
    NCIJ Network NCIJ Network
    Sunday, November 22
    • Home
    • World
    • Ai
    • Business
    • Politics
    • Health
    • Crypto
    • Science
    • Technology
    • Cybersecurity
    • Defense & Security
    • Economy
    • Energy
    • Europe
    • More
      • Fact Check
      • Investigations
      • Opinion & Analysis
      • Environment
    NCIJ Network NCIJ Network
    Home»Artificial Intelligence

    Perplexity Introduces Photon: A Rust-Based Retrieval Engine That Cuts p99 Latency From 800 ms to 65 ms

    NCIJ NETWNCIJ NETWORKBy NCIJ NETWNCIJ NETWORKSeptember 30, 2026 Artificial Intelligence No Comments4 Mins Read
    Share
    Facebook Twitter LinkedIn Pinterest Email

    Perplexity has released Photon, an in-house retrieval and ranking engine written in Rust. It replaces an open-source engine Perplexity had forked for its AI-native search stack. Photon now handles retrieval and ranking for all production traffic. It also powers a new Fast Search mode in the Perplexity Search API. Perplexity reports single-call latency of 160 ms at p50 and 230 ms at p95.

    Is it deployable? Yes, as a hosted API. Set search_type: "fast" on POST /search and pay $1 per 1,000 requests. Photon itself is not open source, so the engine cannot be self-hosted.

    Why Perplexity Replaced its Old Engine

    The old engine hit 3 limits as the index grew:

    • Tail latency: Production p99 sat near 800 ms. The dataset exceeded RAM, so mlock was not an option. Cold reads triggered major page faults that stalled queries.
    • Merge spikes: During disk index fusion, p99 climbed to about 1.2 s for 10 to 15 minutes.
    • Slow recovery: Deploying and syncing an extra cluster could take more than a week. Recovery also raised the share of partial responses.

    Perplexity team concluded that building from scratch was simpler and cheaper than maintaining its fork.

    How Photon Works

    A load balancer routes each request to a Photon broker. The broker fans out to a shard group and watches for timeouts. Each shard runs retrieval, initial ranking, and second-stage ranking. The broker then merges candidates and fetches key document fields.

    • Adaptive posting lists: Short lists sit inline within a single page. Longer lists split into blocks of fixed document ID ranges. Sparse blocks store sorted offset arrays and use galloping search. Dense blocks use bitmaps, so membership becomes a single bit lookup.
    • Budgeted traversal: A WAND-like algorithm splits lists into driving lists and probe lists. Cheap presence checks bound each candidate’s maximum score first. Exact term frequencies are read only when a candidate can clear the threshold.
    • Docblob records: Each document gets a compact record of frequencies, field masks, and positions. Terms use Elias-Fano encoding, so ranking decodes only the matched terms. Ranking a candidate needs just 1 lookup per document.
    • Batched async reads: Record offsets are known upfront, so disk reads go out in batches through io_uring. The cache checks the whole batch first. Readers take no locks, and eviction uses CLOCK instead of a shared LRU list.
    • Separate build and serve: Indexers build versioned shard indexes from YTsaurus tables on dedicated nodes. A controller rotates serving groups one at a time and warms caches with replayed search-log queries.

    A full web index now builds in a single-digit number of hours.

    Interactive Explainer: Inside Photon

    ‘;
    resize();return;
    }
    var nb=Math.min(12,Math.max(3,Math.round(Math.log10(n)*2)));
    var g=document.createElement(‘div’);g.className=”plist”;
    for(var b=0;b=.5;
    var el=document.createElement(‘div’);el.className=”blk “+(dense?’dense’:’sparse’);el.style.animationDelay=(b*45)+’ms’;
    var h=”

    Block “+(b+1)+’: ‘+(dense?’bitmap’:’offset array’)+’

    ‘;
    if(dense){h+=’

    ‘;for(var k=0;k<32;k++)h+=’‘;h+=’

    ‘;}
    else{var c=Math.max(2,Math.round(bd*12)),o=0,arr=[];for(var k3=0;k3[‘+arr.join(‘,’)+’]

    cuts engine Introduces Latency p99 Perplexity Photon Retrieval RustBased
    NCIJ NETWNCIJ NETWORK
    • Website

    Keep Reading

    Google AI Previews Tool Retrieval in the Gemini API for Large Tool Libraries

    Best Personal AI Agents in 2026: OpenClaw, Hermes Agent, Gemini Spark and More, Compared on Memory, Security and Cost

    NASA’s powerful Moon rocket engine roars through a dramatic 200-second test

    A Team of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

    OpenAI Ships GPT-Live-1.1 for Voice Agents, Cuts Idle Cost to $0.02/Min

    Meet Thinking Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

    Add A Comment
    Leave A Reply Cancel Reply

    Editors Picks

    EU deal: ‘Move on!’ Former PMs pile in with advice for Andy Burnham, but will he listen?

    November 22, 2026

    Closer EU ties will give UK say on Brussels decisions, says Ed Miliband | Brexit

    November 22, 2026

    Google AI Previews Tool Retrieval in the Gemini API for Large Tool Libraries

    November 22, 2026

    The Defenders of Mexico’s Scorpion Reef

    November 22, 2026
    Latest Posts

    Unpacking claim USS Doris Miller will be renamed after Trump instead of Black WWII hero

    August 21, 2026

    Iran Vows ‘Devastating’ Retaliation Against New U.S. Sanctions Threats

    August 21, 2026

    Bomb Fishing Is Reducing Coral Reefs to ‘Rubble’

    August 21, 2026

    Subscribe to News

    Get the latest sports news from NewsSite about world, sports and politics.

    NCIJ Network is an independent digital news platform delivering trusted investigative journalism, European and global news, in-depth analysis, and fact-based reporting with accuracy, transparency, and integrity.

    Facebook X (Twitter) Instagram Pinterest YouTube

    EU deal: ‘Move on!’ Former PMs pile in with advice for Andy Burnham, but will he listen?

    November 22, 2026

    Closer EU ties will give UK say on Brussels decisions, says Ed Miliband | Brexit

    November 22, 2026

    Google AI Previews Tool Retrieval in the Gemini API for Large Tool Libraries

    November 22, 2026

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    Type above and press Enter to search. Press Esc to cancel.