Close Menu
NCIJ Network NCIJ Network
    What's Hot

    NASA’s powerful Moon rocket engine roars through a dramatic 200-second test

    November 22, 2026

    Ronald Reagan Changed His Chief of Staff After a Midterm Trouncing, Too

    November 22, 2026

    This scientist proves which problems computers can’t solve quickly

    November 22, 2026
    Facebook X (Twitter) Instagram
    Trending
    • NASA’s powerful Moon rocket engine roars through a dramatic 200-second test
    • Ronald Reagan Changed His Chief of Staff After a Midterm Trouncing, Too
    • This scientist proves which problems computers can’t solve quickly
    • Fossil fuel dispute threatens to derail COP31 climate deal
    • Scientists say the human family tree may need a radical rewrite
    • A Team of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels
    • What helps land recover after fire? This ecologist looks to the past
    • How do scientists learn from failure? This researcher has clues
    • About
      • Our Team
      • Editorial Policy
      • Editorial Independence
      • International Support
    • Trust & Standards
      • AI Usage Policy
      • Conflict of Interest Policy
      • Corrections Policy
      • Ethics Policy
      • Fact-Checking Policy
      • Source Protection
    • Get Involved
      • Guide for Sources
      • Support Independent Journalism
    • Legal
      • Cookie Policy
      • Privacy Policy
      • Terms of Use
    Facebook X (Twitter) Instagram
    NCIJ Network NCIJ Network
    Sunday, November 22
    • Home
    • World
    • Ai
    • Business
    • Politics
    • Health
    • Crypto
    • Science
    • Technology
    • Cybersecurity
    • Defense & Security
    • Economy
    • Energy
    • Europe
    • More
      • Fact Check
      • Investigations
      • Opinion & Analysis
      • Environment
    NCIJ Network NCIJ Network
    Home»Artificial Intelligence

    A Team of Researchers from Columbia and CertiK Introduce TensorLean for Formal Verification of GPU Kernels

    NCIJ NETWNCIJ NETWORKBy NCIJ NETWNCIJ NETWORKNovember 22, 2026 Artificial Intelligence No Comments3 Mins Read
    Share
    Facebook Twitter LinkedIn Pinterest Email

    Researchers from Columbia University and CertiK have introduced TensorLean, a framework for formal verification of GPU kernels at the PTX level. TensorLean is a Lean-based verifier that proves compiled kernels match a tensor-level math spec. The research team checked 149 kernel instances, including every kernel of FlashAttention-2, -3 and -4 plus DeepGEMM. It proved 83 correct. The remaining 66 led to 38 correctness bugs.

    TL;DR

    • Size: 1.8K-line PTX parser. Specs total 10,278 lines against 151,285 lines of kernel source, a ratio near 15:1.
    • Runs on: A 16-core workstation. It checks PTX compiled for A100, H100 and B200 kernels.
    • Performance: 83 of 149 kernel instances proved correct, 38 bugs found across 6 projects.
    • Best: Caught a FlashAttention-4 data race that never appeared in 17,760 test runs.

    What is TensorLean?

    TensorLean is a formal verification framework for GPU kernels at the PTX level.

    It starts from unmodified source code. A developer writes a tensor-level spec in Lean. TensorLean then proves 4 properties: no data races, termination, correct output within tolerance, and untouched memory elsewhere.

    How does TensorLean verify a GPU kernel?

    Specs build on Lean’s Mathlib. Tensor operators follow PyTorch names, so @ means torch.matmul. Each spec has 5 parts: spec_math, spec_mut, spec_layout, spec_tol and requires. The math stays separate from the memory layout.

    The pipeline runs in 7 steps:

    1. Start from unmodified source.
    2. Write the tensor-level spec.
    3. Compile to PTX and load a PTX semantics.
    4. Build a happens-before graph to check races and termination.
    5. Symbolically execute to get final memory, identical across schedules.
    6. Lower the spec to PTX-memory level.
    7. Discharge proofs with Lean’s kernel, Z3 and cvc5.

    Which techniques make it scale?

    • Concurrency to sequential: Race-freedom proofs on the happens-before graph cover all CTAs, threads and loop iterations symbolically.
    • Loop invariants over semirings: Closed forms for tiled, accumulating loops, such as online softmax, need 1 SMT query per loop.
    • Tolerance proofs: Algebraic error is proved zero. Round-off error is bounded separately, then combined.
    • Assertions as hints: Developers add tensorlean_assert in source. Each is proved once, then reused.

    What bugs did TensorLean find?

    The GitHub README lists 38 bugs, all reported upstream. FlashAttention accounts for 23. Liger Kernel has 7, TileOPs 3, TileLang 2, DeepGEMM 2 and Triton 1.

    By category, the site reports 19 memory access errors and 13 numerical bugs. It also counts 7 data races, 5 uninitialized memory reads and 5 undefined behaviors. There are 3 algorithm errors, 2 miscompilations and 1 deadlock. One bug can sit in several categories.

    Of 102 FlashAttention instances, 56 passed all 4 properties. The other 46 each failed a proof goal on a source bug.

    CertiK Columbia formal GPU Introduce Kernels researchers Team TensorLean Verification
    NCIJ NETWNCIJ NETWORK
    • Website

    Keep Reading

    OpenAI Ships GPT-Live-1.1 for Voice Agents, Cuts Idle Cost to $0.02/Min

    Meet Thinking Machines Inkling 2 Mini: 26B Looped MoE Runs on a 32GB Mac

    Baseten Releases Bison-1 and Groundhog-1, Topping Decision Model Index

    RadixArk Ships DaisyRose-27B, a 27B Agentic Coding Model Trained With Reinforcement Learning Only

    NVIDIA AI Releases Nemotron-Labs-Sigma, a Continuous Diffusion Language Model with 14 checkpoints at 3B/8B

    Perplexity Launches Orchestrator API for Failover and Model Routing

    Add A Comment
    Leave A Reply Cancel Reply

    Editors Picks

    NASA’s powerful Moon rocket engine roars through a dramatic 200-second test

    November 22, 2026

    Ronald Reagan Changed His Chief of Staff After a Midterm Trouncing, Too

    November 22, 2026

    This scientist proves which problems computers can’t solve quickly

    November 22, 2026

    Fossil fuel dispute threatens to derail COP31 climate deal

    November 22, 2026
    Latest Posts

    Unpacking claim USS Doris Miller will be renamed after Trump instead of Black WWII hero

    August 21, 2026

    Iran Vows ‘Devastating’ Retaliation Against New U.S. Sanctions Threats

    August 21, 2026

    Bomb Fishing Is Reducing Coral Reefs to ‘Rubble’

    August 21, 2026

    Subscribe to News

    Get the latest sports news from NewsSite about world, sports and politics.

    NCIJ Network is an independent digital news platform delivering trusted investigative journalism, European and global news, in-depth analysis, and fact-based reporting with accuracy, transparency, and integrity.

    Facebook X (Twitter) Instagram Pinterest YouTube

    NASA’s powerful Moon rocket engine roars through a dramatic 200-second test

    November 22, 2026

    Ronald Reagan Changed His Chief of Staff After a Midterm Trouncing, Too

    November 22, 2026

    This scientist proves which problems computers can’t solve quickly

    November 22, 2026

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    Type above and press Enter to search. Press Esc to cancel.