FlashProve: an open-source library for provable inference
FlashProve combines a hiding weight commitment with a succinct cryptographic proof of integer-model inference for Llama 4 Maverick. For a batch of 24 requests with 1,024-token contexts, the authors report about 223 seconds on one H100 GPU and 24 CPU cores, with one selected token checked per request and an 18.78 MB proof for each request. The approximately 110 tokens/second figure counts processed context tokens; checking every token instead gives about 39.1 checked tokens/second in their experiment.