Sign an AI evaluation result so anyone can later verify it was not tampered with.
Prove a benchmark score met a threshold without revealing the exact number.
Let an outside auditor spot-check random samples from a published evaluation run.
Pre-register an evaluation plan before running it to prevent cherry-picked results.
| b7n0de/proofbundle | 0-bingwu-0/live-interpreter | 010zx00x1/faresnipe | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Python | Python | Python |
| Setup difficulty | easy | moderate | easy |
| Complexity | 3/5 | 2/5 | 2/5 |
| Audience | researcher | general | general |
Figures from each repo's GitHub metadata at analysis time.
proofbundle is a small Python tool that creates a tamper-proof receipt for an AI evaluation result. When someone reports a safety score or a capability benchmark for an AI model, there is usually no way to check the claim yourself, you just have to trust the lab that published it. proofbundle turns that kind of result into a single signed file that anyone can check offline, without a server or network connection, to confirm two specific things: that a stated party actually signed those exact numbers, and that nobody has quietly changed them since. It is important to understand what this tool does not do. A receipt does not prove the number itself is true, that the evaluation was designed well, that the issuer was honest, or that the underlying computation was correct. It only proves authorship and integrity, similar to how a cash register receipt proves a transaction happened and was not altered, not that the store treated the customer fairly. The README is upfront that this narrow guarantee is the entire point of the project, not a shortcoming. The technical approach relies on standard cryptographic signatures (Ed25519) and a tree-based structure called a Merkle tree that lets someone verify a large set of results piece by piece without needing everything at once. Optional features include selective disclosure, so a threshold can be proven while the exact score stays hidden, transparency log support so signed claims can be tracked publicly over time, and a per-sample auditing feature that lets an outside auditor spot-check random samples from a run. It also supports pre-registering an evaluation plan before running it, to make cherry-picked results after the fact visible. This is aimed at people building or reviewing AI evaluation pipelines: researchers running benchmarks, auditors checking published safety claims, or teams integrating with existing evaluation frameworks like inspect_ai or pytest. It installs via pip and includes a one-command demo that shows both a valid receipt and a set of deliberately tampered ones failing verification.
A tool that turns AI evaluation results into signed, tamper-proof receipts anyone can verify offline.
Mainly Python. The stack also includes Python, Ed25519, Merkle trees.
MIT licensed, free to use for any purpose including commercial use, as long as the copyright notice is kept.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.