gitwtfhub

wtf is oracle-duel?

klabianco/oracle-duel — explained in plain English

Analysis updated 2026-05-18

0PythonAudience · researcherComplexity · 4/5LicenseSetup · moderate

TL;DR

A research project where Claude and GPT compete as automated forecasters on real Kalshi prediction markets, scored for accuracy with a locked risk control system.

Mindmap

mindmap
  root((Oracle Duel))
    What it does
      Claude vs GPT forecasting
      Brier scoring
      Locked risk engine
    Tech stack
      Python
      Kalshi API
      Claude and GPT APIs
    Use cases
      Calibration research
      Mock pipeline testing
      Go no go review
    Audience
      Researchers
      LLM enthusiasts

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Study how well Claude and GPT calibrate their confidence when forecasting real world prediction markets.

REASON 2

Run the pipeline in mock mode to test the forecasting and scoring logic without spending anything.

REASON 3

Review the pre registered go or no go criteria before deciding whether to allow live trading.

What's in the stack?

Python

How it stacks up

klabianco/oracle-duel0xallam/my-recipe0xhassaan/nn-from-scratch
Stars00
LanguagePythonPythonPython
Last pushed2022-11-22
MaintenanceDormant
Setup difficultymoderatemoderatemoderate
Complexity4/52/54/5
Audienceresearchergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · moderate Time to first run · 30min

Needs API keys for Claude, GPT, and Kalshi, defaults to safe paper trading mode.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice (MIT license).

Wtf does this do

Oracle Duel is a research project that pits two AI language models, Claude and GPT, against each other as forecasters on real prediction markets run by Kalshi. Each model keeps its own five hundred word strategy prompt that it rewrites after every scored round, based on how accurate its past forecasts were using a standard scoring method for probability predictions. Most of what the models produce is just forecasts used purely to measure and improve their judgment, and only the two or three strongest predicted edges each round turn into small real money trades, and even those are sized by a separate, fixed risk control system that the forecasting agents cannot modify or influence. The project is explicit that it is a research experiment about how well language models can forecast and calibrate their confidence, not a betting product or financial advice, and it defaults to a paper trading mode with no real orders placed. Before it can be switched into live trading, a pre registered set of go or no go conditions has to be met, and those conditions were written down and locked before any results were seen, specifically so the project cannot quietly move the goalposts if the early results look good. The fixed risk engine limits position sizing using a conservative fraction of the total bankroll, caps the number of new positions and the total daily loss, and includes a drawdown circuit breaker that halts trading and requires a human to review the situation before it resumes. There is also a simple kill switch file that immediately blocks all new orders while leaving the forecasting itself running. The system can run in a fully mocked mode with no real spending for testing, a paper mode against real markets with no money at risk, and a live mode. It is written in Python, scheduled to run automatically on a daily cycle using macOS's launchd or Linux cron, and released under the MIT license.

Yoink these prompts

Prompt 1
Set up Oracle Duel in mock mode and walk me through fast forwarding the mock clock a week.
Prompt 2
Explain how Oracle Duel's Brier scoring decides which forecasts count as accurate.
Prompt 3
Show me the go or no go conditions in Oracle Duel's gates.py and what they check.
Prompt 4
Help me schedule Oracle Duel's daily forecast cycle using cron on Linux.

Frequently asked questions

wtf is oracle-duel?

A research project where Claude and GPT compete as automated forecasters on real Kalshi prediction markets, scored for accuracy with a locked risk control system.

What language is oracle-duel written in?

Mainly Python. The stack also includes Python.

What license does oracle-duel use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice (MIT license).

How hard is oracle-duel to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is oracle-duel for?

Mainly researcher.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.