gitwtfhub

wtf is xnn-research?

xnn-llc/xnn-research — explained in plain English

Analysis updated 2026-05-18

2PythonAudience · researcherComplexity · 3/5Setup · moderate

TL;DR

Independent AI research showing a language model can be made to misreport what language it is writing in, without changing its actual output.

Mindmap

mindmap
  root((repo))
    What it does
      Injects internal signal
      Splits saying from doing
      Uses scrambled control
    Tech stack
      Python
      PyTorch
      Transformers
    Use cases
      Reproduce the experiment
      Study model self reports
      Check AI interpretability claims
    Audience
      Researchers
      AI safety readers
    Findings
      One confirmed effect
      Zero weight carriers found
      Two negative results published
    Provenance
      Priority timeline
      Hash commitments
      Private research backing

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Reproduce the experiment showing a model's self report can be separated from its actual text output.

REASON 2

Study how internal model signals relate to what a language model claims about its own behavior.

REASON 3

Review a documented example of negative research results being published instead of hidden.

REASON 4

Check the cryptographic priority record to verify when specific findings were first made.

What's in the stack?

PythonPyTorchTransformers

How it stacks up

xnn-llc/xnn-research0-bingwu-0/live-interpreter010zx00x1/faresnipe
Stars222
LanguagePythonPythonPython
Setup difficultymoderatemoderateeasy
Complexity3/52/52/5
Audienceresearchergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · moderate Time to first run · 30min

Requires installing torch and transformers and downloading a public language model to run the reproduction script.

See the repository LICENSE and NOTICE files for the exact permitted uses of this material.

Wtf does this do

This repository is a research notebook from an independent group called XNN LLC that studies how large language models behave inside, not just what they output. The core finding is a strange one: you can ask a model what language a passage is written in, and separately nudge an internal signal so the model claims a different language, even though it keeps writing in the original language without changing a word. In other words, what the model says about text and what it actually does with that text can be pulled apart. The team compares this to a similar idea published by Anthropic in 2026, but adds an important check: they also test a scrambled version of the same nudge, matched in size but meaningless in direction, and that scrambled version barely changes the model's answer at all. This tells them the effect comes from the specific signal they added, not just from poking the model in general. You do not need an account or private access to try this yourself. The repo includes a short, commented Python script that runs on a small public model using standard tools like PyTorch and the transformers library, and it prints out the actual result on a real run so you can compare. The authors are unusually upfront about what has not worked. They also searched for specific stored weights inside models responsible for certain behaviors, and so far found none that held up against their scrambled control, including one costly negative result they still chose to publish. Two earlier phases of their research were closed out as failures and written up honestly rather than dropped quietly. The repository also includes a set of files meant to timestamp and prove when the team reached certain findings, using cryptographic hashes of private documents, without revealing those documents. This lets them claim priority on an idea without publishing everything behind it yet. The project takes no position on questions like machine consciousness. It is written and maintained by Gleb Stepanov of XNN LLC, an independent research company rather than a university lab.

Yoink these prompts

Prompt 1
Explain what it means for a language model to report one language while writing in another.
Prompt 2
Walk me through running reproduce.py from this repo on the Qwen3-1.7B model.
Prompt 3
Summarize the difference between a real injected signal and a norm matched shuffled control in this experiment.
Prompt 4
Explain why the authors count zero weight space carriers found as an honest result rather than a failure.

Frequently asked questions

wtf is xnn-research?

Independent AI research showing a language model can be made to misreport what language it is writing in, without changing its actual output.

What language is xnn-research written in?

Mainly Python. The stack also includes Python, PyTorch, Transformers.

What license does xnn-research use?

See the repository LICENSE and NOTICE files for the exact permitted uses of this material.

How hard is xnn-research to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is xnn-research for?

Mainly researcher.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.