Reproduce the experiment showing a model's self report can be separated from its actual text output.
Study how internal model signals relate to what a language model claims about its own behavior.
Review a documented example of negative research results being published instead of hidden.
Check the cryptographic priority record to verify when specific findings were first made.
| xnn-llc/xnn-research | 0-bingwu-0/live-interpreter | 010zx00x1/faresnipe | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | moderate | easy |
| Complexity | 3/5 | 2/5 | 2/5 |
| Audience | researcher | general | general |
Figures from each repo's GitHub metadata at analysis time.
Requires installing torch and transformers and downloading a public language model to run the reproduction script.
This repository is a research notebook from an independent group called XNN LLC that studies how large language models behave inside, not just what they output. The core finding is a strange one: you can ask a model what language a passage is written in, and separately nudge an internal signal so the model claims a different language, even though it keeps writing in the original language without changing a word. In other words, what the model says about text and what it actually does with that text can be pulled apart. The team compares this to a similar idea published by Anthropic in 2026, but adds an important check: they also test a scrambled version of the same nudge, matched in size but meaningless in direction, and that scrambled version barely changes the model's answer at all. This tells them the effect comes from the specific signal they added, not just from poking the model in general. You do not need an account or private access to try this yourself. The repo includes a short, commented Python script that runs on a small public model using standard tools like PyTorch and the transformers library, and it prints out the actual result on a real run so you can compare. The authors are unusually upfront about what has not worked. They also searched for specific stored weights inside models responsible for certain behaviors, and so far found none that held up against their scrambled control, including one costly negative result they still chose to publish. Two earlier phases of their research were closed out as failures and written up honestly rather than dropped quietly. The repository also includes a set of files meant to timestamp and prove when the team reached certain findings, using cryptographic hashes of private documents, without revealing those documents. This lets them claim priority on an idea without publishing everything behind it yet. The project takes no position on questions like machine consciousness. It is written and maintained by Gleb Stepanov of XNN LLC, an independent research company rather than a university lab.
Independent AI research showing a language model can be made to misreport what language it is writing in, without changing its actual output.
Mainly Python. The stack also includes Python, PyTorch, Transformers.
See the repository LICENSE and NOTICE files for the exact permitted uses of this material.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.