gitwtfhub

wtf is ok-dmd?

unkcenter/ok-dmd — explained in plain English

Analysis updated 2026-05-18

2PythonAudience · researcherComplexity · 5/5LicenseSetup · hard

TL;DR

A Python tool that helps AI language models decide which memories to keep or forget during long conversations, using math that tracks stable topics over time.

Mindmap

mindmap
  root((OK-DMD))
    What it does
      Tracks stable topics
      Decides cache evictions
      Prevents forgetting
    Tech stack
      Python
      PyTorch
      Koopman theory
    Use cases
      Long AI conversations
      Memory benchmarking
      GPU memory savings
    Audience
      AI researchers
      LLM engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Improve how a long-context AI chatbot remembers earlier topics after a brief distraction.

REASON 2

Benchmark memory-eviction strategies for large language model inference.

REASON 3

Reduce GPU memory use for long AI conversations without losing important context.

What's in the stack?

PythonPyTorch

How it stacks up

unkcenter/ok-dmd0-bingwu-0/live-interpreter010zx00x1/faresnipe
Stars222
LanguagePythonPythonPython
Setup difficultyhardmoderateeasy
Complexity5/52/52/5
Audienceresearchergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1h+

Requires GPU and familiarity with LLM inference internals to use meaningfully.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

Wtf does this do

OK-DMD is a Python tool that helps large language models handle very long conversations without losing track of important earlier information. When an AI model reads a long document or chat, it keeps a running memory called a KV-cache. Because that memory is limited, older parts often get deleted to make room for new ones, and standard methods decide what to delete based only on recent attention, which can accidentally throw away something important if the topic briefly changes and then comes back later. This project takes a different approach. It treats the flow of a conversation like a river, using a mathematical method called Koopman Operator Theory to spot the steady underlying "current" of a topic instead of just watching moment to moment shifts. That lets it tell the difference between information that matters for the whole document and passing side comments that can be safely forgotten. The README gives an example: if a document about astronomy is briefly interrupted by an unrelated lasagna recipe, older methods can wipe out the astronomy memory to make room, while OK-DMD is designed to protect it. The project includes a benchmark script that reproduces this exact scenario and reports how well OK-DMD preserves memory compared to a common alternative method called H2O, showing improved results under a tight memory budget. The README is honest about a limitation: if something is mentioned only once and never brought up again, OK-DMD may treat it as unimportant and remove it, so it recommends pairing it with other filtering techniques in real production systems. Installation is done by cloning the repository and installing it locally with pip. The project is licensed under Apache 2.0.

Yoink these prompts

Prompt 1
Explain how OK-DMD decides which parts of an AI's memory to keep during a long conversation.
Prompt 2
Help me install OK-DMD and run its benchmark stress test on my machine.
Prompt 3
Compare OK-DMD to the H2O method for managing AI memory and explain the tradeoffs in plain English.
Prompt 4
Show me how to integrate OK-DMD's eviction scoring into a long-context LLM pipeline.

Frequently asked questions

wtf is ok-dmd?

A Python tool that helps AI language models decide which memories to keep or forget during long conversations, using math that tracks stable topics over time.

What language is ok-dmd written in?

Mainly Python. The stack also includes Python, PyTorch.

What license does ok-dmd use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

How hard is ok-dmd to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is ok-dmd for?

Mainly researcher.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.