gitwtfhub

wtf is moss-transcribe.cpp?

localai-org/moss-transcribe.cpp — explained in plain English

Analysis updated 2026-05-18

29C++Audience · developerComplexity · 4/5LicenseSetup · moderate

TL;DR

A fast C++ rewrite of an AI transcription model that transcribes multi-speaker audio with timestamps, matching the original bit for bit.

Mindmap

mindmap
  root((repo))
    What it does
      Transcribes multi speaker audio
      Adds timestamps
      Matches original bit for bit
    Tech stack
      C++
      ggml
      CUDA
    Use cases
      Offline transcription
      Model conversion to GGUF
      LocalAI integration
    Audience
      Developers
      Local AI users

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Run fast, offline speaker-labeled transcription of audio on your own CPU or GPU without Python or PyTorch.

REASON 2

Convert an official MOSS-Transcribe-Diarize model into a single portable GGUF file for local use.

REASON 3

Integrate accurate, timestamped, multi-speaker transcription into a local-first app via LocalAI.

What's in the stack?

C++ggmlCMakeCUDA

How it stacks up

localai-org/moss-transcribe.cppalex-shayo/bakkes-mod-installollifrickenstein/krnl-exec-pc
Stars292929
LanguageC++C++C++
Setup difficultymoderateeasyeasy
Complexity4/52/52/5
Audiencedevelopergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · moderate Time to first run · 30min

Requires building with CMake and a one-time Python step to convert the model to GGUF format.

MIT license, use freely for any purpose including commercial use.

Wtf does this do

moss-transcribe.cpp is a from-scratch rewrite of an AI model called MOSS-Transcribe-Diarize, built by the LocalAI project. The original model transcribes audio with multiple speakers, figures out which words belong to which speaker, called diarization, and marks exactly when each part of the speech happened, all in a single pass rather than stitching together separate tools for each task. This port reimplements the whole thing in C++ using a library called ggml, so it can run without needing Python, PyTorch, or a CUDA toolkit at the moment you actually transcribe audio, and the entire model fits in one self-contained file format called GGUF. What makes this project notable is that it claims to be exactly as accurate as the original: every piece of the model is checked against the real PyTorch version and matches almost perfectly, so the text it produces is identical, not just similar. On a regular CPU it also runs noticeably faster than the original, around 1.6 to 1.8 times faster on the same hardware, while using less memory, and it can shrink the model down to a fraction of its original size through a technique called quantization, again without changing the output text. It also supports running on GPUs through several backends, including CUDA, Metal, Vulkan, and AMD's HIP, and the CUDA path has been verified to give the identical result on modern NVIDIA hardware. The output looks like a script with timestamps and speaker labels attached directly to the words, for example marking where one speaker's line ends and another begins along with the exact second it happened. Long recordings are handled by splitting the audio into thirty second chunks, processing each one, and stitching the pieces back together while keeping the timing consistent across the whole recording. To use it, you build the C++ project with CMake, then convert an official MOSS-Transcribe-Diarize model download into the GGUF format using an included Python script, which is only needed once during conversion and not while actually transcribing audio. The project is aimed at people who want fast, accurate, multi-speaker transcription that can run entirely on their own hardware without relying on Python or a GPU.

Yoink these prompts

Prompt 1
Help me build moss-transcribe.cpp with CMake and run it on a CUDA GPU.
Prompt 2
Walk me through converting the MOSS-Transcribe-Diarize model from Hugging Face into a GGUF file for this project.
Prompt 3
Explain how this project achieves bit-exact transcription output compared to the original PyTorch model.
Prompt 4
Show me how to quantize the model in this repo down to a smaller size while keeping the same transcript output.

Frequently asked questions

wtf is moss-transcribe.cpp?

A fast C++ rewrite of an AI transcription model that transcribes multi-speaker audio with timestamps, matching the original bit for bit.

What language is moss-transcribe.cpp written in?

Mainly C++. The stack also includes C++, ggml, CMake.

What license does moss-transcribe.cpp use?

MIT license, use freely for any purpose including commercial use.

How hard is moss-transcribe.cpp to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is moss-transcribe.cpp for?

Mainly developer.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.