gitwtfhub

wtf is lyric-video-director?

shadow-shinigami/lyric-video-director — explained in plain English

Analysis updated 2026-05-18

43PythonAudience · developerComplexity · 3/5LicenseSetup · moderate

TL;DR

A Hermes Agent skill that turns a song and its exact lyrics into a stylized, typography focused lyric video, with automatic checks that the on screen text and audio stay accurate.

Mindmap

mindmap
  root((lyric-video-director))
    What it does
      Generates lyric videos
      Typography led animation
      Keeps original song audio
    Tech stack
      Python
      FFmpeg
      GPT Image 2
      Gemini Omni Flash
    Use cases
      Make a stylized lyric video
      Animate instrumental sections
      QC exact lyric text on screen
    Audience
      Hermes Agent users
      Musicians and creators
    Design
      Visual style bible first
      Exact text verification
      Master audio untouched

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Generate a typography led lyric video from a song and its exact lyric timings

REASON 2

Automatically check that on screen lyric text matches the real lyrics exactly

REASON 3

Create a wordless animated narrative for instrumental sections of a song

REASON 4

Assemble final video with FFmpeg while preserving the original master audio

What's in the stack?

PythonFFmpegGPT Image 2Gemini Omni FlashHermes Agent

How it stacks up

shadow-shinigami/lyric-video-directoralibaba/omnidoc-tokenbencharccalc/dwmfix
Stars434343
LanguagePythonPythonPython
Setup difficultymoderatemoderateeasy
Complexity3/53/52/5
Audiencedeveloperresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · moderate Time to first run · 1h+

Requires access to GPT Image 2 and Gemini Omni Flash generation tools plus a local ffmpeg install.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

Wtf does this do

Lyric Video Director is a skill for Hermes Agent, an AI agent framework, that automates the process of turning a song, its exact lyrics, and rough timing of each line into a stylized lyric video where the words themselves are the visual star of the show. The workflow treats the lyric text as the main character on screen. First, an AI image tool called GPT Image 2 designs typography focused compositions, meaning scenes built around how the words look and move rather than live action footage. Then a video tool called Gemini Omni Flash takes those still designs and animates them into motion. Throughout the process, automated checks make sure the text that appears on screen exactly matches the real lyrics, and that the original song audio is never altered or replaced. Before committing to full video generation, the skill builds a visual style guide and short test sequences, since generating final videos in bulk is expensive and mistakes are costly to redo. It can also handle instrumental sections with no lyrics by creating a wordless visual narrative that still flows naturally from one scene to the next. Once everything is generated, FFmpeg, a well known open source video and audio tool, assembles the final video and layers it back over the original, untouched master recording of the song. A final round of checks covers technical quality, whether the on screen text is accurate, whether it matches the music, and whether the creative style stays consistent throughout. To use it, you copy or clone the project into a specific skills folder inside your Hermes Agent profile, after which Hermes can discover and use it automatically. It expects Python 3, the ffmpeg and ffprobe command line tools, and access to the GPT Image 2 and Gemini Omni Flash generation tools, with an optional extra tool for deeper audio analysis. It is written in Python and released under the MIT license.

Yoink these prompts

Prompt 1
Help me install the lyric-video-director skill into my Hermes Agent profile.
Prompt 2
Walk me through preparing a project.yaml and timeline file for lyric-video-director.
Prompt 3
Explain how lyric-video-director verifies that generated on screen text matches the exact lyrics.
Prompt 4
Show me how to run the inspect_audio.py and validate_timeline.py helper scripts.

Frequently asked questions

wtf is lyric-video-director?

A Hermes Agent skill that turns a song and its exact lyrics into a stylized, typography focused lyric video, with automatic checks that the on screen text and audio stay accurate.

What language is lyric-video-director written in?

Mainly Python. The stack also includes Python, FFmpeg, GPT Image 2.

What license does lyric-video-director use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

How hard is lyric-video-director to set up?

Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.

Who is lyric-video-director for?

Mainly developer.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.