gitwtfhub

wtf is openwebui-gemini-omni-video?

spawnofsociety2/openwebui-gemini-omni-video — explained in plain English

Analysis updated 2026-05-18

1PythonAudience · vibe coderComplexity · 4/5Setup · hard

TL;DR

An OpenWebUI tool that generates and edits realistic videos from text prompts or images using Google's Gemini Omni Flash model, shown right inside the chat.

Mindmap

mindmap
  root((repo))
    What it does
      Text to video generation
      Image to video generation
      Video editing
      Inline video playback
    Tech stack
      Python
      OpenWebUI
      Gemini Omni Flash
      Google Cloud
    Use cases
      Generate marketing videos
      Edit existing clips
      Prototype video ideas
    Audience
      Vibe coders
      OpenWebUI users
    Setup
      Enable Vertex AI
      Authenticate Google Cloud
      Configure project and region

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Generate a realistic video from a written prompt directly inside an OpenWebUI chat.

REASON 2

Turn an uploaded image or image link into a starting frame or reference for a generated video.

REASON 3

Edit an existing short video clip or a longer one stored in Google Cloud Storage with a text prompt.

REASON 4

Follow the prompting guide to control camera shots, timing, background music, and on screen text.

What's in the stack?

PythonOpenWebUIGemini Omni FlashGoogle Cloud

How it stacks up

spawnofsociety2/openwebui-gemini-omni-video0xustaz/streamgatea-bissell/unleash-lite
Stars111
LanguagePythonPythonPython
Setup difficultyhardhardhard
Complexity4/54/54/5
Audiencevibe coderdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1h+

Requires a Google Cloud Project with the Vertex AI API enabled and proper IAM authentication, not a simple API key.

No license information is provided in the README.

Wtf does this do

OpenWebUI Gemini Omni Video Generator is a tool that adds video generation to OpenWebUI, a chat interface for AI models. It uses Google's Gemini Omni Flash model to turn a written prompt into a realistic video, then downloads that video and shows it as a playable video right inside your chat conversation, with no need to leave the app to view it. Beyond making videos from text, the tool can also start from an image you upload or link to, using it as a reference for the generated video. It can also edit an existing video: you attach a short clip, or provide a link to a longer one stored in Google Cloud Storage, and describe the change you want, such as replacing the background or changing the style. Setting this up takes more than a normal plug in install, because it connects to a Google Cloud Project rather than using a simple API key. Depending on how OpenWebUI itself was installed (plain Python, Docker, or Kubernetes), the setup steps differ: a Python install just needs you to log into your Google account through the gcloud command line tool, while Docker and Kubernetes installs require creating a Google Cloud service account, downloading its key file, and pointing your container or cluster at that file through an environment variable or secret. Once authenticated, you install the tool's Python file into OpenWebUI, enter your Google Cloud project ID and region, and turn the tool on for the AI model you want to use it with. The README also includes a detailed prompting guide for getting good results from the video model: how to ask for a single continuous shot instead of multiple cuts, how to keep edits simple and specific so the rest of the video stays unchanged, how to request particular background music, how to time events to happen at certain seconds, how to make readable text appear on screen, and how to use multiple reference images together, for example one as the starting frame and another as a style reference. The project does not state a license in its README.

Yoink these prompts

Prompt 1
Help me set up Google Cloud authentication so I can use this OpenWebUI video generation tool.
Prompt 2
Write a prompt for Gemini Omni Flash that keeps the whole video in a single continuous shot.
Prompt 3
Help me write an edit prompt that adds a cat to my video while keeping everything else the same.
Prompt 4
Show me how to use image reference tags to set the first frame and style of a generated video.

Frequently asked questions

wtf is openwebui-gemini-omni-video?

An OpenWebUI tool that generates and edits realistic videos from text prompts or images using Google's Gemini Omni Flash model, shown right inside the chat.

What language is openwebui-gemini-omni-video written in?

Mainly Python. The stack also includes Python, OpenWebUI, Gemini Omni Flash.

What license does openwebui-gemini-omni-video use?

No license information is provided in the README.

How hard is openwebui-gemini-omni-video to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is openwebui-gemini-omni-video for?

Mainly vibe coder.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.