gitwtfhub

wtf is bilispider?

doughnutbean/bilispider — explained in plain English

Analysis updated 2026-05-18

10PythonAudience · developerComplexity · 2/5Setup · easy

TL;DR

A desktop tool for collecting and searching Bilibili video comments locally, with a GUI, QR-code login, SQLite storage, and shared JSONL datasets for small teams.

Mindmap

mindmap
  root((repo))
    What it does
      Collect Bilibili comments
      Local SQLite storage
      Word cloud search
    Tech stack
      Python
      Tkinter
      SQLite
    Use cases
      Personal research
      Word cloud analysis
      Team data sharing
    Audience
      Developers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Collect and locally store comments from a Bilibili video or user for personal research.

REASON 2

Search collected comments and generate a word cloud from the results.

REASON 3

Share a collected comment dataset with a small team using JSONL export and import.

What's in the stack?

PythonTkinterSQLitePyInstaller

How it stacks up

doughnutbean/bilispideraarav90-cpu/fetchitadammartinez271828/x4-analysis
Stars101010
LanguagePythonPythonPython
Setup difficultyeasyeasyeasy
Complexity2/52/52/5
Audiencedeveloperdevelopergeneral

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · easy Time to first run · 30min

Running from source needs pip install plus a QR-code login step before collecting comments.

Wtf does this do

BiliSpider is a desktop tool for collecting and browsing comments from Bilibili, a Chinese video platform, meant for learning, personal research, and small team collaboration rather than large scale scraping. It has a simple graphical interface built with Tkinter, lets you log in by scanning a QR code, and stores everything it collects in a local SQLite database on your own computer. The README is explicit that people should keep their request rate and collection scope reasonable and not use the tool for high frequency bulk requests or to get around platform rules. Once logged in, you can look up an account by its user ID to see its profile and video list, then collect the top level and reply level comments on those videos. Collection can pause and resume where it left off, avoids collecting the same comment twice, and includes rate limiting, cooldowns, and protection against the anti scraping response the platform sometimes returns. Local searches combine what is already stored in the database with fresh results from the live API and mark which source each result came from. Search results can be turned into a word cloud that you can save as an image, zoom or resize, and filter by blocking specific high frequency words with one click. Both a built in stopword list and a personal custom list are supported, and the personal list stays only on your own machine. Data can be shared between collaborators through JSONL files rather than the raw database, with comments deduplicated automatically on import. Command line tools let you export all comments, export by user or video ID, split exports into separate files, and import datasets other people have contributed. The installed Windows version ships without any existing database, but can optionally check for and download small shared dataset updates on startup. To run it from source, you install the Python dependencies, then run a login script followed by the GUI script, or use command line collection directly with options for limiting by date range or number of videos. A prebuilt Windows installer is also available, built with PyInstaller and Inno Setup, which installs without needing administrator rights and keeps its data in the user's own application folder.

Yoink these prompts

Prompt 1
Help me set up BiliSpider from source and log in with a QR code.
Prompt 2
Show me how to run the command line comment crawler limited to the last 30 days.
Prompt 3
Explain how to export and import shared JSONL datasets between collaborators in BiliSpider.

Frequently asked questions

wtf is bilispider?

A desktop tool for collecting and searching Bilibili video comments locally, with a GUI, QR-code login, SQLite storage, and shared JSONL datasets for small teams.

What language is bilispider written in?

Mainly Python. The stack also includes Python, Tkinter, SQLite.

How hard is bilispider to set up?

Setup difficulty is rated easy, with roughly 30min to a first successful run.

Who is bilispider for?

Mainly developer.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.