aglio-lab/rag-retrieval-tools — explained in plain English
Analysis updated 2026-05-18
Find a vector database or search library to power a retrieval-augmented generation app.
Compare embedding models and rerankers before choosing one for your pipeline.
Look up document parsing or web crawling tools to feed source data into a RAG index.
Find an evaluation framework or benchmark to measure your RAG system's quality.
| aglio-lab/rag-retrieval-tools | 0xustaz/streamgate | a-bissell/unleash-lite | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Python | Python | Python |
| Setup difficulty | easy | hard | hard |
| Complexity | 1/5 | 4/5 | 4/5 |
| Audience | developer | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
This project is a large curated reference list covering retrieval-augmented generation, usually shortened to RAG, and the broader field of retrieval. Rather than being software you run, it catalogs over 200 tools that together make up a typical RAG stack: parsing and chunking source files, turning that content into searchable vectors or text indexes, retrieving relevant candidates, reranking them for quality, generating a grounded answer, and evaluating how well the whole system performed. The README is explicit that it separates these layers carefully, so a full RAG framework is listed apart from a vector database, an embedding model is listed apart from a reranker, and an evaluation toolkit is kept separate from an observability platform. Entries span sixteen categories, including frameworks for building end to end RAG applications, vector databases and search libraries, engines for lexical or hybrid keyword search, hosted managed retrieval services, embedding model providers, rerankers that improve result ordering, tools for parsing PDFs and scanned documents, web crawlers for extracting clean text, ingestion pipelines that keep an index in sync with source data, tools for retrieval over graphs of entities and relationships, multimodal retrieval across images and video, query optimization techniques, evaluation frameworks, fixed benchmarks for comparing systems, and tools for observability, security, and governance of a live RAG system. Every entry links back to its original source, such as a repository, documentation site, model card, or research paper, and each is labeled as open source, open weights, open core, or fully commercial. The catalog is also published as machine readable JSON and CSV files and is reviewed monthly, with a dedicated section listing tools that have been discontinued. The project is released under the CC0 license, meaning it sits in the public domain, and it accepts pull requests from contributors who want to add or correct entries.
A curated, monthly-reviewed directory of over 200 tools covering every layer of a RAG stack: vector databases, embeddings, rerankers, parsing, and evaluation.
Mainly Python. The stack also includes Markdown, JSON, CSV.
Public domain dedication, use the list content for any purpose without restriction.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.