Give an AI coding assistant like Claude Code or Cursor a single tool to read and search 52 websites.
Run a self-hosted gateway so agents stop needing custom scrapers per platform.
Cache and route web requests across platforms with automatic failover when a backend breaks.
Build an agent integration in one of nine SDKs against a single consistent API.
| oxbshw/agent-span | cvetkovicdamjan/neurilium | day-os/green-vita | |
|---|---|---|---|
| Stars | 43 | 43 | 43 |
| Language | Rust | Rust | Rust |
| Setup difficulty | moderate | hard | hard |
| Complexity | 4/5 | 4/5 | 4/5 |
| Audience | developer | researcher | general |
Figures from each repo's GitHub metadata at analysis time.
Zero-config for many channels, but several platforms require you to supply your own API key or login cookie.
AgentSpan is a gateway that gives AI agents one consistent way to read and search 52 different internet platforms, such as GitHub, YouTube, Reddit, Wikipedia, and Hacker News, instead of each agent needing its own scraper or integration for every site. It sits between the agent and the internet, offering a REST API, a live event stream, a native MCP server with 91 tools for assistants like Claude Code or Cursor, nine software development kits covering languages such as Python, JavaScript, Rust, and Go, a command line tool, and a React dashboard, all built on an async Rust core. The gateway caches results across three tiers so repeated requests are fast and cheap, and it monitors its own backends: if a connection to a platform starts failing, it automatically switches to a working alternative, reinstalls broken command line tools it depends on, and can alert someone if an outage continues. It also watches its own traffic to suggest things like adjusting how long results stay cached or trying a faster backend. The README is explicit about what AgentSpan does not do. It cannot click buttons, log into websites, or fill out forms the way a browser automation tool can, it is not trying to be a general purpose web crawler for arbitrary sites, and it is not offered as a hosted service, only as software you run yourself. To try it, you run a single command to start the gateway locally, then make simple web requests to read a page or search a specific platform, such as Hacker News. It can also be started with Docker, which brings up the API, a web interface, a Redis cache, a PostgreSQL database, and monitoring tools together. For use with AI coding assistants, a single command writes the correct configuration file automatically. The 52 supported platforms are split into ones that work with no setup and ones that require an API key or login cookie you provide yourself. The project is licensed under MIT.
A self-hosted Rust gateway that gives AI agents one API, MCP server, and set of SDKs to read and search 52 websites like GitHub, YouTube, and Reddit, with automatic caching and failover.
Mainly Rust. The stack also includes Rust, Docker, Redis.
Free to use, modify, and distribute for any purpose, including commercial, as long as you keep the copyright notice.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.