Chat with a fully local AI model from the terminal without needing a cloud API key.
Let the assistant search the web, read and write files, or run shell commands as part of a coding task.
Test tool-calling behavior against different local models served by Ollama or LM Studio.
| aditya-an1l/agenttool | 0xustaz/streamgate | a-bissell/unleash-lite | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | hard | hard |
| Complexity | 2/5 | 4/5 | 4/5 |
| Audience | developer | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires a locally running Ollama or LM Studio server with a model already loaded before use.
AgentTool is a lightweight Python command line assistant that connects to AI models running entirely on your own computer through Ollama or LM Studio, rather than a cloud service. It automatically finds any local model server you have running, presents an interactive menu so you can pick which model to use, and then starts a conversation loop where the model can call built-in tools to accomplish tasks. Once a model is selected, the assistant can search the web using DuckDuckGo, read and write files, list the contents of a directory, and execute shell commands, all as part of an automated back-and-forth loop between the model's requests and the tool results. The tool-calling format follows the same convention used by OpenAI's API, so it works with any local server that speaks that same protocol, and the project includes fallback parsing to handle models that occasionally produce a slightly malformed tool call. Installation follows a standard Python workflow: cloning the repository, setting up a virtual environment, and installing the listed dependencies along with a separate set of development dependencies for running the included test suite. To actually use the assistant, you first need a local inference server running, either by starting Ollama with a model already pulled or by opening LM Studio and loading a model there, then launching the script and selecting the desired model from the list. No real API key is needed since a placeholder key is used internally to satisfy the OpenAI-compatible request format, and the tool-calling loop is capped at ten iterations to prevent it from running indefinitely. The project also includes a comprehensive test suite and handles Ctrl+C interruptions gracefully so a running session can be stopped cleanly.
A terminal coding assistant that auto-discovers local Ollama or LM Studio models and runs an agentic tool-calling loop with web search and file ops.
Mainly Python. The stack also includes Python, Ollama, LM Studio.
Apache 2.0 license: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.