gitwtfhub

wtf is smart_remarkable?

yangg1224/smart_remarkable — explained in plain English

Analysis updated 2026-05-18

60RustAudience · developerComplexity · 4/5Setup · hard

TL;DR

A Rust tool that connects an AI vision model to the reMarkable tablet, letting you get typed or hand-drawn answers to what you write or sketch.

Mindmap

mindmap
  root((smart_remarkable))
    What it does
      Screenshots tablet page
      Sends to vision LLM
      Draws answer as ink
    Tech stack
      Rust
      XOVI extension
      Anthropic OpenAI Gemini
    Use cases
      Select Mode answers
      Draw button sketches
      Offline testing
    Audience
      Developers
      reMarkable tinkerers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Get an AI-drawn answer to a handwritten question right on your reMarkable tablet.

REASON 2

Lasso a region of your notes and have the AI answer only that selection.

REASON 3

Turn a rough sketch into a more detailed, redrawn illustration.

REASON 4

Test the whole trigger-to-draw pipeline offline on a desktop before using it on hardware.

What's in the stack?

RustAnthropic APIOpenAI APIGemini APIXOVI

How it stacks up

yangg1224/smart_remarkablec4pt0r/pierunwayml/avtensor
Stars606060
LanguageRustRustRust
Setup difficultyhardeasymoderate
Complexity4/52/54/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1h+

Requires a reMarkable tablet, SSH access, and an LLM API key such as ANTHROPIC_API_KEY.

Wtf does this do

Smart Remarkable connects a large language model to the reMarkable tablet, a device people use to read and take handwritten notes with a stylus. It is a fork of another project called ghostwriter, with new features added on top. The core idea is simple: you write or draw something on the tablet, trigger the tool with a tap, and it takes a screenshot of the page, sends it to an AI model that can see images, and writes or draws the answer back onto the screen in the same style, either as typed text or as pen strokes that look handwritten. One major feature is Select Mode. You tap a trigger corner, then draw a box around a piece of handwriting you want answered, then a second box showing where the answer should appear. The AI reads only that selected region and draws its response as real ink inside your chosen box, which means you can later move or resize that answer using the tablet's own built in selection tool, just like any other note. The project also adds two small buttons directly into the tablet's native selection menu, next to the usual cut and copy options: an LLM button that starts Select Mode instantly on whatever you have selected, and a Draw button. Tapping Draw on a piece of handwritten text sketches a small illustration under it, while tapping Draw on an existing sketch erases it and redraws an improved version in the same spot. There is also an option to route these drawings through a separate image generating model instead of having the chat AI draw simple line art itself, which produces more detailed pictures that are then traced into pen strokes. Other features include automatically detecting whether the tablet is held upside down and adjusting accordingly, a small web page for viewing and editing settings while the tool runs, and an offline testing mode that lets developers simulate the whole write, screenshot, and draw cycle on a desktop computer without needing the physical tablet. The tool is written in Rust and works with Anthropic, OpenAI, or Google models, though thinking mode and web search are Anthropic only.

Yoink these prompts

Prompt 1
Help me set up smart_remarkable on my reMarkable tablet with my ANTHROPIC_API_KEY.
Prompt 2
Explain how Select Mode works in smart_remarkable and how to trigger it.
Prompt 3
Walk me through installing the llmbutton XOVI extension for smart_remarkable.
Prompt 4
Show me how to enable image-generation drawing with the --image-model flag in smart_remarkable.

Frequently asked questions

wtf is smart_remarkable?

A Rust tool that connects an AI vision model to the reMarkable tablet, letting you get typed or hand-drawn answers to what you write or sketch.

What language is smart_remarkable written in?

Mainly Rust. The stack also includes Rust, Anthropic API, OpenAI API.

How hard is smart_remarkable to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is smart_remarkable for?

Mainly developer.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.