thom4parisot/jsonstream — explained in plain English
Analysis updated 2026-07-18 · repo last pushed 2016-03-02
Process a large API or database response without loading it all into memory.
Extract specific nested fields from a huge JSON stream using path notation.
Build an ETL pipeline that moves gigabytes of JSON data between systems.
Convert a stream of JavaScript objects back into valid JSON with stringify.
| thom4parisot/jsonstream | 3rd-eden/ircb.io | a15n/a15n | |
|---|---|---|---|
| Language | JavaScript | JavaScript | JavaScript |
| Last pushed | 2016-03-02 | 2016-11-16 | 2019-04-07 |
| Maintenance | Dormant | Dormant | Dormant |
| Setup difficulty | easy | easy | easy |
| Complexity | 2/5 | 2/5 | 2/5 |
| Audience | developer | developer | general |
Figures from each repo's GitHub metadata at analysis time.
JSONStream lets you work with huge JSON files without loading them all into memory at once. Instead of reading an entire file and parsing it, you can process JSON data as it arrives, piece by piece, like water flowing through a pipe. Normally, if you want to read a large JSON file, your program has to load the whole thing into memory, parse it, then work with it. That's slow and wasteful. JSONStream changes the game by parsing JSON incrementally. You point it at a stream of data (like a file download or API response) and tell it which parts you care about using a simple path notation. As matching pieces arrive, they get emitted one at a time so you can process them immediately, without ever holding the full dataset in RAM. The README shows a real example: querying a CouchDB database that returns nested JSON. Instead of downloading all 129 rows and parsing them together, you'd write something like JSONStream.parse('rows..doc') to extract just the document objects you need. Each one streams out as it's parsed, and you can pipe it to another tool that does something with it. The is a wildcard that matches any key, and .. lets you search recursively down the hierarchy. You can also transform or filter data as it flows through. The library also works in reverse with stringify, which lets you turn a stream of JavaScript objects back into valid JSON without building the whole structure in memory first. This makes it ideal for ETL pipelines, API integrations, and any scenario where you're moving large amounts of JSON data between systems, a developer could use it in Node.js to process gigabytes of data without their server running out of memory.
A library that parses huge JSON files piece by piece as they stream in, so you never have to load the whole file into memory to process it.
Mainly JavaScript. The stack also includes JavaScript, Node.js.
Dormant — no commits in 2+ years (last push 2016-03-02).
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.