xj85770/xav-glm52-2box-local — explained in plain English
Analysis updated 2026-05-18
Run a 753-billion-parameter AI model offline using two Macs linked by a cable.
Generate a complete Pac-Man game in a single file from a single AI prompt.
Stream AI text generation live with a real-time speed counter for demos.
Render AI text output into a video for proof-of-concept recordings.
| xj85770/xav-glm52-2box-local | aizhigitovamir-code/n8n-automation-suite | ayush-sk-pathak/claude-code-starter-pack | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Shell | Shell | Shell |
| Setup difficulty | hard | moderate | easy |
| Complexity | 5/5 | 3/5 | 2/5 |
| Audience | developer | pm founder | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires two Macs each with 128GB RAM, a physical cable link, compiled patches for llama.cpp, and a 202GB compressed model download.
This repository shows how to run GLM-5.2, a very large AI model with 753 billion parameters, entirely on two Apple Mac computers with no internet connection. The model is so large that a single Mac with 128GB of memory cannot hold it, resulting in a speed of under one token per second. By connecting two Macs together with a single cable into 256GB of shared memory, the full model stays in memory and runs at about 18.5 tokens per second. The repository provides patches and scripts to reproduce this setup. One patch fixes a software crash that happens when large models communicate over a network between the two machines. Another patch adds support for a specific part of the model architecture. The launcher script checks the connection between the two computers, confirms enough memory is free, runs a test, and starts the model. It cleans up memory if anything fails. The recommended configuration uses a setting called f16 for memory and reduces the number of active experts from eight to five. This increased speed by nearly nineteen percent over the starting setup without changing the model or affecting output quality. The setup served up to 128,000 tokens of context during live testing. The model itself is compressed to about 202GB using a method called IQ1_S. The repository includes demo tools used to create proof videos. One demo asks the model to write a complete Pac-Man game in a single file. The resulting file is included and works in a browser with one character fixed. Another demo streams text generation in real time with a live speed counter, and a script renders the output into a video. The project builds on existing open source work from llama.cpp, Z.ai, and Unsloth. The model weights are open.
Run a massive 753-billion-parameter AI model across two Macs with no internet. Connect them with a cable for shared memory and get usable speed.
Mainly Shell. The stack also includes Shell, llama.cpp.
No license information is provided in the explanation, so rights to use or modify this code are unknown.
Setup difficulty is rated hard, with roughly 1day+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.