Repository:woelper/offgrid
offgrid: Self-Contained All-in-One Local LLM Runtime in Rust
offgrid is a portable single-binary Rust tool for downloading, running, and serving large language models completely offline. By compiling llama.cpp straight into the executable, it eliminates Python dependencies and external model servers. It provides developers with a telemetry-free, offline-ready AI environment for chat, coding agents, and API usage.
4starsRust
From X post: 0xSero Showcases Minimalist Interface for Local AI