Repository:JustVugg/colibri
Colibrì: Running Frontier MoE Models via Disk-Streamed Experts
Colibrì is a lightweight inference engine written in pure C with zero dependencies, designed to run frontier Mixture-of-Experts (MoE) models ranging from 744B to 2.8T parameters on consumer and heterogeneous hardware. It treats VRAM, RAM, and storage as a unified memory hierarchy, streaming experts on demand.
37.7kstarsC
From X post: Ten Open-Source Repositories Powering AI Agent Infrastructure