Repository:ggml-org/llama.cpp
llama.cpp: LLM Inference in C/C++
llama.cpp is an open-source C/C++ project by ggml-org dedicated to LLM inference. Boasting over 127,000 GitHub stars, it provides pre-built binaries, Docker containers, REST APIs, and C library bindings for executing language models.
127.1kstarsC++
From Video: AI Weekly Updates: Open-Source Model Surge, Agent Harnesses, and Meta's AI Reality Check