Repository:hhhuang/CAG
Cache-Augmented Generation (CAG): A KV-Cache Alternative to RAG
The CAG open-source repository introduces Cache-Augmented Generation as an alternative to Retrieval-Augmented Generation (RAG). By preloading the entire knowledge base into the context window and reusing the precomputed KV cache, it bypasses real-time document retrieval entirely.
1.5kstarsPython