CRAG: Corrective Retrieval Augmented Generation for Robust LLM Outputs

RepositoryHuskyInSalt/CRAGResearch

CRAG (Corrective Retrieval Augmented Generation) is an open-source research framework designed to improve RAG reliability. It evaluates the quality of retrieved context using a lightweight evaluator and triggers corrective actions, such as web searches or text filtering, when confidence is low.

Key points

  1. A lightweight retrieval evaluator assesses retrieved document relevance and outputs a confidence score.
  2. Triggers corrective actions such as large-scale web searches when corpus retrieval is insufficient.
  3. Employs a decompose-then-recompose algorithm to isolate key facts and remove irrelevant noise.
  4. Designed as a plug-and-play extension compatible with various RAG architectures like Self-RAG.
  5. Evaluated across datasets including PopQA, PubQA, Bio, and Arc_challenge for short- and long-form tasks.

Why it matters

Standard RAG setups fail when retrieval returns incorrect or noisy contexts, leading to hallucinations. CRAG introduces an active validation and fallback step, significantly improving generation robustness in knowledge-driven AI workflows.

Analysis

CRAG addresses a primary bottleneck in current RAG systems: blind trust in retrieval output. By introducing confidence grading, secondary search fallbacks, and fine-grained passage rewriting, it reduces hallucinations. The codebase runs on Python 3.11 with fine-tuned LLaMA-2 checkpoints. However, as an academic repository lacking an explicit open-source licence, it functions primarily as an experimental reference implementation rather than an out-of-the-box production library.

Summary generated by AI (Gemini 3.8 Flash, 27 September 2026). It may contain errors – the original source is authoritative.

Similar in content, found by the AI search.

  • Repository:OpenSPG/KAG

    OpenSPG/KAG: Logic-Form Guided Reasoning and Retrieval Beyond Standard RAG

    KAG (Knowledge Augmented Generation) is an open-source framework combining LLMs with the OpenSPG engine. It aims to address the limitations of vector similarity in standard RAG and noise in OpenIE-based GraphRAG for domain-specific applications.

    9kstarsPython

    AI & LLMs· Tool

  • Repository:OSU-NLP-Group/HippoRAG

    HippoRAG 2: Neurobiologically Inspired Memory Framework for LLMs

    HippoRAG (now in version 2) is an open-source memory framework for LLMs developed by the OSU NLP Group, combining knowledge graphs and Personalized PageRank to mimic human long-term memory across external documents.

    4kstarsPython

    AI & LLMs· Research

  • Repository:hhhuang/CAG

    Cache-Augmented Generation (CAG): A KV-Cache Alternative to RAG

    The CAG open-source repository introduces Cache-Augmented Generation as an alternative to Retrieval-Augmented Generation (RAG). By preloading the entire knowledge base into the context window and reusing the precomputed KV cache, it bypasses real-time document retrieval entirely.

    1.5kstarsPython

    AI & LLMs· Resource

Let's talk about your project

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.