Repository:Tencent/AngelSlim
Tencent AngelSlim: Comprehensive Toolkit for LLM Compression and Acceleration
AngelSlim is an open-source Python toolkit by Tencent designed for large-scale model compression and inference acceleration. It covers quantization, speculative decoding, and sparse attention to make massive models like Hunyuan and Qwen viable on constrained hardware setups.
1.6kstarsPython
From Video: Weekly AI Updates: Local Models, GPT-6 Astra, and Agent Architectures