Repository:inclusionAI/Ling
Ling: Open-Source Mixture-of-Experts LLMs by InclusionAI
InclusionAI has open-sourced Ling, a family of Mixture-of-Experts (MoE) large language models. The suite is offered in two sizes: Ling-lite with 16.8 billion total parameters (2.75 billion activated) and Ling-plus with 290 billion total parameters (28.8 billion activated).
267starsPython