LiangJiang commited on
Commit
4652b0b
·
verified ·
1 Parent(s): c5a9888

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -18,7 +18,7 @@ base_model:
18
 
19
  ## Introduction
20
 
21
- Ring-lite is a fully open-source MoE LLM provided by InclusionAI, which has 16.8B parameters with 2.75B activated parameters. Ring-lite builds upon the publicly available [Ling-lite-1.5](https://huggingface.co/inclusionAI/Ling-lite-1.5) model, which contains 16.8 billion total parameters with 2.75 billion activated parameters. We use joint training pipeline combining knowledge distillation with reinforcement learning. Our model achieves performance comparable to state-of-the-art (SOTA) small-size reasoning models on challenging benchmarks (AIME, LiveCodeBench, and GPQA-Diamond) while activating only one-third of their parameters
22
 
23
 
24
 
 
18
 
19
  ## Introduction
20
 
21
+ Ring-lite is a fully open-source MoE LLM provided by InclusionAI, which has 16.8B parameters with 2.75B activated parameters. Ring-lite builds upon the publicly available [Ling-lite-1.5](https://huggingface.co/inclusionAI/Ling-lite-1.5) model, which contains 16.8 billion total parameters with 2.75 billion activated parameters. We use joint training pipeline combining knowledge distillation with reinforcement learning. Our model achieves performance comparable to state-of-the-art (SOTA) small-size reasoning models on challenging benchmarks (AIME, LiveCodeBench, and GPQA-Diamond) while activating only one-third of their parameters.
22
 
23
 
24