Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,10 @@ tags:
|
|
| 4 |
- prime-rl
|
| 5 |
- verifiers
|
| 6 |
- prime-intellect
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
license: mit
|
| 8 |
language:
|
| 9 |
- en
|
|
@@ -14,24 +18,45 @@ pipeline_tag: text-generation
|
|
| 14 |
|
| 15 |
# INTELLECT-3
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
**INTELLECT-3** is a 106B (A12B) parameter Mixture-of-Experts reasoning model post-trained from [GLM-4.5-Air-Base](https://huggingface.co/zai-org/GLM-4.5-Air-Base) using supervised fine-tuning (SFT) followed by large-scale reinforcement learning (RL).
|
| 18 |
|
| 19 |
-
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
The model, training frameworks, and environments are open-sourced under fully-permissive licenses (MIT and Apache 2.0).
|
| 22 |
|
| 23 |
-
For more details, see the [technical report](
|
| 24 |
|
| 25 |
## Evaluation
|
| 26 |
|
| 27 |
INTELLECT-3 achieves best-in-class performance on math, coding, and reasoning benchmarks:
|
| 28 |
|
| 29 |
-
| Benchmark |
|
| 30 |
-
|
| 31 |
-
|
|
| 32 |
-
|
|
| 33 |
-
|
|
| 34 |
-
|
|
|
|
|
|
|
|
| 35 |
|
| 36 |
## Model Variants
|
| 37 |
|
|
@@ -67,4 +92,4 @@ vllm serve PrimeIntellect/INTELLECT-3-FP8 \
|
|
| 67 |
year={2025},
|
| 68 |
url={https://huggingface.co/PrimeIntellect/INTELLECT-3}
|
| 69 |
}
|
| 70 |
-
```
|
|
|
|
| 4 |
- prime-rl
|
| 5 |
- verifiers
|
| 6 |
- prime-intellect
|
| 7 |
+
- reinforcement-learning
|
| 8 |
+
- reasoning
|
| 9 |
+
- agentic
|
| 10 |
+
- mixture-of-experts
|
| 11 |
license: mit
|
| 12 |
language:
|
| 13 |
- en
|
|
|
|
| 18 |
|
| 19 |
# INTELLECT-3
|
| 20 |
|
| 21 |
+
<div align="center">
|
| 22 |
+
<img src="pi_logo.png" alt="Prime Intellect Logo" width="100px"/>
|
| 23 |
+
</div>
|
| 24 |
+
|
| 25 |
+
<p align="center">
|
| 26 |
+
🚀 <strong>State-of-the-art 100B+ parameter Mixture-of-Experts model trained with large-scale reinforcement learning</strong>
|
| 27 |
+
<br><br>
|
| 28 |
+
Trained with <a href="https://github.com/PrimeIntellect-ai/prime-rl">prime-rl</a> infra and <a href="https://github.com/PrimeIntellect-ai/verifiers">verifiers</a> environments
|
| 29 |
+
<br>
|
| 30 |
+
Environments on <a href="https://app.primeintellect.ai/dashboard/environments">Environments Hub</a> | Read the <a href="https://primeintellect.ai/blog/intellect-3">Blog</a> & <a href="https://huggingface.co/PrimeIntellect/INTELLECT-3">Technical Report</a>
|
| 31 |
+
<br>
|
| 32 |
+
<a href="https://discord.gg/RC5GvMbfDf">X</a> | <a href="https://discord.gg/RC5GvMbfDf">Discord</a> | <a href="https://app.primeintellect.ai/dashboard/create-cluster">Prime Compute Platform</a>
|
| 33 |
+
</p>
|
| 34 |
+
|
| 35 |
+
## Introduction
|
| 36 |
+
|
| 37 |
**INTELLECT-3** is a 106B (A12B) parameter Mixture-of-Experts reasoning model post-trained from [GLM-4.5-Air-Base](https://huggingface.co/zai-org/GLM-4.5-Air-Base) using supervised fine-tuning (SFT) followed by large-scale reinforcement learning (RL).
|
| 38 |
|
| 39 |
+

|
| 40 |
+
|
| 41 |
+
Training was performed with [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) using environments built with the [verifiers](https://github.com/PrimeIntellect-ai/verifiers) library.
|
| 42 |
+
All training and evaluation environments are available on the [Environments Hub](https://app.primeintellect.ai/dashboard/environments).
|
| 43 |
|
| 44 |
The model, training frameworks, and environments are open-sourced under fully-permissive licenses (MIT and Apache 2.0).
|
| 45 |
|
| 46 |
+
For more details, see the [technical report](https://huggingface.co/PrimeIntellect/INTELLECT-3).
|
| 47 |
|
| 48 |
## Evaluation
|
| 49 |
|
| 50 |
INTELLECT-3 achieves best-in-class performance on math, coding, and reasoning benchmarks:
|
| 51 |
|
| 52 |
+
| Benchmark | MATH-500 | AIME24 | AIME25 | LCB | GPQA | HLE | MMLU-Pro |
|
| 53 |
+
|-----------|----------|---------|---------|--------|------|-----|----------|
|
| 54 |
+
| INTELLECT-3 | **98.1** | **90.8** | **88.0** | 69.3 | 74.4 | 14.6 | 81.9 |
|
| 55 |
+
| GLM-4.5-Air | 97.8 | 84.6 | 82.0 | 61.5 | 73.3 | 13.3 | 73.9 |
|
| 56 |
+
| GLM-4.5 | 97.0 | 85.8 | 83.3 | 64.5 | 77.0 | X | X |
|
| 57 |
+
| DeepSeek R1 0528 | 87.3 | 83.2 | 73.4 | 62.5 | 77.5 | 15.9 | 75.3 |
|
| 58 |
+
| DeepSeek v3.2 | 96.8 | 88.1 | 84.7 | **71.6** | **81.4** | **17.9** | **84.6** |
|
| 59 |
+
| GPT-O5S 120B | 96.0 | 75.8 | 77.7 | 69.9 | 70.0 | 10.6 | 67.1 |
|
| 60 |
|
| 61 |
## Model Variants
|
| 62 |
|
|
|
|
| 92 |
year={2025},
|
| 93 |
url={https://huggingface.co/PrimeIntellect/INTELLECT-3}
|
| 94 |
}
|
| 95 |
+
```
|