Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,11 @@ base_model:
|
|
| 19 |
<img src="./Solar-Open-69B-REAP.png" alt="Solar Open 69B REAP" width="100%">
|
| 20 |
</p>
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
# Solar Open to 69B REAP
|
| 23 |
|
| 24 |
This repository contains a pruned version of Upstage's flagship Solar-Open-100B. Using **REAP (Router Expert Activation Pruning)**, the model has been compressed from its original size to a highly efficient **69B parameter** model.
|
|
@@ -53,8 +58,6 @@ Any future REAP uploads to this profile will include specialized experts for:
|
|
| 53 |
* Function-calling
|
| 54 |
* SWE-environment (Software Engineering)
|
| 55 |
|
| 56 |
-
> [!NOTE]
|
| 57 |
-
> Due to the specific pruning focus, this current version is **not optimized for math**.
|
| 58 |
|
| 59 |
---
|
| 60 |
|
|
|
|
| 19 |
<img src="./Solar-Open-69B-REAP.png" alt="Solar Open 69B REAP" width="100%">
|
| 20 |
</p>
|
| 21 |
|
| 22 |
+
> [!NOTE]
|
| 23 |
+
> Due to the specific pruning focus, this current version is **not optimized for math**.
|
| 24 |
+
|
| 25 |
+
|
| 26 |
+
|
| 27 |
# Solar Open to 69B REAP
|
| 28 |
|
| 29 |
This repository contains a pruned version of Upstage's flagship Solar-Open-100B. Using **REAP (Router Expert Activation Pruning)**, the model has been compressed from its original size to a highly efficient **69B parameter** model.
|
|
|
|
| 58 |
* Function-calling
|
| 59 |
* SWE-environment (Software Engineering)
|
| 60 |
|
|
|
|
|
|
|
| 61 |
|
| 62 |
---
|
| 63 |
|