Classify phase 2 as continued pretraining refinement
Browse files
README.md
CHANGED
|
@@ -5,13 +5,12 @@ language:
|
|
| 5 |
- en
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
tags:
|
| 8 |
-
-
|
| 9 |
-
-
|
| 10 |
- tr-hash
|
| 11 |
- mixture-of-experts
|
| 12 |
- gqa
|
| 13 |
- custom-code
|
| 14 |
-
base_model: AETHORIA-AI/TR-HASH-MoE-200M-130B
|
| 15 |
---
|
| 16 |
|
| 17 |
# TR-HASH MoE 200M — Interrupted 160B-Token Refinement Checkpoint
|
|
|
|
| 5 |
- en
|
| 6 |
pipeline_tag: text-generation
|
| 7 |
tags:
|
| 8 |
+
- continued-pretraining
|
| 9 |
+
- refinement
|
| 10 |
- tr-hash
|
| 11 |
- mixture-of-experts
|
| 12 |
- gqa
|
| 13 |
- custom-code
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
# TR-HASH MoE 200M — Interrupted 160B-Token Refinement Checkpoint
|