Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,8 @@
|
|
| 11 |
|
| 12 |
`commandr-35b-cpt` is a **continual-pretrained** version of Cohere's Command-R 35B model, trained with LoRA adapters for efficient enregy doman adaptation.
|
| 13 |
The goal of CPT is to extend the model’s general reasoning, factual grounding, and domain knowledge across science, governance, and energy-domain text.
|
| 14 |
-
|
|
|
|
| 15 |
|
| 16 |
---
|
| 17 |
|
|
|
|
| 11 |
|
| 12 |
`commandr-35b-cpt` is a **continual-pretrained** version of Cohere's Command-R 35B model, trained with LoRA adapters for efficient enregy doman adaptation.
|
| 13 |
The goal of CPT is to extend the model’s general reasoning, factual grounding, and domain knowledge across science, governance, and energy-domain text.
|
| 14 |
+
|
| 15 |
+
Training was performed on the **Leonardo EuroHPC** system using Axolotl with DeepSpeed ZeRO-1 optimization.
|
| 16 |
|
| 17 |
---
|
| 18 |
|