kosmylo1992 commited on
Commit
ace4381
·
verified ·
1 Parent(s): ec6b87f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -11,7 +11,8 @@
11
 
12
  `commandr-35b-cpt` is a **continual-pretrained** version of Cohere's Command-R 35B model, trained with LoRA adapters for efficient enregy doman adaptation.
13
  The goal of CPT is to extend the model’s general reasoning, factual grounding, and domain knowledge across science, governance, and energy-domain text.
14
- The continual pretraining was performed using Axolotl on the Leonardo EuroHPC system.
 
15
 
16
  ---
17
 
 
11
 
12
  `commandr-35b-cpt` is a **continual-pretrained** version of Cohere's Command-R 35B model, trained with LoRA adapters for efficient enregy doman adaptation.
13
  The goal of CPT is to extend the model’s general reasoning, factual grounding, and domain knowledge across science, governance, and energy-domain text.
14
+
15
+ Training was performed on the **Leonardo EuroHPC** system using Axolotl with DeepSpeed ZeRO-1 optimization.
16
 
17
  ---
18