Update README.md
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ The continual pretraining was performed using Axolotl on the Leonardo EuroHPC sy
|
|
| 21 |
**Adapter type:** LoRA
|
| 22 |
**Precision:** bfloat16
|
| 23 |
**Hardware:** 8 nodes × 2 × NVIDIA A100 64GB GPUs
|
| 24 |
-
**Framework:** DeepSpeed ZeRO-1, Axolotl, PyTorch 2.5.1+cu121
|
| 25 |
**Runtime:** ~24 hours
|
| 26 |
**Checkpoints:** Saved every 1/5 of an epoch
|
| 27 |
|
|
|
|
| 21 |
**Adapter type:** LoRA
|
| 22 |
**Precision:** bfloat16
|
| 23 |
**Hardware:** 8 nodes × 2 × NVIDIA A100 64GB GPUs
|
| 24 |
+
**Framework:** DeepSpeed ZeRO-1, Axolotl, PyTorch 2.5.1+cu121
|
| 25 |
**Runtime:** ~24 hours
|
| 26 |
**Checkpoints:** Saved every 1/5 of an epoch
|
| 27 |
|