MrPibb commited on
Commit
ea623e5
·
verified ·
1 Parent(s): f00a276

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -32,7 +32,6 @@ KillChain-8B is intended for:
32
 
33
  ### Training hyperparameters
34
 
35
- The following hyperparameters were used during training:
36
  - learning_rate: 1.5e-05
37
  - train_batch_size: 4
38
  - eval_batch_size: 4
@@ -54,7 +53,14 @@ The following hyperparameters were used during training:
54
  - Datasets 4.0.0
55
  - Tokenizers 0.22.1
56
 
57
- Command used: accelerate launch --num_processes=4 -m axolotl.cli.train config.yaml
 
 
 
 
 
 
 
58
  [<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
59
  <details><summary>See axolotl config</summary>
60
 
 
32
 
33
  ### Training hyperparameters
34
 
 
35
  - learning_rate: 1.5e-05
36
  - train_batch_size: 4
37
  - eval_batch_size: 4
 
53
  - Datasets 4.0.0
54
  - Tokenizers 0.22.1
55
 
56
+ ### Equipment used for training, ~1 hour real time
57
+
58
+ 4x NVIDIA H200 SXM
59
+ ![Screenshot 2026-01-05 at 7.34.18 AM](https://cdn-uploads.huggingface.co/production/uploads/69592e81fb23588772201200/hzkzkHg_76QFY44wcR5lQ.png)
60
+
61
+
62
+ ### Axolotl Config
63
+
64
  [<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
65
  <details><summary>See axolotl config</summary>
66