English
n-gram
olmo-core
language-modeling

Card: lead the resume note with --ignore-data-fingerprints

#2
Files changed (1) hide show
  1. README.md +3 -4
README.md CHANGED
@@ -71,10 +71,9 @@ torchrun --standalone --nproc-per-node=1 olmo-core/src/scripts/train/ladder/coun
71
  --count-k 8 --count-max-order 6 --count-num-orders 6
72
  ```
73
 
74
- Evaluation loads model weights only. Resuming training also restores the optimizer and trainer state.
75
- The trainer state records a fingerprint of the data paths the model was trained on, and the code
76
- refuses to resume on data whose fingerprint differs; when your tokenized data is the same corpus at
77
- different paths, pass `--ignore-data-fingerprints`.
78
 
79
  ## Related
80
 
 
71
  --count-k 8 --count-max-order 6 --count-num-orders 6
72
  ```
73
 
74
+ Evaluation loads model weights only. To resume training on your own copy of the tokenized data,
75
+ pass `--ignore-data-fingerprints`: the checkpoints record a fingerprint of the data paths they were
76
+ trained on, and without the flag the code refuses to resume from different paths.
 
77
 
78
  ## Related
79