Card: lead the resume note with --ignore-data-fingerprints
#2
by IanMagnusson - opened
README.md
CHANGED
|
@@ -71,10 +71,9 @@ torchrun --standalone --nproc-per-node=1 olmo-core/src/scripts/train/ladder/coun
|
|
| 71 |
--count-k 8 --count-max-order 6 --count-num-orders 6
|
| 72 |
```
|
| 73 |
|
| 74 |
-
Evaluation loads model weights only.
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
different paths, pass `--ignore-data-fingerprints`.
|
| 78 |
|
| 79 |
## Related
|
| 80 |
|
|
|
|
| 71 |
--count-k 8 --count-max-order 6 --count-num-orders 6
|
| 72 |
```
|
| 73 |
|
| 74 |
+
Evaluation loads model weights only. To resume training on your own copy of the tokenized data,
|
| 75 |
+
pass `--ignore-data-fingerprints`: the checkpoints record a fingerprint of the data paths they were
|
| 76 |
+
trained on, and without the flag the code refuses to resume from different paths.
|
|
|
|
| 77 |
|
| 78 |
## Related
|
| 79 |
|