README: rename _v3 section to Round 3 for consistency
Browse files
README.md
CHANGED
|
@@ -73,7 +73,8 @@ run_01 Transformer + BPE 16K + FP16 β absolute baseline
|
|
| 73 |
β ββ run_09 + PFNet (pfnet_hidden=32)
|
| 74 |
β ββ run_10 + per-channel decay
|
| 75 |
β
|
| 76 |
-
|
|
|
|
| 77 |
```
|
| 78 |
|
| 79 |
### Round 1 β 2 tok/param
|
|
@@ -131,11 +132,12 @@ Training strategy is the only variable across runs.
|
|
| 131 |
|
| 132 |
---
|
| 133 |
|
| 134 |
-
## `_v3`
|
| 135 |
|
| 136 |
-
Dense step-by-step checkpoints
|
| 137 |
-
Each file contains the full **bf16 model + bf16 optimizer state** β suitable for resuming
|
| 138 |
-
or inspecting the loss landscape at fine granularity.
|
|
|
|
| 139 |
|
| 140 |
| Folder | Step checkpoints | Max step | Per-file size | Total size |
|
| 141 |
|---|---|---|---|---|
|
|
@@ -152,7 +154,7 @@ or inspecting the loss landscape at fine granularity.
|
|
| 152 |
| `run_14_v3/` | 75 | 9,775 | 61.3 MB | 4597 MB |
|
| 153 |
| `run_15_v3/` | 70 | 2,350 | 61.5 MB | 4307 MB |
|
| 154 |
|
| 155 |
-
> **
|
| 156 |
|
| 157 |
---
|
| 158 |
|
|
|
|
| 73 |
β ββ run_09 + PFNet (pfnet_hidden=32)
|
| 74 |
β ββ run_10 + per-channel decay
|
| 75 |
β
|
| 76 |
+
ββ r2 re-runs at 15 tok/param: run_04_r2, run_07_r2
|
| 77 |
+
ββ r3 step-by-step checkpoints (v3 run): run_XX_v3/
|
| 78 |
```
|
| 79 |
|
| 80 |
### Round 1 β 2 tok/param
|
|
|
|
| 132 |
|
| 133 |
---
|
| 134 |
|
| 135 |
+
## Round 3 β step-by-step checkpoints (`_v3` folders)
|
| 136 |
|
| 137 |
+
Dense step-by-step checkpoints saved during the v3 training run.
|
| 138 |
+
Each file contains the full **bf16 model + bf16 optimizer state** β suitable for resuming
|
| 139 |
+
training at any logged step or inspecting the loss landscape at fine granularity.
|
| 140 |
+
No `_final.pt` files here: these are pure training-resume archives.
|
| 141 |
|
| 142 |
| Folder | Step checkpoints | Max step | Per-file size | Total size |
|
| 143 |
|---|---|---|---|---|
|
|
|
|
| 154 |
| `run_14_v3/` | 75 | 9,775 | 61.3 MB | 4597 MB |
|
| 155 |
| `run_15_v3/` | 70 | 2,350 | 61.5 MB | 4307 MB |
|
| 156 |
|
| 157 |
+
> **Round 3 total storage:** 159.3 GB
|
| 158 |
|
| 159 |
---
|
| 160 |
|