Cukinator commited on
Commit
c0e3461
Β·
verified Β·
1 Parent(s): b1dda4f

README: rename _v3 section to Round 3 for consistency

Browse files
Files changed (1) hide show
  1. README.md +8 -6
README.md CHANGED
@@ -73,7 +73,8 @@ run_01 Transformer + BPE 16K + FP16 ← absolute baseline
73
  β”‚ └─ run_09 + PFNet (pfnet_hidden=32)
74
  β”‚ └─ run_10 + per-channel decay
75
  β”‚
76
- └─ r2 re-runs at 15 tok/param: run_04_r2, run_07_r2
 
77
  ```
78
 
79
  ### Round 1 β€” 2 tok/param
@@ -131,11 +132,12 @@ Training strategy is the only variable across runs.
131
 
132
  ---
133
 
134
- ## `_v3` high-resolution folders
135
 
136
- Dense step-by-step checkpoints from the v3 training run.
137
- Each file contains the full **bf16 model + bf16 optimizer state** β€” suitable for resuming training
138
- or inspecting the loss landscape at fine granularity.
 
139
 
140
  | Folder | Step checkpoints | Max step | Per-file size | Total size |
141
  |---|---|---|---|---|
@@ -152,7 +154,7 @@ or inspecting the loss landscape at fine granularity.
152
  | `run_14_v3/` | 75 | 9,775 | 61.3 MB | 4597 MB |
153
  | `run_15_v3/` | 70 | 2,350 | 61.5 MB | 4307 MB |
154
 
155
- > **Total _v3 storage:** 159.3 GB
156
 
157
  ---
158
 
 
73
  β”‚ └─ run_09 + PFNet (pfnet_hidden=32)
74
  β”‚ └─ run_10 + per-channel decay
75
  β”‚
76
+ β”œβ”€ r2 re-runs at 15 tok/param: run_04_r2, run_07_r2
77
+ └─ r3 step-by-step checkpoints (v3 run): run_XX_v3/
78
  ```
79
 
80
  ### Round 1 β€” 2 tok/param
 
132
 
133
  ---
134
 
135
+ ## Round 3 β€” step-by-step checkpoints (`_v3` folders)
136
 
137
+ Dense step-by-step checkpoints saved during the v3 training run.
138
+ Each file contains the full **bf16 model + bf16 optimizer state** β€” suitable for resuming
139
+ training at any logged step or inspecting the loss landscape at fine granularity.
140
+ No `_final.pt` files here: these are pure training-resume archives.
141
 
142
  | Folder | Step checkpoints | Max step | Per-file size | Total size |
143
  |---|---|---|---|---|
 
154
  | `run_14_v3/` | 75 | 9,775 | 61.3 MB | 4597 MB |
155
  | `run_15_v3/` | 70 | 2,350 | 61.5 MB | 4307 MB |
156
 
157
+ > **Round 3 total storage:** 159.3 GB
158
 
159
  ---
160