Add files using upload-large-folder tool
Browse files- README.md +15 -2
- checkpoint/README_REASSEMBLE.md +40 -0
- checkpoint/m1_mix_final_step50000.pt.sha256 +1 -0
README.md
CHANGED
|
@@ -40,7 +40,9 @@ m1_mix_submit/
|
|
| 40 |
βββ README.md # this file
|
| 41 |
βββ task_instructions.json # verbatim --global_task per task + scores
|
| 42 |
βββ checkpoint/
|
| 43 |
-
β
|
|
|
|
|
|
|
| 44 |
βββ norm_stats/
|
| 45 |
β βββ norm_stats.json # min-max state/action stats β [-1, 1]
|
| 46 |
βββ configs/
|
|
@@ -58,7 +60,18 @@ m1_mix_submit/
|
|
| 58 |
|
| 59 |
### About the checkpoint
|
| 60 |
|
| 61 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
| key | content |
|
| 64 |
|------------------------|----------------------------------------------------------------------|
|
|
|
|
| 40 |
βββ README.md # this file
|
| 41 |
βββ task_instructions.json # verbatim --global_task per task + scores
|
| 42 |
βββ checkpoint/
|
| 43 |
+
β βββ m1_mix_final_step50000.pt.part00 β¦ part03 # 15.3 GB full training ckpt, split into 4Γβ€4 GB parts
|
| 44 |
+
β βββ m1_mix_final_step50000.pt.sha256 # SHA-256 of the reassembled checkpoint
|
| 45 |
+
β βββ README_REASSEMBLE.md # how to cat the parts back together + verify
|
| 46 |
βββ norm_stats/
|
| 47 |
β βββ norm_stats.json # min-max state/action stats β [-1, 1]
|
| 48 |
βββ configs/
|
|
|
|
| 60 |
|
| 61 |
### About the checkpoint
|
| 62 |
|
| 63 |
+
> **Reassemble first.** The 15.3 GB checkpoint is uploaded as 4 byte-split parts
|
| 64 |
+
> (`m1_mix_final_step50000.pt.part00β¦03`) because the upload path capped single files at
|
| 65 |
+
> ~9.7 GB. Concatenation reproduces the original **bit-for-bit**:
|
| 66 |
+
>
|
| 67 |
+
> ```bash
|
| 68 |
+
> cat m1_mix_final_step50000.pt.part?? > m1_mix_final_step50000.pt
|
| 69 |
+
> sha256sum -c m1_mix_final_step50000.pt.sha256 # -> m1_mix_final_step50000.pt: OK
|
| 70 |
+
> ```
|
| 71 |
+
>
|
| 72 |
+
> See `checkpoint/README_REASSEMBLE.md` for details.
|
| 73 |
+
|
| 74 |
+
Once reassembled, `m1_mix_final_step50000.pt` is the **full training checkpoint** at step 50000:
|
| 75 |
|
| 76 |
| key | content |
|
| 77 |
|------------------------|----------------------------------------------------------------------|
|
checkpoint/README_REASSEMBLE.md
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Reassembling the checkpoint
|
| 2 |
+
|
| 3 |
+
The full training checkpoint `m1_mix_final_step50000.pt` (15.3 GB) is uploaded as **4
|
| 4 |
+
byte-split parts** because the upload path capped single files at ~9.7 GB. The parts are a
|
| 5 |
+
plain `split -b 4G` of the original file, so concatenating them in order reproduces the
|
| 6 |
+
checkpoint **bit-for-bit**.
|
| 7 |
+
|
| 8 |
+
| part | size |
|
| 9 |
+
|-----------------------------------------|-----------|
|
| 10 |
+
| `m1_mix_final_step50000.pt.part00` | 4.0 GiB |
|
| 11 |
+
| `m1_mix_final_step50000.pt.part01` | 4.0 GiB |
|
| 12 |
+
| `m1_mix_final_step50000.pt.part02` | 4.0 GiB |
|
| 13 |
+
| `m1_mix_final_step50000.pt.part03` | ~2.25 GiB |
|
| 14 |
+
|
| 15 |
+
## 1. Reassemble
|
| 16 |
+
|
| 17 |
+
```bash
|
| 18 |
+
cat m1_mix_final_step50000.pt.part?? > m1_mix_final_step50000.pt
|
| 19 |
+
```
|
| 20 |
+
|
| 21 |
+
(`part??` expands to `part00 part01 part02 part03` in sorted order.)
|
| 22 |
+
|
| 23 |
+
## 2. Verify integrity
|
| 24 |
+
|
| 25 |
+
```bash
|
| 26 |
+
sha256sum -c m1_mix_final_step50000.pt.sha256
|
| 27 |
+
# expected: m1_mix_final_step50000.pt: OK
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
The expected SHA-256 of the full file is:
|
| 31 |
+
|
| 32 |
+
```
|
| 33 |
+
df149a0d27c85ad76217552c4005bee0094f6068fdb92bd9f6b256190f5aa09a
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
+
## 3. Load
|
| 37 |
+
|
| 38 |
+
Load as usual β the deploy loader reads `payload["model_state_dict"]` and calls
|
| 39 |
+
`load_state_dict(..., strict=False)`. See the top-level `README.md` for the full
|
| 40 |
+
inference / evaluation instructions and the optional inference-only slimming snippet.
|
checkpoint/m1_mix_final_step50000.pt.sha256
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
df149a0d27c85ad76217552c4005bee0094f6068fdb92bd9f6b256190f5aa09a m1_mix_final_step50000.pt
|