qiuly commited on
Commit
74d58d0
Β·
verified Β·
1 Parent(s): bd9a7fc

Add files using upload-large-folder tool

Browse files
README.md CHANGED
@@ -40,7 +40,9 @@ m1_mix_submit/
40
  β”œβ”€β”€ README.md # this file
41
  β”œβ”€β”€ task_instructions.json # verbatim --global_task per task + scores
42
  β”œβ”€β”€ checkpoint/
43
- β”‚ └── m1_mix_final_step50000.pt # 15.3 GB full training checkpoint (see below)
 
 
44
  β”œβ”€β”€ norm_stats/
45
  β”‚ └── norm_stats.json # min-max state/action stats β†’ [-1, 1]
46
  β”œβ”€β”€ configs/
@@ -58,7 +60,18 @@ m1_mix_submit/
58
 
59
  ### About the checkpoint
60
 
61
- `checkpoint/m1_mix_final_step50000.pt` is the **full training checkpoint** at step 50000:
 
 
 
 
 
 
 
 
 
 
 
62
 
63
  | key | content |
64
  |------------------------|----------------------------------------------------------------------|
 
40
  β”œβ”€β”€ README.md # this file
41
  β”œβ”€β”€ task_instructions.json # verbatim --global_task per task + scores
42
  β”œβ”€β”€ checkpoint/
43
+ β”‚ β”œβ”€β”€ m1_mix_final_step50000.pt.part00 … part03 # 15.3 GB full training ckpt, split into 4×≀4 GB parts
44
+ β”‚ β”œβ”€β”€ m1_mix_final_step50000.pt.sha256 # SHA-256 of the reassembled checkpoint
45
+ β”‚ └── README_REASSEMBLE.md # how to cat the parts back together + verify
46
  β”œβ”€β”€ norm_stats/
47
  β”‚ └── norm_stats.json # min-max state/action stats β†’ [-1, 1]
48
  β”œβ”€β”€ configs/
 
60
 
61
  ### About the checkpoint
62
 
63
+ > **Reassemble first.** The 15.3 GB checkpoint is uploaded as 4 byte-split parts
64
+ > (`m1_mix_final_step50000.pt.part00…03`) because the upload path capped single files at
65
+ > ~9.7 GB. Concatenation reproduces the original **bit-for-bit**:
66
+ >
67
+ > ```bash
68
+ > cat m1_mix_final_step50000.pt.part?? > m1_mix_final_step50000.pt
69
+ > sha256sum -c m1_mix_final_step50000.pt.sha256 # -> m1_mix_final_step50000.pt: OK
70
+ > ```
71
+ >
72
+ > See `checkpoint/README_REASSEMBLE.md` for details.
73
+
74
+ Once reassembled, `m1_mix_final_step50000.pt` is the **full training checkpoint** at step 50000:
75
 
76
  | key | content |
77
  |------------------------|----------------------------------------------------------------------|
checkpoint/README_REASSEMBLE.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Reassembling the checkpoint
2
+
3
+ The full training checkpoint `m1_mix_final_step50000.pt` (15.3 GB) is uploaded as **4
4
+ byte-split parts** because the upload path capped single files at ~9.7 GB. The parts are a
5
+ plain `split -b 4G` of the original file, so concatenating them in order reproduces the
6
+ checkpoint **bit-for-bit**.
7
+
8
+ | part | size |
9
+ |-----------------------------------------|-----------|
10
+ | `m1_mix_final_step50000.pt.part00` | 4.0 GiB |
11
+ | `m1_mix_final_step50000.pt.part01` | 4.0 GiB |
12
+ | `m1_mix_final_step50000.pt.part02` | 4.0 GiB |
13
+ | `m1_mix_final_step50000.pt.part03` | ~2.25 GiB |
14
+
15
+ ## 1. Reassemble
16
+
17
+ ```bash
18
+ cat m1_mix_final_step50000.pt.part?? > m1_mix_final_step50000.pt
19
+ ```
20
+
21
+ (`part??` expands to `part00 part01 part02 part03` in sorted order.)
22
+
23
+ ## 2. Verify integrity
24
+
25
+ ```bash
26
+ sha256sum -c m1_mix_final_step50000.pt.sha256
27
+ # expected: m1_mix_final_step50000.pt: OK
28
+ ```
29
+
30
+ The expected SHA-256 of the full file is:
31
+
32
+ ```
33
+ df149a0d27c85ad76217552c4005bee0094f6068fdb92bd9f6b256190f5aa09a
34
+ ```
35
+
36
+ ## 3. Load
37
+
38
+ Load as usual β€” the deploy loader reads `payload["model_state_dict"]` and calls
39
+ `load_state_dict(..., strict=False)`. See the top-level `README.md` for the full
40
+ inference / evaluation instructions and the optional inference-only slimming snippet.
checkpoint/m1_mix_final_step50000.pt.sha256 ADDED
@@ -0,0 +1 @@
 
 
1
+ df149a0d27c85ad76217552c4005bee0094f6068fdb92bd9f6b256190f5aa09a m1_mix_final_step50000.pt