AaronLeeky commited on
Commit
f767916
·
verified ·
1 Parent(s): 06c18d4

Organize paper and updated checkpoints

Browse files
README.md CHANGED
@@ -11,14 +11,25 @@ tags:
11
 
12
  Official release checkpoints and benchmark artifacts for [OMG](https://github.com/Tsinghua-MARS-Lab/OMG).
13
 
14
- ## Checkpoints
15
 
16
  | Model | Training step | File |
17
  |---|---:|---|
18
- | OMG 50M | 90,000 | `checkpoints/50m/sstep=090000.ckpt` |
19
- | OMG 100M | 100,000 | `checkpoints/100m/sstep=100000.ckpt` |
20
- | OMG 300M | 55,000 | `checkpoints/300m/sstep=055000.ckpt` |
21
- | OMG 500M | 50,000 | `checkpoints/500m/sstep=050000.ckpt` |
 
 
 
 
 
 
 
 
 
 
 
22
 
23
  The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
24
 
@@ -29,4 +40,3 @@ The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
29
  - `SHA256SUMS`: checksums for release checkpoints and the evaluator.
30
 
31
  See the [OMG benchmark documentation](https://github.com/Tsinghua-MARS-Lab/OMG/blob/main/docs/benchmark.md) for evaluation commands and [OMG-Data](https://huggingface.co/datasets/THU-MARS/OMG-Data) for training data.
32
-
 
11
 
12
  Official release checkpoints and benchmark artifacts for [OMG](https://github.com/Tsinghua-MARS-Lab/OMG).
13
 
14
+ ## Paper Checkpoints
15
 
16
  | Model | Training step | File |
17
  |---|---:|---|
18
+ | OMG 50M | 90,000 | `checkpoints/paper/50m/sstep=090000.ckpt` |
19
+ | OMG 100M | 100,000 | `checkpoints/paper/100m/sstep=100000.ckpt` |
20
+ | OMG 300M | 55,000 | `checkpoints/paper/300m/sstep=055000.ckpt` |
21
+ | OMG 500M | 50,000 | `checkpoints/paper/500m/sstep=050000.ckpt` |
22
+
23
+ ## Updated Checkpoints
24
+
25
+ The updated checkpoints were trained with diffusion loss only on the omni-modal LeRobot dataset.
26
+
27
+ | Model | Training step | Status | File |
28
+ |---|---:|---|---|
29
+ | OMG 100M | 158,000 | Recommended | `updated/100m/sstep=158000.ckpt` |
30
+ | OMG 300M | 154,000 | Experimental | `updated/300m/sstep=154000.ckpt` |
31
+
32
+ The updated models improve the principal fixed-manifest text, audio-distribution, and HumanRef fidelity metrics over the paper 100M checkpoint. The 300M checkpoint remains experimental because simple-command rollout quality is not uniformly better than the updated 100M checkpoint.
33
 
34
  The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
35
 
 
40
  - `SHA256SUMS`: checksums for release checkpoints and the evaluator.
41
 
42
  See the [OMG benchmark documentation](https://github.com/Tsinghua-MARS-Lab/OMG/blob/main/docs/benchmark.md) for evaluation commands and [OMG-Data](https://huggingface.co/datasets/THU-MARS/OMG-Data) for training data.
 
SHA256SUMS CHANGED
@@ -1,5 +1,7 @@
1
- 5e25dc7fd7251ec6df9dda8d3e008ff2540a5c8d1d691c576d4c64f9916eedaa checkpoints/100m/sstep=100000.ckpt
2
- df4ce9aeced84fd96a39583c7f6e2c5773b76f942cb43012c6c51dd9eb806806 checkpoints/300m/sstep=055000.ckpt
3
- f13bc58f07f104fcff67e35e79650def0fec5a6eb62a193fa1ae9f979fb911cf checkpoints/500m/sstep=050000.ckpt
4
- 389fae1aa2ba31234e0ef621706362a19387ac485dce1f929408e06a3b012b2c checkpoints/50m/sstep=090000.ckpt
 
 
5
  e346790c5ce33c42840aa19f7fcc2891a4cab27e0d92e23bfaff7d48cb339c40 evaluator/step_004000.pt
 
1
+ 5e25dc7fd7251ec6df9dda8d3e008ff2540a5c8d1d691c576d4c64f9916eedaa checkpoints/paper/100m/sstep=100000.ckpt
2
+ df4ce9aeced84fd96a39583c7f6e2c5773b76f942cb43012c6c51dd9eb806806 checkpoints/paper/300m/sstep=055000.ckpt
3
+ f13bc58f07f104fcff67e35e79650def0fec5a6eb62a193fa1ae9f979fb911cf checkpoints/paper/500m/sstep=050000.ckpt
4
+ 389fae1aa2ba31234e0ef621706362a19387ac485dce1f929408e06a3b012b2c checkpoints/paper/50m/sstep=090000.ckpt
5
+ d45c93fb749bfe9d6e2875c60d40a6762c4777dca4f4f63eb59c6f1cdf106f52 updated/100m/sstep=158000.ckpt
6
+ 6c2520b76be7a4c76f7d2231d9832cb2c7b4130eb2e271115a52ce77b497ff7c updated/300m/sstep=154000.ckpt
7
  e346790c5ce33c42840aa19f7fcc2891a4cab27e0d92e23bfaff7d48cb339c40 evaluator/step_004000.pt
checkpoints/{100m → paper/100m}/sstep=100000.ckpt RENAMED
File without changes
checkpoints/{300m → paper/300m}/sstep=055000.ckpt RENAMED
File without changes
checkpoints/{500m → paper/500m}/sstep=050000.ckpt RENAMED
File without changes
checkpoints/{50m → paper/50m}/sstep=090000.ckpt RENAMED
File without changes