Organize paper and updated checkpoints
Browse files
README.md
CHANGED
|
@@ -11,14 +11,25 @@ tags:
|
|
| 11 |
|
| 12 |
Official release checkpoints and benchmark artifacts for [OMG](https://github.com/Tsinghua-MARS-Lab/OMG).
|
| 13 |
|
| 14 |
-
## Checkpoints
|
| 15 |
|
| 16 |
| Model | Training step | File |
|
| 17 |
|---|---:|---|
|
| 18 |
-
| OMG 50M | 90,000 | `checkpoints/50m/sstep=090000.ckpt` |
|
| 19 |
-
| OMG 100M | 100,000 | `checkpoints/100m/sstep=100000.ckpt` |
|
| 20 |
-
| OMG 300M | 55,000 | `checkpoints/300m/sstep=055000.ckpt` |
|
| 21 |
-
| OMG 500M | 50,000 | `checkpoints/500m/sstep=050000.ckpt` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
|
| 24 |
|
|
@@ -29,4 +40,3 @@ The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
|
|
| 29 |
- `SHA256SUMS`: checksums for release checkpoints and the evaluator.
|
| 30 |
|
| 31 |
See the [OMG benchmark documentation](https://github.com/Tsinghua-MARS-Lab/OMG/blob/main/docs/benchmark.md) for evaluation commands and [OMG-Data](https://huggingface.co/datasets/THU-MARS/OMG-Data) for training data.
|
| 32 |
-
|
|
|
|
| 11 |
|
| 12 |
Official release checkpoints and benchmark artifacts for [OMG](https://github.com/Tsinghua-MARS-Lab/OMG).
|
| 13 |
|
| 14 |
+
## Paper Checkpoints
|
| 15 |
|
| 16 |
| Model | Training step | File |
|
| 17 |
|---|---:|---|
|
| 18 |
+
| OMG 50M | 90,000 | `checkpoints/paper/50m/sstep=090000.ckpt` |
|
| 19 |
+
| OMG 100M | 100,000 | `checkpoints/paper/100m/sstep=100000.ckpt` |
|
| 20 |
+
| OMG 300M | 55,000 | `checkpoints/paper/300m/sstep=055000.ckpt` |
|
| 21 |
+
| OMG 500M | 50,000 | `checkpoints/paper/500m/sstep=050000.ckpt` |
|
| 22 |
+
|
| 23 |
+
## Updated Checkpoints
|
| 24 |
+
|
| 25 |
+
The updated checkpoints were trained with diffusion loss only on the omni-modal LeRobot dataset.
|
| 26 |
+
|
| 27 |
+
| Model | Training step | Status | File |
|
| 28 |
+
|---|---:|---|---|
|
| 29 |
+
| OMG 100M | 158,000 | Recommended | `updated/100m/sstep=158000.ckpt` |
|
| 30 |
+
| OMG 300M | 154,000 | Experimental | `updated/300m/sstep=154000.ckpt` |
|
| 31 |
+
|
| 32 |
+
The updated models improve the principal fixed-manifest text, audio-distribution, and HumanRef fidelity metrics over the paper 100M checkpoint. The 300M checkpoint remains experimental because simple-command rollout quality is not uniformly better than the updated 100M checkpoint.
|
| 33 |
|
| 34 |
The pretrained benchmark evaluator is stored at `evaluator/step_004000.pt`.
|
| 35 |
|
|
|
|
| 40 |
- `SHA256SUMS`: checksums for release checkpoints and the evaluator.
|
| 41 |
|
| 42 |
See the [OMG benchmark documentation](https://github.com/Tsinghua-MARS-Lab/OMG/blob/main/docs/benchmark.md) for evaluation commands and [OMG-Data](https://huggingface.co/datasets/THU-MARS/OMG-Data) for training data.
|
|
|
SHA256SUMS
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
-
5e25dc7fd7251ec6df9dda8d3e008ff2540a5c8d1d691c576d4c64f9916eedaa checkpoints/100m/sstep=100000.ckpt
|
| 2 |
-
df4ce9aeced84fd96a39583c7f6e2c5773b76f942cb43012c6c51dd9eb806806 checkpoints/300m/sstep=055000.ckpt
|
| 3 |
-
f13bc58f07f104fcff67e35e79650def0fec5a6eb62a193fa1ae9f979fb911cf checkpoints/500m/sstep=050000.ckpt
|
| 4 |
-
389fae1aa2ba31234e0ef621706362a19387ac485dce1f929408e06a3b012b2c checkpoints/50m/sstep=090000.ckpt
|
|
|
|
|
|
|
| 5 |
e346790c5ce33c42840aa19f7fcc2891a4cab27e0d92e23bfaff7d48cb339c40 evaluator/step_004000.pt
|
|
|
|
| 1 |
+
5e25dc7fd7251ec6df9dda8d3e008ff2540a5c8d1d691c576d4c64f9916eedaa checkpoints/paper/100m/sstep=100000.ckpt
|
| 2 |
+
df4ce9aeced84fd96a39583c7f6e2c5773b76f942cb43012c6c51dd9eb806806 checkpoints/paper/300m/sstep=055000.ckpt
|
| 3 |
+
f13bc58f07f104fcff67e35e79650def0fec5a6eb62a193fa1ae9f979fb911cf checkpoints/paper/500m/sstep=050000.ckpt
|
| 4 |
+
389fae1aa2ba31234e0ef621706362a19387ac485dce1f929408e06a3b012b2c checkpoints/paper/50m/sstep=090000.ckpt
|
| 5 |
+
d45c93fb749bfe9d6e2875c60d40a6762c4777dca4f4f63eb59c6f1cdf106f52 updated/100m/sstep=158000.ckpt
|
| 6 |
+
6c2520b76be7a4c76f7d2231d9832cb2c7b4130eb2e271115a52ce77b497ff7c updated/300m/sstep=154000.ckpt
|
| 7 |
e346790c5ce33c42840aa19f7fcc2891a4cab27e0d92e23bfaff7d48cb339c40 evaluator/step_004000.pt
|
checkpoints/{100m → paper/100m}/sstep=100000.ckpt
RENAMED
|
File without changes
|
checkpoints/{300m → paper/300m}/sstep=055000.ckpt
RENAMED
|
File without changes
|
checkpoints/{500m → paper/500m}/sstep=050000.ckpt
RENAMED
|
File without changes
|
checkpoints/{50m → paper/50m}/sstep=090000.ckpt
RENAMED
|
File without changes
|