Add files using upload-large-folder tool
Browse files- README.md +89 -0
- SHA256SUMS +11 -0
- third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt +3 -0
- third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt +3 -0
- third_party/DrivoR/ckpts/drivor_baseline.ckpt +3 -0
- third_party/DrivoR/ckpts/drivor_sdroute.ckpt +3 -0
- third_party/SafeDrive/ckpts/safedrive_baseline.ckpt +3 -0
- third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt +3 -0
- third_party/navsim/ckpts/ltf_baseline.ckpt +3 -0
- third_party/navsim/ckpts/ltf_sdroute.ckpt +3 -0
- third_party/recogdrive/ckpts/recogdrive_baseline.ckpt +3 -0
- third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt +3 -0
- third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt +3 -0
README.md
ADDED
|
@@ -0,0 +1,89 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: cc-by-nc-sa-4.0-and-apache-2.0
|
| 4 |
+
license_link: https://huggingface.co/ADRLAB/odyssey-models#license
|
| 5 |
+
tags:
|
| 6 |
+
- autonomous-driving
|
| 7 |
+
- end-to-end-driving
|
| 8 |
+
- motion-planning
|
| 9 |
+
- navsim
|
| 10 |
+
- pytorch-lightning
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# Odyssey Models
|
| 14 |
+
|
| 15 |
+
Checkpoints of the end-to-end driving planners evaluated in the **Odyssey** closed-loop benchmark.
|
| 16 |
+
|
| 17 |
+
- Five planners are included: LTF, DrivoR, DiffusionDrive, SafeDrive and ReCogDrive.
|
| 18 |
+
- Each comes in two versions:
|
| 19 |
+
- **`baseline`:** the upstream model. It takes NAVSIM's `driving_command` and has no route.
|
| 20 |
+
- **`sdroute`:** `driving_command` is removed, and a standard-definition (SD) route becomes the only navigation signal.
|
| 21 |
+
- The code that loads and runs these checkpoints is **OdysseyZoo**. A link will be added here once it is public.
|
| 22 |
+
- The closed-loop scenes are in [ADRLAB/odyssey-scenes](https://huggingface.co/datasets/ADRLAB/odyssey-scenes).
|
| 23 |
+
|
| 24 |
+
## Checkpoints
|
| 25 |
+
|
| 26 |
+
Paths match the OdysseyZoo tree, so the files land in place when you download into an OdysseyZoo checkout.
|
| 27 |
+
|
| 28 |
+
| File | Model | Version | Origin | License |
|
| 29 |
+
|---|---|---|---|---|
|
| 30 |
+
| `third_party/navsim/ckpts/ltf_baseline.ckpt` | LTF | baseline | NAVSIM release: [`autonomousvision/navsim_baselines`](https://huggingface.co/autonomousvision/navsim_baselines) `ltf/ltf_seed_0.ckpt` | Apache-2.0 |
|
| 31 |
+
| `third_party/navsim/ckpts/ltf_sdroute.ckpt` | LTF | sdroute | trained by us | CC BY-NC-SA 4.0 |
|
| 32 |
+
| `third_party/DrivoR/ckpts/drivor_baseline.ckpt` | DrivoR | baseline | [DrivoR](https://github.com/valeoai/DrivoR) authors' release (GitHub Releases, navtrain only, 25 epochs) | Apache-2.0 |
|
| 33 |
+
| `third_party/DrivoR/ckpts/drivor_sdroute.ckpt` | DrivoR | sdroute | trained by us | CC BY-NC-SA 4.0 |
|
| 34 |
+
| `third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt` | DiffusionDrive | baseline | trained by us with the upstream recipe | CC BY-NC-SA 4.0 |
|
| 35 |
+
| `third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt` | DiffusionDrive | sdroute | trained by us | CC BY-NC-SA 4.0 |
|
| 36 |
+
| `third_party/SafeDrive/ckpts/safedrive_baseline.ckpt` | SafeDrive | baseline (camera-only, with pedestrian detection) | trained by us | CC BY-NC-SA 4.0 |
|
| 37 |
+
| `third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt` | SafeDrive | sdroute | trained by us | CC BY-NC-SA 4.0 |
|
| 38 |
+
| `third_party/recogdrive/ckpts/recogdrive_baseline.ckpt` | ReCogDrive | baseline | ReCogDrive release: [`owl10/ReCogDrive-2B-RL`](https://huggingface.co/owl10/ReCogDrive-2B-RL) | Apache-2.0 |
|
| 39 |
+
| `third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt` | ReCogDrive | sdroute (imitation learning + GRPO) | trained by us | CC BY-NC-SA 4.0 |
|
| 40 |
+
| `third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt` | ReCogDrive | sdroute, imitation learning only (before GRPO) | trained by us | CC BY-NC-SA 4.0 |
|
| 41 |
+
|
| 42 |
+
- Every model was trained on NAVSIM `navtrain`.
|
| 43 |
+
- **File contents:** each file keeps only `state_dict`, `pytorch-lightning_version`, `epoch` and `global_step`.
|
| 44 |
+
- Optimizer, scheduler and callback states were dropped, so a file is about a third of a full Lightning checkpoint. This means they cannot resume training.
|
| 45 |
+
- For the three upstream checkpoints, every tensor is identical to the original release.
|
| 46 |
+
- `SHA256SUMS` lists the checksum of every file.
|
| 47 |
+
|
| 48 |
+
## Download
|
| 49 |
+
|
| 50 |
+
```bash
|
| 51 |
+
# all checkpoints, into an OdysseyZoo checkout
|
| 52 |
+
hf download ADRLAB/odyssey-models --include "third_party/*" --local-dir OdysseyZoo
|
| 53 |
+
|
| 54 |
+
# verify
|
| 55 |
+
hf download ADRLAB/odyssey-models SHA256SUMS --local-dir .
|
| 56 |
+
(cd OdysseyZoo && sha256sum -c ../SHA256SUMS)
|
| 57 |
+
```
|
| 58 |
+
|
| 59 |
+
`--include "third_party/*"` keeps this repo's `README.md` from overwriting OdysseyZoo's.
|
| 60 |
+
|
| 61 |
+
**Also needed, from their own repos:**
|
| 62 |
+
|
| 63 |
+
| For | Download into | Command |
|
| 64 |
+
|---|---|---|
|
| 65 |
+
| ReCogDrive (all three checkpoints) | `third_party/recogdrive/ckpts/ReCogDrive-VLM-2B/` | `hf download owl10/ReCogDrive-VLM-2B --local-dir OdysseyZoo/third_party/recogdrive/ckpts/ReCogDrive-VLM-2B` |
|
| 66 |
+
| DrivoR (both checkpoints) | `third_party/DrivoR/weights/vit_small_patch14_reg4_dinov2.lvd142m/` | `hf download timm/vit_small_patch14_reg4_dinov2.lvd142m --local-dir OdysseyZoo/third_party/DrivoR/weights/vit_small_patch14_reg4_dinov2.lvd142m` |
|
| 67 |
+
|
| 68 |
+
- LTF, DiffusionDrive and SafeDrive fetch `timm/resnet34.a1_in1k` from the Hugging Face Hub when the model is built. On an offline machine, have it in the local HF cache.
|
| 69 |
+
- The DINOv2 and ResNet-34 weights are only initial values. The checkpoints overwrite them.
|
| 70 |
+
|
| 71 |
+
## License
|
| 72 |
+
|
| 73 |
+
- **Checkpoints trained by us:** [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).
|
| 74 |
+
- They were trained on NAVSIM/OpenScene data derived from nuPlan, so the [nuPlan terms of use](https://www.nuscenes.org/terms-of-use) also apply.
|
| 75 |
+
- Non-commercial use only.
|
| 76 |
+
- **Upstream checkpoints** (`ltf_baseline`, `drivor_baseline`, `recogdrive_baseline`):
|
| 77 |
+
- Redistributed under their original [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) license.
|
| 78 |
+
- Modified only by dropping the training state, as described above.
|
| 79 |
+
- Origins are listed in the table.
|
| 80 |
+
|
| 81 |
+
## Citation
|
| 82 |
+
|
| 83 |
+
Please cite the upstream works of the models you use:
|
| 84 |
+
|
| 85 |
+
- [NAVSIM](https://github.com/autonomousvision/navsim), which also provides LTF
|
| 86 |
+
- [DrivoR](https://github.com/valeoai/DrivoR)
|
| 87 |
+
- [DiffusionDrive](https://github.com/hustvl/DiffusionDrive)
|
| 88 |
+
- [SafeDrive](https://github.com/SPA-junghokim/SafeDrive)
|
| 89 |
+
- [ReCogDrive](https://github.com/xiaomi-research/recogdrive)
|
SHA256SUMS
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
4c0961a398973cb9567f0097aa6f7e0a51e33759ce93733daa4de181f93a78f0 third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt
|
| 2 |
+
64684ca8ce1ea1a5bd152d86a5f4f7530069007676db2c3d5f409c79c17da68b third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt
|
| 3 |
+
abdf5b117aec819a9ccb26ca4540f99b7631858af02b85bb2eba864f37e6a58a third_party/DrivoR/ckpts/drivor_baseline.ckpt
|
| 4 |
+
22ff0261fc06f114e57d4ed8d1f91c9fc467e57789e02d961afe39112d5a2dd2 third_party/DrivoR/ckpts/drivor_sdroute.ckpt
|
| 5 |
+
2ff4571d34e6cf06a7de011b406e0aad5fc11ff2749239d6cb4c656d11f1c038 third_party/SafeDrive/ckpts/safedrive_baseline.ckpt
|
| 6 |
+
bbe47afa6ccb28ef6663f628ed784f12c19f36bbe03ece36bca1d9ba46d2aed1 third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt
|
| 7 |
+
e59a08776eec4ba82824c91941b9e628550c3cb7ee37daeccdceafc19b7738f5 third_party/navsim/ckpts/ltf_baseline.ckpt
|
| 8 |
+
c57a92a5f645c111f19c9e4616d06920766432acaed9e4a760f28c8dea56c432 third_party/navsim/ckpts/ltf_sdroute.ckpt
|
| 9 |
+
9f1927d8e1e965161df5baa6a16b337046ab510f046749e701fadb51af5e02f0 third_party/recogdrive/ckpts/recogdrive_baseline.ckpt
|
| 10 |
+
a782e50adb7e811c13420e05358bf3c5724b395b2c1f75af2f90e0e0d1172c5e third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt
|
| 11 |
+
5011bfcadfee5922c721277f2d949440e60ac1cf2beb481e26c2e7fa690f5333 third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt
|
third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4c0961a398973cb9567f0097aa6f7e0a51e33759ce93733daa4de181f93a78f0
|
| 3 |
+
size 243602235
|
third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:64684ca8ce1ea1a5bd152d86a5f4f7530069007676db2c3d5f409c79c17da68b
|
| 3 |
+
size 252432907
|
third_party/DrivoR/ckpts/drivor_baseline.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:abdf5b117aec819a9ccb26ca4540f99b7631858af02b85bb2eba864f37e6a58a
|
| 3 |
+
size 163320283
|
third_party/DrivoR/ckpts/drivor_sdroute.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:22ff0261fc06f114e57d4ed8d1f91c9fc467e57789e02d961afe39112d5a2dd2
|
| 3 |
+
size 179658018
|
third_party/SafeDrive/ckpts/safedrive_baseline.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2ff4571d34e6cf06a7de011b406e0aad5fc11ff2749239d6cb4c656d11f1c038
|
| 3 |
+
size 455121077
|
third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbe47afa6ccb28ef6663f628ed784f12c19f36bbe03ece36bca1d9ba46d2aed1
|
| 3 |
+
size 478786573
|
third_party/navsim/ckpts/ltf_baseline.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e59a08776eec4ba82824c91941b9e628550c3cb7ee37daeccdceafc19b7738f5
|
| 3 |
+
size 224565586
|
third_party/navsim/ckpts/ltf_sdroute.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c57a92a5f645c111f19c9e4616d06920766432acaed9e4a760f28c8dea56c432
|
| 3 |
+
size 237148771
|
third_party/recogdrive/ckpts/recogdrive_baseline.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9f1927d8e1e965161df5baa6a16b337046ab510f046749e701fadb51af5e02f0
|
| 3 |
+
size 274895291
|
third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a782e50adb7e811c13420e05358bf3c5724b395b2c1f75af2f90e0e0d1172c5e
|
| 3 |
+
size 282960369
|
third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5011bfcadfee5922c721277f2d949440e60ac1cf2beb481e26c2e7fa690f5333
|
| 3 |
+
size 141479715
|