ADRLAB commited on
Commit
3a3418b
·
verified ·
1 Parent(s): 3d2f9c4

Add files using upload-large-folder tool

Browse files
README.md ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: cc-by-nc-sa-4.0-and-apache-2.0
4
+ license_link: https://huggingface.co/ADRLAB/odyssey-models#license
5
+ tags:
6
+ - autonomous-driving
7
+ - end-to-end-driving
8
+ - motion-planning
9
+ - navsim
10
+ - pytorch-lightning
11
+ ---
12
+
13
+ # Odyssey Models
14
+
15
+ Checkpoints of the end-to-end driving planners evaluated in the **Odyssey** closed-loop benchmark.
16
+
17
+ - Five planners are included: LTF, DrivoR, DiffusionDrive, SafeDrive and ReCogDrive.
18
+ - Each comes in two versions:
19
+ - **`baseline`:** the upstream model. It takes NAVSIM's `driving_command` and has no route.
20
+ - **`sdroute`:** `driving_command` is removed, and a standard-definition (SD) route becomes the only navigation signal.
21
+ - The code that loads and runs these checkpoints is **OdysseyZoo**. A link will be added here once it is public.
22
+ - The closed-loop scenes are in [ADRLAB/odyssey-scenes](https://huggingface.co/datasets/ADRLAB/odyssey-scenes).
23
+
24
+ ## Checkpoints
25
+
26
+ Paths match the OdysseyZoo tree, so the files land in place when you download into an OdysseyZoo checkout.
27
+
28
+ | File | Model | Version | Origin | License |
29
+ |---|---|---|---|---|
30
+ | `third_party/navsim/ckpts/ltf_baseline.ckpt` | LTF | baseline | NAVSIM release: [`autonomousvision/navsim_baselines`](https://huggingface.co/autonomousvision/navsim_baselines) `ltf/ltf_seed_0.ckpt` | Apache-2.0 |
31
+ | `third_party/navsim/ckpts/ltf_sdroute.ckpt` | LTF | sdroute | trained by us | CC BY-NC-SA 4.0 |
32
+ | `third_party/DrivoR/ckpts/drivor_baseline.ckpt` | DrivoR | baseline | [DrivoR](https://github.com/valeoai/DrivoR) authors' release (GitHub Releases, navtrain only, 25 epochs) | Apache-2.0 |
33
+ | `third_party/DrivoR/ckpts/drivor_sdroute.ckpt` | DrivoR | sdroute | trained by us | CC BY-NC-SA 4.0 |
34
+ | `third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt` | DiffusionDrive | baseline | trained by us with the upstream recipe | CC BY-NC-SA 4.0 |
35
+ | `third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt` | DiffusionDrive | sdroute | trained by us | CC BY-NC-SA 4.0 |
36
+ | `third_party/SafeDrive/ckpts/safedrive_baseline.ckpt` | SafeDrive | baseline (camera-only, with pedestrian detection) | trained by us | CC BY-NC-SA 4.0 |
37
+ | `third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt` | SafeDrive | sdroute | trained by us | CC BY-NC-SA 4.0 |
38
+ | `third_party/recogdrive/ckpts/recogdrive_baseline.ckpt` | ReCogDrive | baseline | ReCogDrive release: [`owl10/ReCogDrive-2B-RL`](https://huggingface.co/owl10/ReCogDrive-2B-RL) | Apache-2.0 |
39
+ | `third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt` | ReCogDrive | sdroute (imitation learning + GRPO) | trained by us | CC BY-NC-SA 4.0 |
40
+ | `third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt` | ReCogDrive | sdroute, imitation learning only (before GRPO) | trained by us | CC BY-NC-SA 4.0 |
41
+
42
+ - Every model was trained on NAVSIM `navtrain`.
43
+ - **File contents:** each file keeps only `state_dict`, `pytorch-lightning_version`, `epoch` and `global_step`.
44
+ - Optimizer, scheduler and callback states were dropped, so a file is about a third of a full Lightning checkpoint. This means they cannot resume training.
45
+ - For the three upstream checkpoints, every tensor is identical to the original release.
46
+ - `SHA256SUMS` lists the checksum of every file.
47
+
48
+ ## Download
49
+
50
+ ```bash
51
+ # all checkpoints, into an OdysseyZoo checkout
52
+ hf download ADRLAB/odyssey-models --include "third_party/*" --local-dir OdysseyZoo
53
+
54
+ # verify
55
+ hf download ADRLAB/odyssey-models SHA256SUMS --local-dir .
56
+ (cd OdysseyZoo && sha256sum -c ../SHA256SUMS)
57
+ ```
58
+
59
+ `--include "third_party/*"` keeps this repo's `README.md` from overwriting OdysseyZoo's.
60
+
61
+ **Also needed, from their own repos:**
62
+
63
+ | For | Download into | Command |
64
+ |---|---|---|
65
+ | ReCogDrive (all three checkpoints) | `third_party/recogdrive/ckpts/ReCogDrive-VLM-2B/` | `hf download owl10/ReCogDrive-VLM-2B --local-dir OdysseyZoo/third_party/recogdrive/ckpts/ReCogDrive-VLM-2B` |
66
+ | DrivoR (both checkpoints) | `third_party/DrivoR/weights/vit_small_patch14_reg4_dinov2.lvd142m/` | `hf download timm/vit_small_patch14_reg4_dinov2.lvd142m --local-dir OdysseyZoo/third_party/DrivoR/weights/vit_small_patch14_reg4_dinov2.lvd142m` |
67
+
68
+ - LTF, DiffusionDrive and SafeDrive fetch `timm/resnet34.a1_in1k` from the Hugging Face Hub when the model is built. On an offline machine, have it in the local HF cache.
69
+ - The DINOv2 and ResNet-34 weights are only initial values. The checkpoints overwrite them.
70
+
71
+ ## License
72
+
73
+ - **Checkpoints trained by us:** [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/).
74
+ - They were trained on NAVSIM/OpenScene data derived from nuPlan, so the [nuPlan terms of use](https://www.nuscenes.org/terms-of-use) also apply.
75
+ - Non-commercial use only.
76
+ - **Upstream checkpoints** (`ltf_baseline`, `drivor_baseline`, `recogdrive_baseline`):
77
+ - Redistributed under their original [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0) license.
78
+ - Modified only by dropping the training state, as described above.
79
+ - Origins are listed in the table.
80
+
81
+ ## Citation
82
+
83
+ Please cite the upstream works of the models you use:
84
+
85
+ - [NAVSIM](https://github.com/autonomousvision/navsim), which also provides LTF
86
+ - [DrivoR](https://github.com/valeoai/DrivoR)
87
+ - [DiffusionDrive](https://github.com/hustvl/DiffusionDrive)
88
+ - [SafeDrive](https://github.com/SPA-junghokim/SafeDrive)
89
+ - [ReCogDrive](https://github.com/xiaomi-research/recogdrive)
SHA256SUMS ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 4c0961a398973cb9567f0097aa6f7e0a51e33759ce93733daa4de181f93a78f0 third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt
2
+ 64684ca8ce1ea1a5bd152d86a5f4f7530069007676db2c3d5f409c79c17da68b third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt
3
+ abdf5b117aec819a9ccb26ca4540f99b7631858af02b85bb2eba864f37e6a58a third_party/DrivoR/ckpts/drivor_baseline.ckpt
4
+ 22ff0261fc06f114e57d4ed8d1f91c9fc467e57789e02d961afe39112d5a2dd2 third_party/DrivoR/ckpts/drivor_sdroute.ckpt
5
+ 2ff4571d34e6cf06a7de011b406e0aad5fc11ff2749239d6cb4c656d11f1c038 third_party/SafeDrive/ckpts/safedrive_baseline.ckpt
6
+ bbe47afa6ccb28ef6663f628ed784f12c19f36bbe03ece36bca1d9ba46d2aed1 third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt
7
+ e59a08776eec4ba82824c91941b9e628550c3cb7ee37daeccdceafc19b7738f5 third_party/navsim/ckpts/ltf_baseline.ckpt
8
+ c57a92a5f645c111f19c9e4616d06920766432acaed9e4a760f28c8dea56c432 third_party/navsim/ckpts/ltf_sdroute.ckpt
9
+ 9f1927d8e1e965161df5baa6a16b337046ab510f046749e701fadb51af5e02f0 third_party/recogdrive/ckpts/recogdrive_baseline.ckpt
10
+ a782e50adb7e811c13420e05358bf3c5724b395b2c1f75af2f90e0e0d1172c5e third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt
11
+ 5011bfcadfee5922c721277f2d949440e60ac1cf2beb481e26c2e7fa690f5333 third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt
third_party/DiffusionDrive/ckpts/diffusiondrive_baseline.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c0961a398973cb9567f0097aa6f7e0a51e33759ce93733daa4de181f93a78f0
3
+ size 243602235
third_party/DiffusionDrive/ckpts/diffusiondrive_sdroute.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64684ca8ce1ea1a5bd152d86a5f4f7530069007676db2c3d5f409c79c17da68b
3
+ size 252432907
third_party/DrivoR/ckpts/drivor_baseline.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abdf5b117aec819a9ccb26ca4540f99b7631858af02b85bb2eba864f37e6a58a
3
+ size 163320283
third_party/DrivoR/ckpts/drivor_sdroute.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22ff0261fc06f114e57d4ed8d1f91c9fc467e57789e02d961afe39112d5a2dd2
3
+ size 179658018
third_party/SafeDrive/ckpts/safedrive_baseline.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ff4571d34e6cf06a7de011b406e0aad5fc11ff2749239d6cb4c656d11f1c038
3
+ size 455121077
third_party/SafeDrive/ckpts/safedrive_sdroute.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbe47afa6ccb28ef6663f628ed784f12c19f36bbe03ece36bca1d9ba46d2aed1
3
+ size 478786573
third_party/navsim/ckpts/ltf_baseline.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e59a08776eec4ba82824c91941b9e628550c3cb7ee37daeccdceafc19b7738f5
3
+ size 224565586
third_party/navsim/ckpts/ltf_sdroute.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c57a92a5f645c111f19c9e4616d06920766432acaed9e4a760f28c8dea56c432
3
+ size 237148771
third_party/recogdrive/ckpts/recogdrive_baseline.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f1927d8e1e965161df5baa6a16b337046ab510f046749e701fadb51af5e02f0
3
+ size 274895291
third_party/recogdrive/ckpts/recogdrive_sdroute.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a782e50adb7e811c13420e05358bf3c5724b395b2c1f75af2f90e0e0d1172c5e
3
+ size 282960369
third_party/recogdrive/ckpts/recogdrive_sdroute_il.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5011bfcadfee5922c721277f2d949440e60ac1cf2beb481e26c2e7fa690f5333
3
+ size 141479715