ImIntheMiddle commited on
Commit
a8db8d6
·
verified ·
1 Parent(s): d7d02db

Model Card: assets overview, quick start, license, citation

Browse files
Files changed (1) hide show
  1. README.md +83 -0
README.md CHANGED
@@ -1,3 +1,86 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - human-trajectory-prediction
7
+ - social-transmotion
8
+ - jrdb
9
+ - jta
10
+ - cvpr2025
11
+ - emloco
12
+ pipeline_tag: other
13
+ library_name: pytorch
14
  ---
15
+
16
+ # EmLoco — CVPR 2025 release assets
17
+
18
+ This repository hosts the **`Ours` (num_modes=1) checkpoints** and **CVPR-era preprocessed shards** that accompany:
19
+
20
+ > **Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment** (CVPR 2025).
21
+ > Hiromu Taketsugu, Takeru Oba, Takahiro Maeda, Shohei Nobuhara, Norimichi Ukita.
22
+ > [📄 paper](https://openaccess.thecvf.com/content/CVPR2025/html/Taketsugu_Physical_Plausibility-aware_Trajectory_Prediction_via_Locomotion_Embodiment_CVPR_2025_paper.html) · [arXiv 2503.17267](https://arxiv.org/abs/2503.17267) · [project page](https://iminthemiddle.github.io/EmLoco-Page/) · [🐙 source code](https://github.com/ImIntheMiddle/EmLoco)
23
+
24
+ ## What's here
25
+
26
+ | Path | Size | Content |
27
+ |---|---|---|
28
+ | `checkpoints/jta_ours/` | 38 MB | JTA Ours model (num_modes=1, EmLoco loss, token_num=49) — `best_val_checkpoint` of `jta_valuenet_100` |
29
+ | `checkpoints/jrdb_ours/` | 38 MB | JRDB Ours model (num_modes=1, EmLoco loss, token_num=26) — last `checkpoint` of `jrdb_value150` |
30
+ | `preprocess_smpl_cvpr/jta_all_visual_cues/{train,val,test}/` | 23 GB | JTA J=49 shards (torch 2.x zip-format `.pt`, 21 parts) |
31
+ | `preprocess_smpl_cvpr/jrdb_all_visual_cues/{train,val,test}/` | 4.5 GB | JRDB J=26 shards (`.pkl`, 7 parts). Pose tokens are NaN-filled for frames without a JRDB-Act label so the EmLoco loss skips them automatically. |
32
+
33
+ Each checkpoint directory also contains a `config.yaml` capturing the training-time hyper-parameters.
34
+
35
+ ## Quick start
36
+
37
+ ```bash
38
+ # 0. Clone EmLoco source + set up the unified Python 3.8 / CUDA 12.1 env
39
+ git clone https://github.com/ImIntheMiddle/EmLoco && cd EmLoco
40
+ uv sync && source .venv-22.04/bin/activate
41
+
42
+ # 1. Pull the assets from this repo
43
+ pip install -U "huggingface_hub[cli]"
44
+ hf download iminthemiddle/EmLoco --local-dir .assets --repo-type model
45
+
46
+ # 2. Wire them into the expected paths
47
+ ln -s "$PWD/.assets/preprocess_smpl_cvpr/jta_all_visual_cues" \
48
+ social-transmotion/data/jta_all_visual_cues/preprocess_smpl_cvpr
49
+ ln -s "$PWD/.assets/preprocess_smpl_cvpr/jrdb_all_visual_cues" \
50
+ social-transmotion/data/jrdb_all_visual_cues/preprocess_smpl_cvpr
51
+ mkdir -p social-transmotion/experiments/{JTA,JRDB}
52
+ ln -s "$PWD/.assets/checkpoints/jta_ours" social-transmotion/experiments/JTA/jta_ours
53
+ ln -s "$PWD/.assets/checkpoints/jrdb_ours" social-transmotion/experiments/JRDB/jrdb_ours
54
+
55
+ # 3. Grab the LocoVal value-network from the GitHub Release (28 KB)
56
+ mkdir -p pacer/output/exp/pacer
57
+ # https://github.com/ImIntheMiddle/EmLoco/releases/tag/checkpoints (unzip valuenet_checkpoints.zip)
58
+
59
+ # 4. Evaluate the released Ours checkpoints
60
+ python social-transmotion/evaluate_jta.py --exp_name jta_ours --modality traj+all # ADE 0.951 / FDE 1.921
61
+ python social-transmotion/evaluate_jrdb.py --exp_name jrdb_ours --modality traj+all # ADE 0.369 / FDE 0.724
62
+ ```
63
+
64
+ ## Reproduced numbers (JRDB-Traj test, JTA-Dataset test)
65
+
66
+ | Setting | ADE | FDE |
67
+ |---|---|---|
68
+ | JTA Ours (`jta_ours`, num_modes=1) | **0.951** | **1.921** |
69
+ | JRDB Ours (`jrdb_ours`, num_modes=1) | **0.369** | **0.724** |
70
+
71
+ For the multi-modal Table rows (num_modes>1, LocoVal filter at inference), train your own with `--multi_modal --valueloss_w 1.0` on top of `preprocess_smpl_cvpr/` or contact the authors for additional checkpoints.
72
+
73
+ ## License
74
+
75
+ The assets in this repository are released under **CC BY-NC 4.0** — *research, non-commercial use only*. The reason is that the underlying SMPL body model and the JTA / JRDB datasets used during preprocessing and training are themselves restricted to non-commercial research use, as is the PACER (NVIDIA) code that produced the LocoVal value function. The EmLoco source code on GitHub remains under MIT.
76
+
77
+ ## Citation
78
+
79
+ ```bibtex
80
+ @InProceedings{EmLoco_CVPR25,
81
+ author = {Taketsugu, Hiromu and Oba, Takeru and Maeda, Takahiro and Nobuhara, Shohei and Ukita, Norimichi},
82
+ title = {Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment},
83
+ booktitle = {IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR)},
84
+ year = {2025}
85
+ }
86
+ ```