Model Card: assets overview, quick start, license, citation
Browse files
README.md
CHANGED
|
@@ -1,3 +1,86 @@
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: cc-by-nc-4.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
tags:
|
| 6 |
+
- human-trajectory-prediction
|
| 7 |
+
- social-transmotion
|
| 8 |
+
- jrdb
|
| 9 |
+
- jta
|
| 10 |
+
- cvpr2025
|
| 11 |
+
- emloco
|
| 12 |
+
pipeline_tag: other
|
| 13 |
+
library_name: pytorch
|
| 14 |
---
|
| 15 |
+
|
| 16 |
+
# EmLoco — CVPR 2025 release assets
|
| 17 |
+
|
| 18 |
+
This repository hosts the **`Ours` (num_modes=1) checkpoints** and **CVPR-era preprocessed shards** that accompany:
|
| 19 |
+
|
| 20 |
+
> **Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment** (CVPR 2025).
|
| 21 |
+
> Hiromu Taketsugu, Takeru Oba, Takahiro Maeda, Shohei Nobuhara, Norimichi Ukita.
|
| 22 |
+
> [📄 paper](https://openaccess.thecvf.com/content/CVPR2025/html/Taketsugu_Physical_Plausibility-aware_Trajectory_Prediction_via_Locomotion_Embodiment_CVPR_2025_paper.html) · [arXiv 2503.17267](https://arxiv.org/abs/2503.17267) · [project page](https://iminthemiddle.github.io/EmLoco-Page/) · [🐙 source code](https://github.com/ImIntheMiddle/EmLoco)
|
| 23 |
+
|
| 24 |
+
## What's here
|
| 25 |
+
|
| 26 |
+
| Path | Size | Content |
|
| 27 |
+
|---|---|---|
|
| 28 |
+
| `checkpoints/jta_ours/` | 38 MB | JTA Ours model (num_modes=1, EmLoco loss, token_num=49) — `best_val_checkpoint` of `jta_valuenet_100` |
|
| 29 |
+
| `checkpoints/jrdb_ours/` | 38 MB | JRDB Ours model (num_modes=1, EmLoco loss, token_num=26) — last `checkpoint` of `jrdb_value150` |
|
| 30 |
+
| `preprocess_smpl_cvpr/jta_all_visual_cues/{train,val,test}/` | 23 GB | JTA J=49 shards (torch 2.x zip-format `.pt`, 21 parts) |
|
| 31 |
+
| `preprocess_smpl_cvpr/jrdb_all_visual_cues/{train,val,test}/` | 4.5 GB | JRDB J=26 shards (`.pkl`, 7 parts). Pose tokens are NaN-filled for frames without a JRDB-Act label so the EmLoco loss skips them automatically. |
|
| 32 |
+
|
| 33 |
+
Each checkpoint directory also contains a `config.yaml` capturing the training-time hyper-parameters.
|
| 34 |
+
|
| 35 |
+
## Quick start
|
| 36 |
+
|
| 37 |
+
```bash
|
| 38 |
+
# 0. Clone EmLoco source + set up the unified Python 3.8 / CUDA 12.1 env
|
| 39 |
+
git clone https://github.com/ImIntheMiddle/EmLoco && cd EmLoco
|
| 40 |
+
uv sync && source .venv-22.04/bin/activate
|
| 41 |
+
|
| 42 |
+
# 1. Pull the assets from this repo
|
| 43 |
+
pip install -U "huggingface_hub[cli]"
|
| 44 |
+
hf download iminthemiddle/EmLoco --local-dir .assets --repo-type model
|
| 45 |
+
|
| 46 |
+
# 2. Wire them into the expected paths
|
| 47 |
+
ln -s "$PWD/.assets/preprocess_smpl_cvpr/jta_all_visual_cues" \
|
| 48 |
+
social-transmotion/data/jta_all_visual_cues/preprocess_smpl_cvpr
|
| 49 |
+
ln -s "$PWD/.assets/preprocess_smpl_cvpr/jrdb_all_visual_cues" \
|
| 50 |
+
social-transmotion/data/jrdb_all_visual_cues/preprocess_smpl_cvpr
|
| 51 |
+
mkdir -p social-transmotion/experiments/{JTA,JRDB}
|
| 52 |
+
ln -s "$PWD/.assets/checkpoints/jta_ours" social-transmotion/experiments/JTA/jta_ours
|
| 53 |
+
ln -s "$PWD/.assets/checkpoints/jrdb_ours" social-transmotion/experiments/JRDB/jrdb_ours
|
| 54 |
+
|
| 55 |
+
# 3. Grab the LocoVal value-network from the GitHub Release (28 KB)
|
| 56 |
+
mkdir -p pacer/output/exp/pacer
|
| 57 |
+
# https://github.com/ImIntheMiddle/EmLoco/releases/tag/checkpoints (unzip valuenet_checkpoints.zip)
|
| 58 |
+
|
| 59 |
+
# 4. Evaluate the released Ours checkpoints
|
| 60 |
+
python social-transmotion/evaluate_jta.py --exp_name jta_ours --modality traj+all # ADE 0.951 / FDE 1.921
|
| 61 |
+
python social-transmotion/evaluate_jrdb.py --exp_name jrdb_ours --modality traj+all # ADE 0.369 / FDE 0.724
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
## Reproduced numbers (JRDB-Traj test, JTA-Dataset test)
|
| 65 |
+
|
| 66 |
+
| Setting | ADE | FDE |
|
| 67 |
+
|---|---|---|
|
| 68 |
+
| JTA Ours (`jta_ours`, num_modes=1) | **0.951** | **1.921** |
|
| 69 |
+
| JRDB Ours (`jrdb_ours`, num_modes=1) | **0.369** | **0.724** |
|
| 70 |
+
|
| 71 |
+
For the multi-modal Table rows (num_modes>1, LocoVal filter at inference), train your own with `--multi_modal --valueloss_w 1.0` on top of `preprocess_smpl_cvpr/` or contact the authors for additional checkpoints.
|
| 72 |
+
|
| 73 |
+
## License
|
| 74 |
+
|
| 75 |
+
The assets in this repository are released under **CC BY-NC 4.0** — *research, non-commercial use only*. The reason is that the underlying SMPL body model and the JTA / JRDB datasets used during preprocessing and training are themselves restricted to non-commercial research use, as is the PACER (NVIDIA) code that produced the LocoVal value function. The EmLoco source code on GitHub remains under MIT.
|
| 76 |
+
|
| 77 |
+
## Citation
|
| 78 |
+
|
| 79 |
+
```bibtex
|
| 80 |
+
@InProceedings{EmLoco_CVPR25,
|
| 81 |
+
author = {Taketsugu, Hiromu and Oba, Takeru and Maeda, Takahiro and Nobuhara, Shohei and Ukita, Norimichi},
|
| 82 |
+
title = {Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment},
|
| 83 |
+
booktitle = {IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR)},
|
| 84 |
+
year = {2025}
|
| 85 |
+
}
|
| 86 |
+
```
|