Slim down Model Card
Browse files
README.md
CHANGED
|
@@ -15,64 +15,23 @@ library_name: pytorch
|
|
| 15 |
|
| 16 |
# EmLoco β CVPR 2025 release assets
|
| 17 |
|
| 18 |
-
|
|
|
|
| 19 |
|
| 20 |
-
|
| 21 |
-
> Hiromu Taketsugu, Takeru Oba, Takahiro Maeda, Shohei Nobuhara, Norimichi Ukita.
|
| 22 |
-
> [π paper](https://openaccess.thecvf.com/content/CVPR2025/html/Taketsugu_Physical_Plausibility-aware_Trajectory_Prediction_via_Locomotion_Embodiment_CVPR_2025_paper.html) Β· [arXiv 2503.17267](https://arxiv.org/abs/2503.17267) Β· [project page](https://iminthemiddle.github.io/EmLoco-Page/) Β· [π source code](https://github.com/ImIntheMiddle/EmLoco)
|
| 23 |
|
| 24 |
-
##
|
| 25 |
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
| `checkpoints/jta_ours/` | 38 MB | JTA Ours model (num_modes=1, EmLoco loss, token_num=49) β `best_val_checkpoint` of `jta_valuenet_100` |
|
| 29 |
-
| `checkpoints/jrdb_ours/` | 38 MB | JRDB Ours model (num_modes=1, EmLoco loss, token_num=26) β last `checkpoint` of `jrdb_value150` |
|
| 30 |
-
| `preprocess_smpl_cvpr/jta_all_visual_cues/{train,val,test}/` | 23 GB | JTA J=49 shards (torch 2.x zip-format `.pt`, 21 parts) |
|
| 31 |
-
| `preprocess_smpl_cvpr/jrdb_all_visual_cues/{train,val,test}/` | 4.5 GB | JRDB J=26 shards (`.pkl`, 7 parts). Pose tokens are NaN-filled for frames without a JRDB-Act label so the EmLoco loss skips them automatically. |
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
-
#
|
| 36 |
-
|
| 37 |
-
```bash
|
| 38 |
-
# 0. Clone EmLoco source + set up the unified Python 3.8 / CUDA 12.1 env
|
| 39 |
-
git clone https://github.com/ImIntheMiddle/EmLoco && cd EmLoco
|
| 40 |
-
uv sync && source .venv-22.04/bin/activate
|
| 41 |
-
|
| 42 |
-
# 1. Pull the assets from this repo
|
| 43 |
-
pip install -U "huggingface_hub[cli]"
|
| 44 |
-
hf download iminthemiddle/EmLoco --local-dir .assets --repo-type model
|
| 45 |
-
|
| 46 |
-
# 2. Wire them into the expected paths
|
| 47 |
-
ln -s "$PWD/.assets/preprocess_smpl_cvpr/jta_all_visual_cues" \
|
| 48 |
-
social-transmotion/data/jta_all_visual_cues/preprocess_smpl_cvpr
|
| 49 |
-
ln -s "$PWD/.assets/preprocess_smpl_cvpr/jrdb_all_visual_cues" \
|
| 50 |
-
social-transmotion/data/jrdb_all_visual_cues/preprocess_smpl_cvpr
|
| 51 |
-
mkdir -p social-transmotion/experiments/{JTA,JRDB}
|
| 52 |
-
ln -s "$PWD/.assets/checkpoints/jta_ours" social-transmotion/experiments/JTA/jta_ours
|
| 53 |
-
ln -s "$PWD/.assets/checkpoints/jrdb_ours" social-transmotion/experiments/JRDB/jrdb_ours
|
| 54 |
-
|
| 55 |
-
# 3. Grab the LocoVal value-network from the GitHub Release (28 KB)
|
| 56 |
-
mkdir -p pacer/output/exp/pacer
|
| 57 |
-
# https://github.com/ImIntheMiddle/EmLoco/releases/tag/checkpoints (unzip valuenet_checkpoints.zip)
|
| 58 |
-
|
| 59 |
-
# 4. Evaluate the released Ours checkpoints
|
| 60 |
-
python social-transmotion/evaluate_jta.py --exp_name jta_ours --modality traj+all # ADE 0.951 / FDE 1.921
|
| 61 |
-
python social-transmotion/evaluate_jrdb.py --exp_name jrdb_ours --modality traj+all # ADE 0.369 / FDE 0.724
|
| 62 |
-
```
|
| 63 |
-
|
| 64 |
-
## Reproduced numbers (JRDB-Traj test, JTA-Dataset test)
|
| 65 |
-
|
| 66 |
-
| Setting | ADE | FDE |
|
| 67 |
-
|---|---|---|
|
| 68 |
-
| JTA Ours (`jta_ours`, num_modes=1) | **0.951** | **1.921** |
|
| 69 |
-
| JRDB Ours (`jrdb_ours`, num_modes=1) | **0.369** | **0.724** |
|
| 70 |
-
|
| 71 |
-
For the multi-modal Table rows (num_modes>1, LocoVal filter at inference), train your own with `--multi_modal --valueloss_w 1.0` on top of `preprocess_smpl_cvpr/` or contact the authors for additional checkpoints.
|
| 72 |
|
| 73 |
## License
|
| 74 |
|
| 75 |
-
|
| 76 |
|
| 77 |
## Citation
|
| 78 |
|
|
|
|
| 15 |
|
| 16 |
# EmLoco β CVPR 2025 release assets
|
| 17 |
|
| 18 |
+
Checkpoints and preprocessed shards for
|
| 19 |
+
**Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment** (CVPR 2025).
|
| 20 |
|
| 21 |
+
π [paper](https://openaccess.thecvf.com/content/CVPR2025/html/Taketsugu_Physical_Plausibility-aware_Trajectory_Prediction_via_Locomotion_Embodiment_CVPR_2025_paper.html) Β· π [code](https://github.com/ImIntheMiddle/EmLoco)
|
|
|
|
|
|
|
| 22 |
|
| 23 |
+
## Contents
|
| 24 |
|
| 25 |
+
- `checkpoints/{jta_ours, jrdb_ours}/` β Ours model (num_modes=1)
|
| 26 |
+
- `preprocess_smpl_cvpr/{jta, jrdb}_all_visual_cues/{train, val, test}/` β CVPR-era preprocessed shards
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
+
## Usage
|
| 29 |
|
| 30 |
+
See the [GitHub README](https://github.com/ImIntheMiddle/EmLoco#-data--checkpoints-hugging-face) for download + setup instructions.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
## License
|
| 33 |
|
| 34 |
+
CC BY-NC 4.0 (research, non-commercial). The underlying SMPL / JTA / JRDB / PACER assets restrict commercial use.
|
| 35 |
|
| 36 |
## Citation
|
| 37 |
|