Consolidate evaluation projectors into two dataset bundles
Browse files- evaluation/body_pose_v1/README.md +0 -20
- evaluation/motion_v1/3dpw_j14.pt +0 -3
- evaluation/motion_v1/README.md +0 -25
- evaluation/motion_v1/mesh_projector/face_vertex_indices.pt +0 -3
- evaluation/motion_v1/mesh_projector/smpl_vertex_barycentric.pt +0 -3
- evaluation/motion_v1/mesh_projector/smpl_vertex_face_ids.pt +0 -3
- evaluation/motion_v1/mesh_projector/tet_vertex_indices.pt +0 -3
- evaluation/motion_v1/smpl24.pt +0 -3
- evaluation/{body_pose_v1 → projectors_v1}/3dpw_projector.pt +2 -2
- evaluation/projectors_v1/README.md +26 -0
- evaluation/{body_pose_v1 → projectors_v1}/emdb_projector.pt +2 -2
evaluation/body_pose_v1/README.md
DELETED
|
@@ -1,20 +0,0 @@
|
|
| 1 |
-
# Body Pose evaluation projectors
|
| 2 |
-
|
| 3 |
-
Use these projectors with GEM-X's Body Pose evaluation on 3DPW test and EMDB-1.
|
| 4 |
-
They expect SOMA 0.3.3 MID meshes with 18,056 vertices in metres, in the vertex
|
| 5 |
-
order returned by the released Body Pose predictor. Load the files with
|
| 6 |
-
`gem.pose.evaluation.body.BodyJointProjector.from_asset`.
|
| 7 |
-
|
| 8 |
-
| File | Output joint order | Evaluated subset and pelvis |
|
| 9 |
-
| --- | --- | --- |
|
| 10 |
-
| `3dpw_projector.pt` | Complete 44-joint benchmark layout | Score 25–37 and 43; center on 39 |
|
| 11 |
-
| `emdb_projector.pt` | SMPL24 | Score all 24; center on the mean of 1 and 2 |
|
| 12 |
-
|
| 13 |
-
Indices start at zero. These are joint evaluation assets: they do not provide
|
| 14 |
-
PVE or a temporal Motion evaluation protocol. Datasets, ground-truth labels and
|
| 15 |
-
SMPL model files are obtained separately by each user.
|
| 16 |
-
|
| 17 |
-
See the [Body Pose benchmark guide](https://github.com/NVlabs/GEM-X/blob/main/docs/BODY_BENCHMARKS.md)
|
| 18 |
-
for data preparation and fixed evaluation configurations.
|
| 19 |
-
|
| 20 |
-
Evaluation code is available in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34) while its merge is pending.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/3dpw_j14.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:cb55ad8a086d0c3452633515aefad343856d679d8a85b0ce94ebb647a3761bc7
|
| 3 |
-
size 3901534
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/README.md
DELETED
|
@@ -1,25 +0,0 @@
|
|
| 1 |
-
# Body Motion evaluation projectors
|
| 2 |
-
|
| 3 |
-
These assets support GEM-X's complete-sequence Motion evaluation. Inputs are
|
| 4 |
-
SOMA 0.3.3 MID meshes with 18,056 vertices in metres, using the Motion evaluation
|
| 5 |
-
geometry profile without pose correctives. They are separate from the Body Pose
|
| 6 |
-
evaluation bundle.
|
| 7 |
-
|
| 8 |
-
| Asset | Usage |
|
| 9 |
-
| --- | --- |
|
| 10 |
-
| `smpl24.pt` | SMPL24 joint order for EMDB-1 and EMDB-2; pelvis is the midpoint of joints 1 and 2 |
|
| 11 |
-
| `3dpw_j14.pt` | Motion's 14-joint 3DPW order; pelvis is the midpoint of joints 2 and 3 |
|
| 12 |
-
| `mesh_projector/` | Corresponding 6,890-vertex output for EMDB-1 PVE and EMDB-2 foot sliding |
|
| 13 |
-
|
| 14 |
-
Joint indices start at zero. Load the joint files with
|
| 15 |
-
`gem.motion.evaluation.geometry.SomaJointRegressor`; load the directory with
|
| 16 |
-
`SomaMeshProjector`. The mesh directory requires all four files together:
|
| 17 |
-
`face_vertex_indices.pt`, `tet_vertex_indices.pt`, `smpl_vertex_face_ids.pt`, and
|
| 18 |
-
`smpl_vertex_barycentric.pt`.
|
| 19 |
-
|
| 20 |
-
Users obtain benchmark data and SMPL models separately and prepare their own
|
| 21 |
-
ground truth locally. See the [Motion benchmark guide](https://github.com/NVlabs/GEM-X/blob/main/docs/MOTION_BENCHMARKS.md)
|
| 22 |
-
for matching models, preparation, frame masks, camera inputs and raw/Contact-IK
|
| 23 |
-
evaluation commands.
|
| 24 |
-
|
| 25 |
-
Evaluation code is available in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34) while its merge is pending.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/mesh_projector/face_vertex_indices.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:547b1eb1bf14ab7c58f7698b5516682346fdc10d395a183a3c553cda6b3da30c
|
| 3 |
-
size 868221
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/mesh_projector/smpl_vertex_barycentric.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:2cdf0283168ebfcc47e4bc6d3fd2b48e82ce27c4a047fcfbafd617e3e463d95d
|
| 3 |
-
size 111961
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/mesh_projector/smpl_vertex_face_ids.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:8900ad9f5d004a7ebc044f65ac51c6947728cec96674a58d9f59a5dc1f9cac7b
|
| 3 |
-
size 56772
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/mesh_projector/tet_vertex_indices.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:b3ff920312b88ffb00071b3b2fe2c63f19ba736c3ad2a0326c3c78737279e18f
|
| 3 |
-
size 1157110
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/motion_v1/smpl24.pt
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:d3a297f63cc4b2b1471c8c52c62240f58245a9b26002672678c3b35adeb98a64
|
| 3 |
-
size 6067986
|
|
|
|
|
|
|
|
|
|
|
|
evaluation/{body_pose_v1 → projectors_v1}/3dpw_projector.pt
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ad7e1f1d7327fd38c9a2fe8db03cb1328e7ad35fe1bfeada09977facf73e416
|
| 3 |
+
size 13434629
|
evaluation/projectors_v1/README.md
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# GEM-X evaluation projectors
|
| 2 |
+
|
| 3 |
+
Download the two files for Body Pose and Body Motion evaluation:
|
| 4 |
+
|
| 5 |
+
```bash
|
| 6 |
+
hf download nvidia/GEM-X --include 'evaluation/projectors_v1/*' --local-dir weights
|
| 7 |
+
```
|
| 8 |
+
|
| 9 |
+
| File | Use |
|
| 10 |
+
| --- | --- |
|
| 11 |
+
| `emdb_projector.pt` | Shared EMDB SMPL24 joints; also includes the mesh mapping for Motion PVE and foot sliding |
|
| 12 |
+
| `3dpw_projector.pt` | Body Pose and Motion 3DPW joint protocols; the evaluator selects the appropriate layout |
|
| 13 |
+
|
| 14 |
+
Both files accept SOMA MID meshes with 18,056 vertices in metres. Body Pose
|
| 15 |
+
uses its matching geometry profile; Motion evaluates MID geometry without pose
|
| 16 |
+
correctives. The 3DPW protocols have different joint and pelvis definitions;
|
| 17 |
+
sharing the file does not interchange those definitions.
|
| 18 |
+
|
| 19 |
+
Use `BodyJointProjector.from_asset` for Pose and `SomaJointRegressor` for Motion.
|
| 20 |
+
For Motion mesh metrics, pass `emdb_projector.pt` to `SomaMeshProjector` as well;
|
| 21 |
+
there is no separate mesh directory to download.
|
| 22 |
+
|
| 23 |
+
Datasets, SMPL models and prepared ground truth are obtained separately by each
|
| 24 |
+
user. Setup and evaluation instructions are in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34)
|
| 25 |
+
and the repository's [Body Pose](https://github.com/NVlabs/GEM-X/blob/main/docs/BODY_BENCHMARKS.md)
|
| 26 |
+
and [Motion](https://github.com/NVlabs/GEM-X/blob/main/docs/MOTION_BENCHMARKS.md) guides.
|
evaluation/{body_pose_v1 → projectors_v1}/emdb_projector.pt
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:45dba2e5f80afd994ecc3924cea51b2f0e02910e8f8a3420c4fc4d2792f7ee1d
|
| 3 |
+
size 7389707
|