jeffffffli commited on
Commit
b111f2d
·
verified ·
1 Parent(s): d49ccd8

Consolidate evaluation projectors into two dataset bundles

Browse files
evaluation/body_pose_v1/README.md DELETED
@@ -1,20 +0,0 @@
1
- # Body Pose evaluation projectors
2
-
3
- Use these projectors with GEM-X's Body Pose evaluation on 3DPW test and EMDB-1.
4
- They expect SOMA 0.3.3 MID meshes with 18,056 vertices in metres, in the vertex
5
- order returned by the released Body Pose predictor. Load the files with
6
- `gem.pose.evaluation.body.BodyJointProjector.from_asset`.
7
-
8
- | File | Output joint order | Evaluated subset and pelvis |
9
- | --- | --- | --- |
10
- | `3dpw_projector.pt` | Complete 44-joint benchmark layout | Score 25–37 and 43; center on 39 |
11
- | `emdb_projector.pt` | SMPL24 | Score all 24; center on the mean of 1 and 2 |
12
-
13
- Indices start at zero. These are joint evaluation assets: they do not provide
14
- PVE or a temporal Motion evaluation protocol. Datasets, ground-truth labels and
15
- SMPL model files are obtained separately by each user.
16
-
17
- See the [Body Pose benchmark guide](https://github.com/NVlabs/GEM-X/blob/main/docs/BODY_BENCHMARKS.md)
18
- for data preparation and fixed evaluation configurations.
19
-
20
- Evaluation code is available in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34) while its merge is pending.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
evaluation/motion_v1/3dpw_j14.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:cb55ad8a086d0c3452633515aefad343856d679d8a85b0ce94ebb647a3761bc7
3
- size 3901534
 
 
 
 
evaluation/motion_v1/README.md DELETED
@@ -1,25 +0,0 @@
1
- # Body Motion evaluation projectors
2
-
3
- These assets support GEM-X's complete-sequence Motion evaluation. Inputs are
4
- SOMA 0.3.3 MID meshes with 18,056 vertices in metres, using the Motion evaluation
5
- geometry profile without pose correctives. They are separate from the Body Pose
6
- evaluation bundle.
7
-
8
- | Asset | Usage |
9
- | --- | --- |
10
- | `smpl24.pt` | SMPL24 joint order for EMDB-1 and EMDB-2; pelvis is the midpoint of joints 1 and 2 |
11
- | `3dpw_j14.pt` | Motion's 14-joint 3DPW order; pelvis is the midpoint of joints 2 and 3 |
12
- | `mesh_projector/` | Corresponding 6,890-vertex output for EMDB-1 PVE and EMDB-2 foot sliding |
13
-
14
- Joint indices start at zero. Load the joint files with
15
- `gem.motion.evaluation.geometry.SomaJointRegressor`; load the directory with
16
- `SomaMeshProjector`. The mesh directory requires all four files together:
17
- `face_vertex_indices.pt`, `tet_vertex_indices.pt`, `smpl_vertex_face_ids.pt`, and
18
- `smpl_vertex_barycentric.pt`.
19
-
20
- Users obtain benchmark data and SMPL models separately and prepare their own
21
- ground truth locally. See the [Motion benchmark guide](https://github.com/NVlabs/GEM-X/blob/main/docs/MOTION_BENCHMARKS.md)
22
- for matching models, preparation, frame masks, camera inputs and raw/Contact-IK
23
- evaluation commands.
24
-
25
- Evaluation code is available in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34) while its merge is pending.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
evaluation/motion_v1/mesh_projector/face_vertex_indices.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:547b1eb1bf14ab7c58f7698b5516682346fdc10d395a183a3c553cda6b3da30c
3
- size 868221
 
 
 
 
evaluation/motion_v1/mesh_projector/smpl_vertex_barycentric.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:2cdf0283168ebfcc47e4bc6d3fd2b48e82ce27c4a047fcfbafd617e3e463d95d
3
- size 111961
 
 
 
 
evaluation/motion_v1/mesh_projector/smpl_vertex_face_ids.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:8900ad9f5d004a7ebc044f65ac51c6947728cec96674a58d9f59a5dc1f9cac7b
3
- size 56772
 
 
 
 
evaluation/motion_v1/mesh_projector/tet_vertex_indices.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:b3ff920312b88ffb00071b3b2fe2c63f19ba736c3ad2a0326c3c78737279e18f
3
- size 1157110
 
 
 
 
evaluation/motion_v1/smpl24.pt DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3a297f63cc4b2b1471c8c52c62240f58245a9b26002672678c3b35adeb98a64
3
- size 6067986
 
 
 
 
evaluation/{body_pose_v1 → projectors_v1}/3dpw_projector.pt RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e71c6f8026448a4f6fc8ce1ba1da6776a2af0b84c84a554922236083012dc04d
3
- size 10401437
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ad7e1f1d7327fd38c9a2fe8db03cb1328e7ad35fe1bfeada09977facf73e416
3
+ size 13434629
evaluation/projectors_v1/README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # GEM-X evaluation projectors
2
+
3
+ Download the two files for Body Pose and Body Motion evaluation:
4
+
5
+ ```bash
6
+ hf download nvidia/GEM-X --include 'evaluation/projectors_v1/*' --local-dir weights
7
+ ```
8
+
9
+ | File | Use |
10
+ | --- | --- |
11
+ | `emdb_projector.pt` | Shared EMDB SMPL24 joints; also includes the mesh mapping for Motion PVE and foot sliding |
12
+ | `3dpw_projector.pt` | Body Pose and Motion 3DPW joint protocols; the evaluator selects the appropriate layout |
13
+
14
+ Both files accept SOMA MID meshes with 18,056 vertices in metres. Body Pose
15
+ uses its matching geometry profile; Motion evaluates MID geometry without pose
16
+ correctives. The 3DPW protocols have different joint and pelvis definitions;
17
+ sharing the file does not interchange those definitions.
18
+
19
+ Use `BodyJointProjector.from_asset` for Pose and `SomaJointRegressor` for Motion.
20
+ For Motion mesh metrics, pass `emdb_projector.pt` to `SomaMeshProjector` as well;
21
+ there is no separate mesh directory to download.
22
+
23
+ Datasets, SMPL models and prepared ground truth are obtained separately by each
24
+ user. Setup and evaluation instructions are in [GEM-X PR #34](https://github.com/NVlabs/GEM-X/pull/34)
25
+ and the repository's [Body Pose](https://github.com/NVlabs/GEM-X/blob/main/docs/BODY_BENCHMARKS.md)
26
+ and [Motion](https://github.com/NVlabs/GEM-X/blob/main/docs/MOTION_BENCHMARKS.md) guides.
evaluation/{body_pose_v1 → projectors_v1}/emdb_projector.pt RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1d2e1bc34116462baae51d743b2b1ea905ee62069e98f25fcf36d9ecba2c940
3
- size 6068317
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45dba2e5f80afd994ecc3924cea51b2f0e02910e8f8a3420c4fc4d2792f7ee1d
3
+ size 7389707