Lexiyutou commited on
Commit
2014750
·
verified ·
1 Parent(s): c2ab373

Initial commit for model card

Browse files

Add model details, metrics, training, and evaluation data description

Files changed (1) hide show
  1. README.md +91 -3
README.md CHANGED
@@ -1,3 +1,91 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - computer_vision
5
+ - animal_pose_and_shape_estimation
6
+ - deeplabcut
7
+ pipeline_tag: image-to-3d
8
+
9
+ ---
10
+ # MODEL CARD:
11
+
12
+ ## Model Details
13
+
14
+ • PRIMA model(s) developed by the [M.W.Mathis Lab](http://www.mackenziemathislab.org/) in 2026, trained to predict quadruped shape and pose from images.
15
+ Please see **paper link** for details.
16
+
17
+ • There are two main models:
18
+ - `s1ckpt.ckpt` is the stage-1 model trained with Animal3D, CtrlAni3D, and Quadruped2D datasets.
19
+ - `s3ckpt.ckpt` is the stage-3 model trained with Animal3D, CtrlAni3D, and Quadruped3D datasets.
20
+
21
+ ```python
22
+ from pathlib import Path
23
+ from dlclibrary import download_huggingface_model
24
+ # Creates a folder and downloads the model to it
25
+ model_dir = Path("./prima_animal_model_pytorch")
26
+ model_dir.mkdir()
27
+ download_huggingface_model("prima_animal_model_pytorch", model_dir)
28
+ ```
29
+ ## Intended Use
30
+ • Intended to be used for shape and pose estimation of quadruped images taken from a single view.
31
+
32
+ • Intended for academic and research professionals working in fields related to animal behavior, such as neuroscience
33
+ and ecology.
34
+
35
+ • Not suitable as a zero-shot model for applications that require high shape and pose precision, but can be further optimized with 2D keypoint
36
+ annotations or from Deeplabcut_Superanimal to improve accuracy. Also not suitable for videos that look dramatically different from those
37
+ we show in the paper.
38
+
39
+ ## Metrics
40
+ • PA-MPJPE (Procrustes-aligned mean per-joint position error), computed over 3D joints.
41
+
42
+ • PA-MPVPE (Procrustes-aligned mean per-vertex position error), computed over the SMAL mesh vertices.
43
+
44
+ • PCK (Percentage of Correct Keypoints) measures the proportion of predicted keypoints within a specified threshold of the ground-truth keypoints.
45
+
46
+ • AUC (Area Under the Curve), computed by integrating the PCK values as the threshold varies from 0 to 1.
47
+
48
+
49
+ ## Evaluation Data
50
+ • In the paper we benchmark on Animal3d, CtrlAni3D, Quadruped2D, and AnimalKingdom.
51
+
52
+ ## Training Data:
53
+ It consists of being trained together on the following datasets:
54
+ - **Animal3D** see full details at (1).
55
+ - **CtrlAni3D** See full details at (2).
56
+ - **Quadruped2D** See full details at (3).
57
+ - **Quadruped3D** Horse-30 dataset, benchmark task is called Horse-10; See full details at (4).
58
+
59
+
60
+ ## Ethical Considerations
61
+ • No experimental data were collected for this model; all datasets used are cited.
62
+
63
+ ## License
64
+ Modified MIT.
65
+ Copyright 2026 by Mackenzie Mathis, Xiaohang Yu, and contributors.
66
+ Permission is hereby granted to you (hereafter "LICENSEE") a fully-paid, non-exclusive,
67
+ and non-transferable license for academic, non-commercial purposes only (hereafter “LICENSE”)
68
+ to use the "MODEL" weights (hereafter "MODEL"), subject to the following conditions:
69
+ The above copyright notice and this permission notice shall be included in all copies or substantial
70
+ portions of the Software:
71
+ This software may not be used to harm any animal deliberately.
72
+ LICENSEE acknowledges that the MODEL is a research tool.
73
+ THE MODEL IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING
74
+ BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
75
+ IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
76
+ WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE MODEL
77
+ OR THE USE OR OTHER DEALINGS IN THE MODEL.
78
+ If this license is not appropriate for your application, please contact Prof. Mackenzie W. Mathis
79
+ (mackenzie@post.harvard.edu) and/or the TTO office at EPFL (tto@epfl.ch) for a commercial use license.
80
+ Please cite **paper link** if you use this model in your work.
81
+
82
+ ## References
83
+ 1. Xu, J., Zhang, Y., Peng, J., Ma, W., Jesslen, A., Ji, P., Hu, Q., Zhang, J., Liu, Q.,
84
+ Wang, J., et al.: Animal3d: A comprehensive dataset of 3d animal pose and shape.
85
+ In: ICCV. pp. 9099–9109 (2023)
86
+ 2. Lyu, J., Zhu, T., Gu, Y., Lin, L., Cheng, P., Liu, Y., Tang, X., An, L.: Animer:
87
+ Animal pose and shape estimation using a family-aware transformer. In: CVPR. pp.
88
+ 17486–17496 (2025)
89
+ 3. Ye, S., Filippova, A., Lauer, J., Schneider, S., Vidal, M., Qiu, T., Mathis, A.,
90
+ Mathis, M.W.: Superanimal pretrained pose estimation models for behavioral anal-
91
+ ysis. Nature communications 15(1), 5165 (2024)