qtpose/synthpose-base-52-onnx

SynthPose-Base 52 keypoints (ONNX) for qtpose

ONNX export of stanfordmimi/synthpose-vitpose-base-hf (ViTPose, about 90M parameters, fine-tuned from usyd-community/vitpose-base-simple), published for use by qtpose. SynthPose predicts 52 anatomical landmarks, including spine, pelvis and foot points, for markerless motion capture.

Licence and citation

The SynthPose weights are released under the Apache-2.0 licence, and this derived ONNX file is distributed under the same licence. SynthPose is described in arXiv:2406.09788; please cite it when you use this model.

Export

Exported with qtpose's helper scripts/dev/convert_synthpose_to_onnx.py --variant base --validate, which loads the model with transformers.VitPoseForPoseEstimation and runs torch.onnx.export(..., opset_version=17, dynamo=False) on a wrapper that returns only the heatmap tensor.

Model file

• synthpose_base_52.onnx, 360237019 bytes
• Input: pixel_values, float32, shape (batch, 3, 256, 192) (RGB person crop, ImageNet mean/std normalised)
• Output: heatmaps, float32, shape (batch, 52, 64, 48): one heatmap per keypoint at 1/4 of the input resolution. A person detector supplies the crop.
• SHA-256 of the downloaded file: 2fba1d2175ab9fb5d8bfd679b65f52f7e8d1a314f5c69c78661b075ab1b2a238