Keypoint Detection
PyTorch
android
qaihm-bot commited on
Commit
8a4b58b
·
verified ·
1 Parent(s): e5a6545

See https://github.com/qualcomm/ai-hub-models/releases/v0.60.0 for changelog.

Files changed (2) hide show
  1. README.md +55 -52
  2. release_assets.json +35 -20
README.md CHANGED
@@ -14,7 +14,7 @@ pipeline_tag: keypoint-detection
14
  CenterNet-Pose is a machine learning model that detects human pose and returns a location and confidence for each of 17 joints.
15
 
16
  This is based on the implementation of CenterNet-Pose found [here](https://github.com/xingyizhou/CenterNet).
17
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/centernet_pose) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
@@ -27,81 +27,84 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip)
31
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip)
32
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip)
33
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip)
34
- | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip)
35
- | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip)
36
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
37
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
38
- | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip)
39
- | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip)
40
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip)
41
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip)
42
- | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip)
43
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8775p.zip)
44
- | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs9075.zip)
45
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa7255p.zip)
46
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8295p.zip)
47
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
48
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
 
 
49
 
50
  For more device-specific assets and performance metrics, visit **[CenterNet-Pose on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/centernet_pose)**.
51
 
52
 
53
  ### Option 2: Export with Custom Configurations
54
 
55
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/centernet_pose) Python library to compile and export the model with your own:
56
  - Custom weights (e.g., fine-tuned checkpoints)
57
  - Custom input shapes
58
  - Target device and runtime configurations
59
 
60
  This option is ideal if you need to customize the model beyond the default configuration provided here.
61
 
62
- See our repository for [CenterNet-Pose on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/centernet_pose) for usage instructions.
63
 
64
  ## Model Details
65
 
66
  **Model Type:** Model_use_case.pose_estimation
67
 
68
  **Model Stats:**
69
- - Model checkpoint: multi_pose_dla_3x.pth
70
  - Input resolution: 1 x 3 x 512 x 512
71
- - Number of parameters: 20.6M
72
  - Model size: 57.8 MB
 
73
 
74
  ## Performance Summary
75
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
76
  |---|---|---|---|---|---|---
77
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | 27.615 ms | 4 - 4 MB | NPU
78
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | 57.652 ms | 44 - 44 MB | NPU
79
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | 38.712 ms | 4 - 11 MB | NPU
80
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | 87.937 ms | 4 - 18 MB | NPU
81
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 55.697 ms | 0 - 49 MB | NPU
82
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8450 | 87.937 ms | 4 - 18 MB | NPU
83
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 58.212 ms | 3 - 6 MB | NPU
84
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 57.652 ms | 44 - 44 MB | NPU
85
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 30.562 ms | 4 - 15 MB | NPU
86
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | 30.562 ms | 4 - 15 MB | NPU
87
- | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 26.881 ms | 3 - 10 MB | NPU
88
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | 27.761 ms | 1 - 1 MB | NPU
89
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | 57.596 ms | 1 - 1 MB | NPU
90
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | 38.565 ms | 1 - 8 MB | NPU
91
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | 88.365 ms | 1 - 11 MB | NPU
92
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8275 | 104.16 ms | 1 - 10 MB | NPU
93
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 55.845 ms | 1 - 3 MB | NPU
94
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | 57.583 ms | 1 - 10 MB | NPU
95
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8650P | 57.583 ms | 1 - 10 MB | NPU
96
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8255P | 57.583 ms | 1 - 10 MB | NPU
97
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 | 88.365 ms | 1 - 11 MB | NPU
98
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | 57.924 ms | 3 - 6 MB | NPU
99
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-X7181 | 57.596 ms | 1 - 1 MB | NPU
100
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ Q-8750 | 30.409 ms | 1 - 10 MB | NPU
101
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | 104.16 ms | 1 - 10 MB | NPU
102
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | 79.847 ms | 0 - 6 MB | NPU
103
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | 30.409 ms | 1 - 10 MB | NPU
104
- | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | 26.822 ms | 1 - 11 MB | NPU
 
105
 
106
  ## License
107
  * The license for the original implementation of CenterNet-Pose can be found
 
14
  CenterNet-Pose is a machine learning model that detects human pose and returns a location and confidence for each of 17 joints.
15
 
16
  This is based on the implementation of CenterNet-Pose found [here](https://github.com/xingyizhou/CenterNet).
17
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/centernet_pose) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip)
31
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip)
32
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip)
33
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip)
34
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8275.zip)
35
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip)
36
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip)
37
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
38
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
39
+ | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip)
40
+ | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip)
41
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip)
42
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip)
43
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-8275 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8275.zip)
44
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip)
45
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8775p.zip)
46
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs9075.zip)
47
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa7255p.zip)
48
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8295p.zip)
49
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
50
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
51
 
52
  For more device-specific assets and performance metrics, visit **[CenterNet-Pose on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/centernet_pose)**.
53
 
54
 
55
  ### Option 2: Export with Custom Configurations
56
 
57
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/centernet_pose) Python library to compile and export the model with your own:
58
  - Custom weights (e.g., fine-tuned checkpoints)
59
  - Custom input shapes
60
  - Target device and runtime configurations
61
 
62
  This option is ideal if you need to customize the model beyond the default configuration provided here.
63
 
64
+ See our repository for [CenterNet-Pose on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/centernet_pose) for usage instructions.
65
 
66
  ## Model Details
67
 
68
  **Model Type:** Model_use_case.pose_estimation
69
 
70
  **Model Stats:**
 
71
  - Input resolution: 1 x 3 x 512 x 512
72
+ - Model checkpoint: multi_pose_dla_3x.pth
73
  - Model size: 57.8 MB
74
+ - Number of parameters: 20.6M
75
 
76
  ## Performance Summary
77
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
78
  |---|---|---|---|---|---|---
79
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | 22.381 ms | 4 - 4 MB | NPU
80
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | 51.261 ms | 44 - 44 MB | NPU
81
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | 34.296 ms | 4 - 10 MB | NPU
82
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | 96.43 ms | 4 - 18 MB | NPU
83
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 46.434 ms | 3 - 7 MB | NPU
84
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 50.517 ms | 4 - 5 MB | NPU
85
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8450 | 96.43 ms | 4 - 18 MB | NPU
86
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 70.788 ms | 3 - 6 MB | NPU
87
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 51.261 ms | 44 - 44 MB | NPU
88
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 26.691 ms | 4 - 15 MB | NPU
89
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | 26.691 ms | 4 - 15 MB | NPU
90
+ | CenterNet-Pose | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.364 ms | 3 - 11 MB | NPU
91
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | 22.789 ms | 1 - 1 MB | NPU
92
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | 51.488 ms | 1 - 1 MB | NPU
93
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | 34.112 ms | 1 - 8 MB | NPU
94
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | 96.159 ms | 1 - 10 MB | NPU
95
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-8275 | 91.518 ms | 1 - 10 MB | NPU
96
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 50.227 ms | 1 - 3 MB | NPU
97
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | 51.604 ms | 1 - 11 MB | NPU
98
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8650P | 51.604 ms | 1 - 11 MB | NPU
99
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8255P | 51.604 ms | 1 - 11 MB | NPU
100
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 | 96.159 ms | 1 - 10 MB | NPU
101
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | 51.462 ms | 1 - 4 MB | NPU
102
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-X7181 | 51.488 ms | 1 - 1 MB | NPU
103
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ Q-8750 | 26.675 ms | 12 - 21 MB | NPU
104
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | 91.518 ms | 1 - 10 MB | NPU
105
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | 60.684 ms | 0 - 6 MB | NPU
106
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | 26.675 ms | 12 - 21 MB | NPU
107
+ | CenterNet-Pose | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.379 ms | 1 - 11 MB | NPU
108
 
109
  ## License
110
  * The license for the original implementation of CenterNet-Pose can be found
release_assets.json CHANGED
@@ -1,21 +1,36 @@
1
  {
2
- "version": "0.59.0",
3
  "precisions": {
4
  "float": {
5
  "chipset_assets": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  "qualcomm-qcs8550-proxy": {
7
  "precompiled_qnn_onnx": {
8
  "tool_versions": {
9
  "qairt": "2.45.0.260326154327",
10
  "onnx_runtime": "1.27.1"
11
  },
12
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip"
13
  },
14
  "qnn_context_binary": {
15
  "tool_versions": {
16
  "qairt": "2.45.0.260326154327"
17
  },
18
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip"
19
  }
20
  },
21
  "qualcomm-qcs9075": {
@@ -24,13 +39,13 @@
24
  "qairt": "2.45.0.260326154327",
25
  "onnx_runtime": "1.27.1"
26
  },
27
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip"
28
  },
29
  "qnn_context_binary": {
30
  "tool_versions": {
31
  "qairt": "2.45.0.260326154327"
32
  },
33
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs9075.zip"
34
  }
35
  },
36
  "qualcomm-sa7255p": {
@@ -38,7 +53,7 @@
38
  "tool_versions": {
39
  "qairt": "2.45.0.260326154327"
40
  },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa7255p.zip"
42
  }
43
  },
44
  "qualcomm-sa8295p": {
@@ -46,7 +61,7 @@
46
  "tool_versions": {
47
  "qairt": "2.45.0.260326154327"
48
  },
49
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8295p.zip"
50
  }
51
  },
52
  "qualcomm-sa8775p": {
@@ -54,7 +69,7 @@
54
  "tool_versions": {
55
  "qairt": "2.45.0.260326154327"
56
  },
57
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8775p.zip"
58
  }
59
  },
60
  "qualcomm-snapdragon-8-elite-for-galaxy": {
@@ -63,13 +78,13 @@
63
  "qairt": "2.45.0.260326154327",
64
  "onnx_runtime": "1.27.1"
65
  },
66
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
67
  },
68
  "qnn_context_binary": {
69
  "tool_versions": {
70
  "qairt": "2.45.0.260326154327"
71
  },
72
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
73
  }
74
  },
75
  "qualcomm-snapdragon-8-elite-gen5-for-galaxy": {
@@ -78,13 +93,13 @@
78
  "qairt": "2.45.0.260326154327",
79
  "onnx_runtime": "1.27.1"
80
  },
81
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
82
  },
83
  "qnn_context_binary": {
84
  "tool_versions": {
85
  "qairt": "2.45.0.260326154327"
86
  },
87
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
88
  }
89
  },
90
  "qualcomm-snapdragon-8gen1": {
@@ -93,13 +108,13 @@
93
  "qairt": "2.45.0.260326154327",
94
  "onnx_runtime": "1.27.1"
95
  },
96
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip"
97
  },
98
  "qnn_context_binary": {
99
  "tool_versions": {
100
  "qairt": "2.45.0.260326154327"
101
  },
102
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip"
103
  }
104
  },
105
  "qualcomm-snapdragon-8gen3": {
@@ -108,13 +123,13 @@
108
  "qairt": "2.45.0.260326154327",
109
  "onnx_runtime": "1.27.1"
110
  },
111
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip"
112
  },
113
  "qnn_context_binary": {
114
  "tool_versions": {
115
  "qairt": "2.45.0.260326154327"
116
  },
117
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip"
118
  }
119
  },
120
  "qualcomm-snapdragon-x-elite": {
@@ -123,13 +138,13 @@
123
  "qairt": "2.45.0.260326154327",
124
  "onnx_runtime": "1.27.1"
125
  },
126
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip"
127
  },
128
  "qnn_context_binary": {
129
  "tool_versions": {
130
  "qairt": "2.45.0.260326154327"
131
  },
132
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip"
133
  }
134
  },
135
  "qualcomm-snapdragon-x2-elite": {
@@ -138,13 +153,13 @@
138
  "qairt": "2.45.0.260326154327",
139
  "onnx_runtime": "1.27.1"
140
  },
141
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip"
142
  },
143
  "qnn_context_binary": {
144
  "tool_versions": {
145
  "qairt": "2.45.0.260326154327"
146
  },
147
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.59.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip"
148
  }
149
  }
150
  }
 
1
  {
2
+ "version": "0.60.0",
3
  "precisions": {
4
  "float": {
5
  "chipset_assets": {
6
+ "qualcomm-qcs8275": {
7
+ "precompiled_qnn_onnx": {
8
+ "tool_versions": {
9
+ "qairt": "2.45.0.260326154327",
10
+ "onnx_runtime": "1.27.1"
11
+ },
12
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8275.zip"
13
+ },
14
+ "qnn_context_binary": {
15
+ "tool_versions": {
16
+ "qairt": "2.45.0.260326154327"
17
+ },
18
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8275.zip"
19
+ }
20
+ },
21
  "qualcomm-qcs8550-proxy": {
22
  "precompiled_qnn_onnx": {
23
  "tool_versions": {
24
  "qairt": "2.45.0.260326154327",
25
  "onnx_runtime": "1.27.1"
26
  },
27
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip"
28
  },
29
  "qnn_context_binary": {
30
  "tool_versions": {
31
  "qairt": "2.45.0.260326154327"
32
  },
33
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip"
34
  }
35
  },
36
  "qualcomm-qcs9075": {
 
39
  "qairt": "2.45.0.260326154327",
40
  "onnx_runtime": "1.27.1"
41
  },
42
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip"
43
  },
44
  "qnn_context_binary": {
45
  "tool_versions": {
46
  "qairt": "2.45.0.260326154327"
47
  },
48
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_qcs9075.zip"
49
  }
50
  },
51
  "qualcomm-sa7255p": {
 
53
  "tool_versions": {
54
  "qairt": "2.45.0.260326154327"
55
  },
56
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa7255p.zip"
57
  }
58
  },
59
  "qualcomm-sa8295p": {
 
61
  "tool_versions": {
62
  "qairt": "2.45.0.260326154327"
63
  },
64
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8295p.zip"
65
  }
66
  },
67
  "qualcomm-sa8775p": {
 
69
  "tool_versions": {
70
  "qairt": "2.45.0.260326154327"
71
  },
72
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_sa8775p.zip"
73
  }
74
  },
75
  "qualcomm-snapdragon-8-elite-for-galaxy": {
 
78
  "qairt": "2.45.0.260326154327",
79
  "onnx_runtime": "1.27.1"
80
  },
81
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
82
  },
83
  "qnn_context_binary": {
84
  "tool_versions": {
85
  "qairt": "2.45.0.260326154327"
86
  },
87
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
88
  }
89
  },
90
  "qualcomm-snapdragon-8-elite-gen5-for-galaxy": {
 
93
  "qairt": "2.45.0.260326154327",
94
  "onnx_runtime": "1.27.1"
95
  },
96
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
97
  },
98
  "qnn_context_binary": {
99
  "tool_versions": {
100
  "qairt": "2.45.0.260326154327"
101
  },
102
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
103
  }
104
  },
105
  "qualcomm-snapdragon-8gen1": {
 
108
  "qairt": "2.45.0.260326154327",
109
  "onnx_runtime": "1.27.1"
110
  },
111
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip"
112
  },
113
  "qnn_context_binary": {
114
  "tool_versions": {
115
  "qairt": "2.45.0.260326154327"
116
  },
117
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip"
118
  }
119
  },
120
  "qualcomm-snapdragon-8gen3": {
 
123
  "qairt": "2.45.0.260326154327",
124
  "onnx_runtime": "1.27.1"
125
  },
126
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip"
127
  },
128
  "qnn_context_binary": {
129
  "tool_versions": {
130
  "qairt": "2.45.0.260326154327"
131
  },
132
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip"
133
  }
134
  },
135
  "qualcomm-snapdragon-x-elite": {
 
138
  "qairt": "2.45.0.260326154327",
139
  "onnx_runtime": "1.27.1"
140
  },
141
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip"
142
  },
143
  "qnn_context_binary": {
144
  "tool_versions": {
145
  "qairt": "2.45.0.260326154327"
146
  },
147
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip"
148
  }
149
  },
150
  "qualcomm-snapdragon-x2-elite": {
 
153
  "qairt": "2.45.0.260326154327",
154
  "onnx_runtime": "1.27.1"
155
  },
156
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip"
157
  },
158
  "qnn_context_binary": {
159
  "tool_versions": {
160
  "qairt": "2.45.0.260326154327"
161
  },
162
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/centernet_pose/releases/v0.60.0/centernet_pose-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip"
163
  }
164
  }
165
  }