File size: 9,728 Bytes
ba41173 1529439 ba41173 1529439 ea34727 1529439 ba41173 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 |
---
library_name: pytorch
license: other
tags:
- real_time
- android
pipeline_tag: object-detection
---

# HRNetFace: Optimized for Qualcomm Devices
Detects attributes (liveness, eye closeness, mask presence, glasses presence, sunglasses presence) that apply to a given face.
This is based on the implementation of HRNetFace found [here](https://github.com/HRNet/HRNet-Facial-Landmark-Detection).
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/hrnet_face) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
## Getting Started
There are two ways to deploy this model on your device:
### Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-onnx-float.zip)
| ONNX | w8a8 | Universal | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-onnx-w8a8.zip)
| QNN_DLC | float | Universal | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-qnn_dlc-float.zip)
| QNN_DLC | w8a8 | Universal | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-qnn_dlc-w8a8.zip)
| TFLITE | float | Universal | QAIRT 2.42, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-tflite-float.zip)
| TFLITE | w8a8 | Universal | QAIRT 2.42, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/hrnet_face/releases/v0.46.0/hrnet_face-tflite-w8a8.zip)
For more device-specific assets and performance metrics, visit **[HRNetFace on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/hrnet_face)**.
### Option 2: Export with Custom Configurations
Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/hrnet_face) Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for [HRNetFace on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/hrnet_face) for usage instructions.
## Model Details
**Model Type:** Model_use_case.object_detection
**Model Stats:**
- Model checkpoint: HR18-COFW.pth
- Input resolution: 256x256
- Number of parameters: 9.68M
- Model size (float): 36.87MB
- Model size (w8a8): 17.7 MB
## Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
|---|---|---|---|---|---|---
| HRNetFace | ONNX | float | Snapdragon® X Elite | 3.233 ms | 30 - 30 MB | NPU
| HRNetFace | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 2.296 ms | 0 - 203 MB | NPU
| HRNetFace | ONNX | float | Qualcomm® QCS8550 (Proxy) | 3.221 ms | 1 - 3 MB | NPU
| HRNetFace | ONNX | float | Qualcomm® QCS9075 | 4.954 ms | 2 - 4 MB | NPU
| HRNetFace | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.917 ms | 0 - 146 MB | NPU
| HRNetFace | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.551 ms | 0 - 146 MB | NPU
| HRNetFace | ONNX | w8a8 | Snapdragon® X Elite | 1.545 ms | 15 - 15 MB | NPU
| HRNetFace | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.166 ms | 0 - 213 MB | NPU
| HRNetFace | ONNX | w8a8 | Qualcomm® QCS6490 | 91.814 ms | 18 - 37 MB | CPU
| HRNetFace | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.612 ms | 0 - 30 MB | NPU
| HRNetFace | ONNX | w8a8 | Qualcomm® QCS9075 | 1.791 ms | 0 - 3 MB | NPU
| HRNetFace | ONNX | w8a8 | Qualcomm® QCM6690 | 49.183 ms | 18 - 35 MB | CPU
| HRNetFace | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.913 ms | 0 - 163 MB | NPU
| HRNetFace | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 45.82 ms | 19 - 37 MB | CPU
| HRNetFace | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.774 ms | 0 - 165 MB | NPU
| HRNetFace | QNN_DLC | float | Snapdragon® X Elite | 3.707 ms | 1 - 1 MB | NPU
| HRNetFace | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 2.379 ms | 1 - 125 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 15.608 ms | 1 - 76 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 3.313 ms | 1 - 34 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® SA8775P | 5.144 ms | 1 - 80 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® QCS9075 | 5.092 ms | 3 - 6 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 4.973 ms | 0 - 105 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® SA7255P | 15.608 ms | 1 - 76 MB | NPU
| HRNetFace | QNN_DLC | float | Qualcomm® SA8295P | 5.681 ms | 1 - 62 MB | NPU
| HRNetFace | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.795 ms | 0 - 78 MB | NPU
| HRNetFace | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.416 ms | 1 - 81 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.605 ms | 0 - 0 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.957 ms | 0 - 109 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3.864 ms | 0 - 2 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.373 ms | 0 - 71 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.387 ms | 0 - 6 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.761 ms | 0 - 72 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 1.631 ms | 2 - 4 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 10.678 ms | 0 - 195 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.88 ms | 0 - 107 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.373 ms | 0 - 71 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.286 ms | 0 - 68 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.688 ms | 0 - 72 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.659 ms | 0 - 78 MB | NPU
| HRNetFace | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.553 ms | 0 - 72 MB | NPU
| HRNetFace | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 2.172 ms | 0 - 144 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 15.341 ms | 0 - 96 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 2.976 ms | 0 - 3 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® SA8775P | 4.875 ms | 0 - 97 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® QCS9075 | 4.725 ms | 0 - 35 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 4.511 ms | 0 - 127 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® SA7255P | 15.341 ms | 0 - 96 MB | NPU
| HRNetFace | TFLITE | float | Qualcomm® SA8295P | 5.359 ms | 0 - 75 MB | NPU
| HRNetFace | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.667 ms | 0 - 96 MB | NPU
| HRNetFace | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.332 ms | 0 - 99 MB | NPU
| HRNetFace | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.868 ms | 0 - 117 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCS6490 | 3.487 ms | 0 - 18 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.214 ms | 0 - 73 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.268 ms | 0 - 5 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® SA8775P | 6.374 ms | 0 - 75 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCS9075 | 1.475 ms | 0 - 18 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCM6690 | 10.058 ms | 0 - 190 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.73 ms | 0 - 108 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® SA7255P | 3.214 ms | 0 - 73 MB | NPU
| HRNetFace | TFLITE | w8a8 | Qualcomm® SA8295P | 2.18 ms | 0 - 68 MB | NPU
| HRNetFace | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.671 ms | 0 - 73 MB | NPU
| HRNetFace | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.563 ms | 0 - 72 MB | NPU
| HRNetFace | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.567 ms | 0 - 75 MB | NPU
## License
* The license for the original implementation of HRNetFace can be found
[here](https://github.com/HRNet/HRNet-Facial-Landmark-Detection/blob/master/LICENCE).
## References
* [Deep High-Resolution Representation Learning for Visual Recognition](https://arxiv.org/abs/1908.07919)
* [Source Model Implementation](https://github.com/HRNet/HRNet-Facial-Landmark-Detection)
## Community
* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).
|