YOLOv9-Detection: Optimized for Qualcomm Devices
Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for YOLOv9-Detection on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Input resolution: 640x640
- Model checkpoint: YOLOv9-T
- Model size (float): 8.84 MB
- Model size (w8a16): 3.25 MB
- Model size (w8a8): 3.23 MB
- Model size (w8a8_mixed_int16): 3.74 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| YOLOv9-Detection | ONNX | float | Snapdragon® X2 Elite | 3.824 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® X Elite | 10.797 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.541 ms | 5 - 270 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.086 ms | 5 - 255 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 11.228 ms | 5 - 8 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.475 ms | 5 - 10 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® QCS8450 | 17.086 ms | 5 - 255 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.84 ms | 5 - 7 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.797 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.402 ms | 0 - 213 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Mobile | 4.402 ms | 0 - 213 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.507 ms | 2 - 231 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 91.042 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X Elite | 314.879 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 228.237 ms | 3 - 164 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 390.55 ms | 3 - 161 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 605.501 ms | 2 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 295.611 ms | 2 - 6 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 300.194 ms | 2 - 7 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® QCS8450 | 390.55 ms | 3 - 161 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 304.244 ms | 2 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 314.879 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 647.719 ms | 2 - 238 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 272.679 ms | 5 - 257 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 115.415 ms | 2 - 133 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 115.415 ms | 2 - 133 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 91.363 ms | 2 - 135 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 272.679 ms | 5 - 257 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 110.647 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X Elite | 188.558 ms | 0 - 0 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.494 ms | 2 - 119 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.684 ms | 2 - 122 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 530.284 ms | 1 - 4 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 176.8 ms | 1 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 178.835 ms | 0 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® QCS8450 | 237.684 ms | 2 - 122 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 182.674 ms | 1 - 4 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 188.558 ms | 0 - 0 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 512.365 ms | 1 - 222 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 171.376 ms | 1 - 216 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 143.38 ms | 2 - 101 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 143.38 ms | 2 - 101 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.603 ms | 0 - 98 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 171.376 ms | 1 - 216 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 3.448 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® X Elite | 8.755 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 5.945 ms | 0 - 234 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 13.889 ms | 0 - 230 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 9.093 ms | 5 - 12 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 21.619 ms | 2 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.117 ms | 5 - 116 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8775P | 10.477 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8650P | 10.477 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8255P | 10.477 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® QCS8450 | 13.889 ms | 0 - 230 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 13.231 ms | 5 - 11 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 8.755 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.208 ms | 0 - 205 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA7255P | 21.619 ms | 2 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8295P | 13.374 ms | 0 - 203 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.208 ms | 0 - 205 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.828 ms | 5 - 212 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 80.371 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 224.569 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 165.683 ms | 3 - 122 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 357.547 ms | 2 - 121 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 603.748 ms | 1 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 228.408 ms | 2 - 7 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 447.437 ms | 2 - 92 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 214.113 ms | 3 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 235.393 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8650P | 235.393 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8255P | 235.393 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 357.547 ms | 2 - 121 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 234.469 ms | 2 - 6 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 224.569 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 561.094 ms | 2 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 286.418 ms | 3 - 221 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 114.457 ms | 2 - 97 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 447.437 ms | 2 - 92 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 301.596 ms | 0 - 96 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 114.457 ms | 2 - 97 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 79.598 ms | 2 - 104 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 286.418 ms | 3 - 221 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 100.74 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 175.953 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 135.898 ms | 1 - 83 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.685 ms | 1 - 83 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 586.665 ms | 1 - 3 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 177.331 ms | 1 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 347.726 ms | 2 - 62 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.376 ms | 2 - 3 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 170.705 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8650P | 170.705 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8255P | 170.705 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 237.685 ms | 1 - 83 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 170.202 ms | 3 - 6 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 175.953 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 510.998 ms | 1 - 186 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 176.085 ms | 1 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.235 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 347.726 ms | 2 - 62 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 202.931 ms | 1 - 62 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 133.235 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.317 ms | 1 - 67 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 176.085 ms | 1 - 63 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.588 ms | 0 - 125 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 11.97 ms | 0 - 110 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 8.734 ms | 0 - 14 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 21.026 ms | 0 - 94 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.689 ms | 0 - 2 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8775P | 10.228 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8650P | 10.228 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8255P | 10.228 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® QCS8450 | 11.97 ms | 0 - 110 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 9.924 ms | 0 - 14 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 2.964 ms | 0 - 102 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA7255P | 21.026 ms | 0 - 94 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8295P | 12.846 ms | 0 - 76 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Mobile | 2.964 ms | 0 - 102 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.322 ms | 0 - 116 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.679 ms | 0 - 86 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.917 ms | 0 - 80 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 566.54 ms | 0 - 7 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 177.027 ms | 0 - 7 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 347.382 ms | 0 - 60 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.002 ms | 0 - 2 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 182.55 ms | 0 - 64 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8650P | 182.55 ms | 0 - 64 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8255P | 182.55 ms | 0 - 64 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 | 237.917 ms | 0 - 80 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 204.599 ms | 0 - 7 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 500.54 ms | 0 - 185 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 178.252 ms | 0 - 59 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.036 ms | 1 - 59 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 347.382 ms | 0 - 60 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 202.824 ms | 0 - 58 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 133.036 ms | 1 - 59 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.393 ms | 0 - 62 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 178.252 ms | 0 - 59 MB | NPU |
License
- The license for the original implementation of YOLOv9-Detection can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
