YOLOv9-Detection: Optimized for Qualcomm Devices
Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for YOLOv9-Detection on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Model checkpoint: YOLOv9-T
- Input resolution: 640x640
- Model size (float): 8.84 MB
- Model size (w8a8): 3.23 MB
- Model size (w8a8_mixed_int16): 3.74 MB
- Model size (w8a16): 3.25 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| YOLOv9-Detection | ONNX | float | Snapdragon® X2 Elite | 3.829 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® X Elite | 10.795 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.534 ms | 5 - 267 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.165 ms | 5 - 252 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.474 ms | 5 - 10 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® QCS8450 | 17.165 ms | 5 - 252 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.512 ms | 1 - 226 MB | NPU |
| YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Mobile | 4.399 ms | 0 - 211 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.573 ms | 5 - 7 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.399 ms | 0 - 211 MB | NPU |
| YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.795 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 91.228 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X Elite | 315.06 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 228.271 ms | 3 - 167 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 390.756 ms | 3 - 165 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 605.283 ms | 2 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 300.172 ms | 3 - 7 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® QCS8450 | 390.756 ms | 3 - 165 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 115.319 ms | 1 - 132 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 304.182 ms | 2 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 272.744 ms | 3 - 257 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 91.363 ms | 2 - 138 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 646.023 ms | 2 - 240 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 272.744 ms | 3 - 257 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 115.319 ms | 1 - 132 MB | NPU |
| YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 315.06 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 110.788 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X Elite | 188.65 ms | 0 - 0 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.581 ms | 2 - 124 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.83 ms | 2 - 124 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 532.325 ms | 1 - 4 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 178.96 ms | 0 - 5 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® QCS8450 | 237.83 ms | 2 - 124 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 143.121 ms | 2 - 104 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 171.431 ms | 1 - 218 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 182.194 ms | 1 - 4 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.396 ms | 0 - 102 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 512.156 ms | 1 - 225 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 171.431 ms | 1 - 218 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 143.121 ms | 2 - 104 MB | NPU |
| YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 188.65 ms | 0 - 0 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 3.452 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® X Elite | 8.695 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 5.923 ms | 5 - 239 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 13.924 ms | 3 - 234 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® QCS8275 | 21.626 ms | 1 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.101 ms | 5 - 40 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8775P | 10.444 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8650P | 10.444 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8255P | 10.444 ms | 0 - 206 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® QCS8450 | 13.924 ms | 3 - 234 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.82 ms | 5 - 212 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.142 ms | 0 - 205 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 13.814 ms | 5 - 11 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA7255P | 21.626 ms | 1 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8295P | 13.404 ms | 0 - 203 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.142 ms | 0 - 205 MB | NPU |
| YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 8.695 ms | 5 - 5 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 80.188 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 224.345 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 165.605 ms | 2 - 119 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 357.638 ms | 2 - 120 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 604.762 ms | 4 - 8 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 447.263 ms | 1 - 91 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 214.255 ms | 2 - 138 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 235.288 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8650P | 235.288 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8255P | 235.288 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 357.638 ms | 2 - 120 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 114.646 ms | 2 - 96 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 235.566 ms | 0 - 4 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 447.263 ms | 1 - 91 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 301.459 ms | 0 - 96 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 286.124 ms | 3 - 216 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 79.638 ms | 2 - 101 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 562.349 ms | 2 - 204 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 286.124 ms | 3 - 216 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 114.646 ms | 2 - 96 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 224.345 ms | 2 - 2 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 100.851 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 175.996 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.175 ms | 1 - 84 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.872 ms | 1 - 83 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 585.99 ms | 1 - 4 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 347.827 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.155 ms | 2 - 4 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 170.799 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8650P | 170.799 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8255P | 170.799 ms | 1 - 64 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 237.872 ms | 1 - 83 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 132.783 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 175.996 ms | 1 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 192.609 ms | 0 - 3 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 347.827 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 203.095 ms | 1 - 62 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.386 ms | 1 - 67 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 510.94 ms | 1 - 185 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 175.996 ms | 1 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 132.783 ms | 2 - 63 MB | NPU |
| YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 175.996 ms | 1 - 1 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.584 ms | 0 - 121 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 11.913 ms | 0 - 110 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® QCS8275 | 21.017 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.729 ms | 0 - 5 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8775P | 10.195 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8650P | 10.195 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8255P | 10.195 ms | 0 - 107 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® QCS8450 | 11.913 ms | 0 - 110 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.335 ms | 0 - 115 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Mobile | 2.952 ms | 0 - 103 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 9.909 ms | 0 - 14 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA7255P | 21.017 ms | 0 - 95 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® SA8295P | 12.87 ms | 0 - 77 MB | NPU |
| YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 2.952 ms | 0 - 103 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.568 ms | 0 - 86 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.918 ms | 1 - 84 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 566.756 ms | 0 - 7 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® QCS8275 | 347.372 ms | 0 - 60 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.331 ms | 0 - 2 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 182.686 ms | 0 - 63 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8650P | 182.686 ms | 0 - 63 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8255P | 182.686 ms | 0 - 63 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 | 237.918 ms | 1 - 84 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 133.514 ms | 1 - 66 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 179.21 ms | 0 - 59 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 182.252 ms | 0 - 7 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 347.372 ms | 0 - 60 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 202.898 ms | 0 - 57 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.271 ms | 0 - 64 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 500.253 ms | 0 - 185 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 179.21 ms | 0 - 59 MB | NPU |
| YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.514 ms | 1 - 66 MB | NPU |
License
- The license for the original implementation of YOLOv9-Detection can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
