YOLOv8-Detection: Optimized for Qualcomm Devices
Ultralytics YOLOv8 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of YOLOv8-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for YOLOv8-Detection on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Model checkpoint: YOLOv8-N
- Input resolution: 640x640
- Number of parameters: 3.18M
- Model size (float): 12.2 MB
- Model size (w8a8): 3.25 MB
- Model size (w8a16): 3.60 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| YOLOv8-Detection | ONNX | float | Snapdragon® X2 Elite | 2.982 ms | 3 - 3 MB | NPU |
| YOLOv8-Detection | ONNX | float | Snapdragon® X Elite | 6.413 ms | 5 - 5 MB | NPU |
| YOLOv8-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 3.594 ms | 1 - 276 MB | NPU |
| YOLOv8-Detection | ONNX | float | Qualcomm® QCS8550 (Proxy) | 5.833 ms | 5 - 15 MB | NPU |
| YOLOv8-Detection | ONNX | float | Qualcomm® QCS9075 | 6.763 ms | 5 - 7 MB | NPU |
| YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.875 ms | 0 - 213 MB | NPU |
| YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.523 ms | 0 - 217 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 1.99 ms | 0 - 0 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X Elite | 4.916 ms | 2 - 2 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.754 ms | 2 - 96 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS6490 | 334.407 ms | 64 - 69 MB | CPU |
| YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 4.465 ms | 2 - 7 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS9075 | 5.718 ms | 2 - 5 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCM6690 | 171.943 ms | 65 - 74 MB | CPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 2.027 ms | 0 - 65 MB | NPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 158.047 ms | 68 - 76 MB | CPU |
| YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.835 ms | 0 - 71 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 0.705 ms | 0 - 0 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X Elite | 1.764 ms | 2 - 2 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.036 ms | 0 - 65 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS6490 | 58.165 ms | 20 - 28 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.532 ms | 0 - 16 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS9075 | 1.832 ms | 0 - 3 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCM6690 | 43.275 ms | 21 - 31 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.753 ms | 0 - 52 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 33.391 ms | 25 - 35 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.646 ms | 0 - 51 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X2 Elite | 3.368 ms | 5 - 5 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X Elite | 8.355 ms | 3 - 3 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 5.239 ms | 3 - 146 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS6490 | 118.055 ms | 59 - 69 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS8550 (Proxy) | 7.694 ms | 0 - 10 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS9075 | 9.931 ms | 2 - 5 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCM6690 | 75.866 ms | 57 - 69 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite For Galaxy Mobile | 3.892 ms | 2 - 224 MB | NPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 67.628 ms | 66 - 76 MB | CPU |
| YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.121 ms | 0 - 112 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 2.409 ms | 5 - 5 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Snapdragon® X Elite | 4.006 ms | 5 - 5 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 2.709 ms | 0 - 204 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 13.564 ms | 0 - 177 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 3.607 ms | 5 - 20 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8775P | 21.268 ms | 0 - 178 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS9075 | 4.919 ms | 5 - 11 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.099 ms | 5 - 190 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA7255P | 13.564 ms | 0 - 177 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8295P | 7.903 ms | 0 - 159 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.006 ms | 0 - 179 MB | NPU |
| YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.836 ms | 4 - 185 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1.707 ms | 2 - 2 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 3.719 ms | 2 - 2 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.259 ms | 0 - 74 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 8.665 ms | 2 - 6 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 6.887 ms | 0 - 51 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.334 ms | 2 - 4 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 3.911 ms | 0 - 54 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 3.728 ms | 2 - 6 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 19.554 ms | 2 - 169 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 3.995 ms | 2 - 73 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 6.887 ms | 0 - 51 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 4.613 ms | 1 - 50 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.554 ms | 2 - 54 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.689 ms | 2 - 170 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.251 ms | 2 - 60 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.837 ms | 1 - 1 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.605 ms | 1 - 1 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.942 ms | 1 - 53 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3.454 ms | 1 - 4 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.291 ms | 1 - 37 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.388 ms | 1 - 3 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.792 ms | 1 - 40 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 1.699 ms | 3 - 6 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 8.475 ms | 1 - 153 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.658 ms | 1 - 53 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.291 ms | 1 - 37 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.222 ms | 0 - 34 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.698 ms | 1 - 37 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.507 ms | 1 - 37 MB | NPU |
| YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.578 ms | 1 - 39 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 2.397 ms | 0 - 110 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.92 ms | 0 - 78 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 3.269 ms | 0 - 3 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® SA8775P | 4.873 ms | 0 - 84 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® QCS9075 | 4.622 ms | 0 - 14 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 6.233 ms | 0 - 79 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® SA7255P | 12.92 ms | 0 - 78 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Qualcomm® SA8295P | 7.192 ms | 0 - 50 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.797 ms | 0 - 81 MB | NPU |
| YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.376 ms | 0 - 94 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.898 ms | 0 - 52 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS6490 | 3.653 ms | 0 - 7 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.154 ms | 0 - 35 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.318 ms | 0 - 10 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 6.807 ms | 0 - 37 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS9075 | 1.676 ms | 0 - 7 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCM6690 | 8.352 ms | 0 - 151 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.612 ms | 0 - 52 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 3.154 ms | 0 - 35 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 2.161 ms | 0 - 34 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.661 ms | 0 - 34 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.481 ms | 0 - 35 MB | NPU |
| YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.574 ms | 0 - 40 MB | NPU |
License
- The license for the original implementation of YOLOv8-Detection can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
