Yolo-v7: Optimized for Qualcomm Devices
YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for Yolo-v7 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Model checkpoint: YoloV7 Tiny
- Input resolution: 640x640
- Number of parameters: 6.24M
- Model size (float): 23.8 MB
- Model size (w8a8): 6.23 MB
- Model size (w8a16): 6.66 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Yolo-v7 | ONNX | float | Snapdragon® X2 Elite | 5.801 ms | 208 - 208 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® X Elite | 10.782 ms | 176 - 176 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.742 ms | 6 - 182 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.463 ms | 6 - 187 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8550 (Proxy) | 10.719 ms | 5 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8450 | 17.463 ms | 6 - 187 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Mobile | 6.539 ms | 3 - 176 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.9 ms | 1 - 167 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS9075 | 14.527 ms | 5 - 50 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8750 | 6.539 ms | 3 - 176 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS7181 | 10.782 ms | 176 - 176 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X2 Elite | 4.393 ms | 210 - 210 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X Elite | 4.763 ms | 179 - 179 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.92 ms | 0 - 205 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 7.196 ms | 3 - 209 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS6490 | 14.742 ms | 2 - 48 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 4.539 ms | 0 - 13 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8450 | 7.196 ms | 3 - 209 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.744 ms | 1 - 190 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 2.221 ms | 0 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS9075 | 6.106 ms | 0 - 50 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 5.573 ms | 3 - 183 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCM6690 | 34.246 ms | 0 - 212 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS7790 | 5.573 ms | 3 - 183 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8750 | 2.221 ms | 0 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS7181 | 4.763 ms | 179 - 179 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X2 Elite | 1.064 ms | 212 - 212 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X Elite | 2.473 ms | 148 - 148 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.521 ms | 0 - 68 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.28 ms | 0 - 73 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS6490 | 8.463 ms | 1 - 46 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 2.36 ms | 0 - 15 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8450 | 3.28 ms | 0 - 73 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS9075 | 2.649 ms | 0 - 50 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCM6690 | 15.825 ms | 0 - 167 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.458 ms | 2 - 168 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.982 ms | 0 - 58 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.232 ms | 0 - 54 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS7790 | 3.458 ms | 2 - 168 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8750 | 1.232 ms | 0 - 54 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS7181 | 2.473 ms | 148 - 148 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X2 Elite | 6.301 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X Elite | 10.086 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 6.94 ms | 5 - 183 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 16.273 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8275 | 23.391 ms | 3 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 9.693 ms | 5 - 106 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8450 | 16.273 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.337 ms | 0 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA7255P | 23.391 ms | 3 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8295P | 13.359 ms | 2 - 154 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.627 ms | 5 - 164 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS9075 | 12.799 ms | 5 - 11 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8750 | 6.337 ms | 0 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS7181 | 10.086 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 2.061 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X Elite | 4.018 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.536 ms | 2 - 190 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 5.598 ms | 2 - 204 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 10.499 ms | 1 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 8.587 ms | 1 - 165 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.597 ms | 2 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 5.598 ms | 2 - 204 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.541 ms | 2 - 173 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 1.89 ms | 0 - 165 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 4.387 ms | 2 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.83 ms | 2 - 173 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 29.675 ms | 2 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8295P | 5.272 ms | 0 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA7255P | 8.587 ms | 1 - 165 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 4.83 ms | 2 - 173 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 1.89 ms | 0 - 165 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 4.018 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.978 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.321 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.324 ms | 1 - 58 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.795 ms | 1 - 64 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 5.874 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 4.323 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 2.059 ms | 1 - 12 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2.795 ms | 1 - 64 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 2.403 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 4.323 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 13.83 ms | 1 - 156 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.346 ms | 0 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.314 ms | 1 - 38 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.774 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.025 ms | 1 - 39 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 3.346 ms | 0 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 1.025 ms | 1 - 39 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 2.321 ms | 1 - 1 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.934 ms | 0 - 190 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 16.096 ms | 1 - 186 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8275 | 23.539 ms | 1 - 157 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 9.72 ms | 1 - 3 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8775P | 35.812 ms | 17 - 44 MB | GPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8650P | 35.812 ms | 17 - 44 MB | GPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8255P | 35.812 ms | 17 - 44 MB | GPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8450 | 16.096 ms | 1 - 186 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Mobile | 6.316 ms | 1 - 165 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA7255P | 23.539 ms | 1 - 157 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8295P | 13.315 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.697 ms | 1 - 168 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS9075 | 12.289 ms | 1 - 20 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8750 | 6.316 ms | 1 - 165 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.403 ms | 0 - 61 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.974 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS6490 | 5.908 ms | 0 - 9 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8275 | 4.658 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 2.08 ms | 0 - 68 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8775P | 36.846 ms | 15 - 45 MB | GPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8650P | 36.846 ms | 15 - 45 MB | GPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8255P | 36.846 ms | 15 - 45 MB | GPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.974 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS9075 | 2.363 ms | 0 - 9 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.658 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCM6690 | 14.009 ms | 0 - 157 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.496 ms | 0 - 165 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.596 ms | 0 - 42 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.887 ms | 0 - 86 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.11 ms | 0 - 66 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS7790 | 3.496 ms | 0 - 165 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8750 | 1.11 ms | 0 - 66 MB | NPU |
License
- The license for the original implementation of Yolo-v7 can be found here.
References
- YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
- Source Model Implementation
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
