qaihm-bot commited on
Commit
6e27fde
·
verified ·
1 Parent(s): 7c966d5

See https://github.com/qualcomm/ai-hub-models/releases/v0.48.0 for changelog.

Files changed (1) hide show
  1. README.md +105 -103
README.md CHANGED
@@ -15,18 +15,18 @@ pipeline_tag: object-detection
15
  Ultralytics YOLOv8 is a machine learning model that predicts bounding boxes and classes of objects in an image.
16
 
17
  This is based on the implementation of YOLOv8-Detection found [here](https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/yolo/detect).
18
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
22
  ## Getting Started
23
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
24
- Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) Python library to compile and export the model with your own:
25
  - Custom weights (e.g., fine-tuned checkpoints)
26
  - Custom input shapes
27
  - Target device and runtime configurations
28
 
29
- See our repository for [YOLOv8-Detection on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) for usage instructions.
30
 
31
 
32
  ## Model Details
@@ -44,106 +44,108 @@ See our repository for [YOLOv8-Detection on GitHub](https://github.com/quic/ai-h
44
  ## Performance Summary
45
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
46
  |---|---|---|---|---|---|---
47
- | YOLOv8-Detection | ONNX | float | Snapdragon® X Elite | 6.342 ms | 5 - 5 MB | NPU
48
- | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 3.606 ms | 1 - 268 MB | NPU
49
- | YOLOv8-Detection | ONNX | float | Qualcomm® QCS8550 (Proxy) | 5.83 ms | 5 - 16 MB | NPU
50
- | YOLOv8-Detection | ONNX | float | Qualcomm® QCS9075 | 6.748 ms | 5 - 7 MB | NPU
51
- | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.872 ms | 1 - 215 MB | NPU
52
- | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.527 ms | 1 - 218 MB | NPU
53
- | YOLOv8-Detection | ONNX | float | Snapdragon® X2 Elite | 2.978 ms | 3 - 3 MB | NPU
54
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X Elite | 4.917 ms | 2 - 2 MB | NPU
55
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.763 ms | 2 - 89 MB | NPU
56
- | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS6490 | 336.932 ms | 66 - 71 MB | CPU
57
- | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 4.481 ms | 2 - 6 MB | NPU
58
- | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS9075 | 5.758 ms | 2 - 5 MB | NPU
59
- | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCM6690 | 172.577 ms | 65 - 73 MB | CPU
60
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 2.023 ms | 1 - 69 MB | NPU
61
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 157.233 ms | 65 - 74 MB | CPU
62
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.831 ms | 0 - 70 MB | NPU
63
- | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 1.978 ms | 0 - 0 MB | NPU
64
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X Elite | 1.806 ms | 2 - 2 MB | NPU
65
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.048 ms | 0 - 70 MB | NPU
66
- | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS6490 | 59.877 ms | 20 - 29 MB | CPU
67
- | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.542 ms | 0 - 11 MB | NPU
68
- | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS9075 | 1.843 ms | 0 - 3 MB | NPU
69
- | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCM6690 | 43.601 ms | 22 - 31 MB | CPU
70
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.744 ms | 0 - 51 MB | NPU
71
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 34.074 ms | 27 - 37 MB | CPU
72
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.65 ms | 0 - 50 MB | NPU
73
- | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 1.156 ms | 0 - 0 MB | NPU
74
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X Elite | 8.658 ms | 3 - 3 MB | NPU
75
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 5.515 ms | 3 - 163 MB | NPU
76
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS6490 | 119.565 ms | 59 - 69 MB | CPU
77
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS8550 (Proxy) | 7.981 ms | 2 - 5 MB | NPU
78
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS9075 | 10.28 ms | 2 - 5 MB | NPU
79
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCM6690 | 76.787 ms | 59 - 70 MB | CPU
80
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite For Galaxy Mobile | 3.888 ms | 2 - 121 MB | NPU
81
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 62.642 ms | 67 - 78 MB | CPU
82
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.361 ms | 0 - 115 MB | NPU
83
- | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X2 Elite | 3.619 ms | 4 - 4 MB | NPU
84
- | YOLOv8-Detection | QNN_DLC | float | Snapdragon® X Elite | 3.953 ms | 5 - 5 MB | NPU
85
- | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 2.7 ms | 5 - 210 MB | NPU
86
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 13.543 ms | 1 - 178 MB | NPU
87
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 3.612 ms | 4 - 15 MB | NPU
88
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8775P | 5.236 ms | 1 - 181 MB | NPU
89
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS9075 | 4.891 ms | 5 - 11 MB | NPU
90
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.115 ms | 5 - 189 MB | NPU
91
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA7255P | 13.543 ms | 1 - 178 MB | NPU
92
- | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8295P | 7.89 ms | 1 - 160 MB | NPU
93
- | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.997 ms | 5 - 183 MB | NPU
94
- | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.706 ms | 5 - 185 MB | NPU
95
- | YOLOv8-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 2.415 ms | 5 - 5 MB | NPU
96
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 3.679 ms | 2 - 2 MB | NPU
97
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.272 ms | 2 - 76 MB | NPU
98
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 9.08 ms | 2 - 6 MB | NPU
99
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.343 ms | 2 - 10 MB | NPU
100
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 3.916 ms | 1 - 54 MB | NPU
101
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 3.73 ms | 1 - 4 MB | NPU
102
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 20.514 ms | 2 - 169 MB | NPU
103
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 4.05 ms | 2 - 74 MB | NPU
104
- | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 4.638 ms | 0 - 49 MB | NPU
105
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.559 ms | 2 - 54 MB | NPU
106
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.646 ms | 0 - 168 MB | NPU
107
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.252 ms | 1 - 59 MB | NPU
108
- | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1.9 ms | 2 - 2 MB | NPU
109
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.609 ms | 1 - 1 MB | NPU
110
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.945 ms | 1 - 52 MB | NPU
111
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3.34 ms | 1 - 4 MB | NPU
112
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.311 ms | 1 - 38 MB | NPU
113
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.393 ms | 1 - 3 MB | NPU
114
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.79 ms | 1 - 40 MB | NPU
115
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 1.707 ms | 1 - 4 MB | NPU
116
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 8.376 ms | 1 - 156 MB | NPU
117
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.672 ms | 1 - 52 MB | NPU
118
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.311 ms | 1 - 38 MB | NPU
119
- | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.22 ms | 1 - 36 MB | NPU
120
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.708 ms | 1 - 36 MB | NPU
121
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.519 ms | 0 - 35 MB | NPU
122
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.576 ms | 1 - 39 MB | NPU
123
- | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.838 ms | 1 - 1 MB | NPU
124
- | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 2.394 ms | 0 - 110 MB | NPU
125
- | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 57.706 ms | 3 - 33 MB | GPU
126
- | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 3.283 ms | 0 - 3 MB | NPU
127
- | YOLOv8-Detection | TFLITE | float | Qualcomm® SA8775P | 4.881 ms | 0 - 85 MB | NPU
128
- | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS9075 | 4.633 ms | 0 - 14 MB | NPU
129
- | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 6.243 ms | 0 - 74 MB | NPU
130
- | YOLOv8-Detection | TFLITE | float | Qualcomm® SA7255P | 57.706 ms | 3 - 33 MB | GPU
131
- | YOLOv8-Detection | TFLITE | float | Qualcomm® SA8295P | 7.191 ms | 0 - 50 MB | NPU
132
- | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.798 ms | 0 - 91 MB | NPU
133
- | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.382 ms | 0 - 94 MB | NPU
134
- | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.91 ms | 0 - 51 MB | NPU
135
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS6490 | 3.242 ms | 0 - 7 MB | NPU
136
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.16 ms | 0 - 35 MB | NPU
137
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.332 ms | 0 - 8 MB | NPU
138
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 1.718 ms | 0 - 40 MB | NPU
139
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS9075 | 1.675 ms | 0 - 7 MB | NPU
140
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCM6690 | 8.435 ms | 0 - 154 MB | NPU
141
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.583 ms | 0 - 51 MB | NPU
142
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 3.16 ms | 0 - 35 MB | NPU
143
- | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 2.144 ms | 0 - 34 MB | NPU
144
- | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.662 ms | 0 - 34 MB | NPU
145
- | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.48 ms | 0 - 35 MB | NPU
146
- | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.573 ms | 0 - 39 MB | NPU
 
 
147
 
148
  ## License
149
  * The license for the original implementation of YOLOv8-Detection can be found
 
15
  Ultralytics YOLOv8 is a machine learning model that predicts bounding boxes and classes of objects in an image.
16
 
17
  This is based on the implementation of YOLOv8-Detection found [here](https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/yolo/detect).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
22
  ## Getting Started
23
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
24
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) Python library to compile and export the model with your own:
25
  - Custom weights (e.g., fine-tuned checkpoints)
26
  - Custom input shapes
27
  - Target device and runtime configurations
28
 
29
+ See our repository for [YOLOv8-Detection on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/yolov8_det) for usage instructions.
30
 
31
 
32
  ## Model Details
 
44
  ## Performance Summary
45
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
46
  |---|---|---|---|---|---|---
47
+ | YOLOv8-Detection | ONNX | float | Snapdragon® X2 Elite | 2.982 ms | 3 - 3 MB | NPU
48
+ | YOLOv8-Detection | ONNX | float | Snapdragon® X Elite | 6.413 ms | 5 - 5 MB | NPU
49
+ | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 3.594 ms | 1 - 276 MB | NPU
50
+ | YOLOv8-Detection | ONNX | float | Qualcomm® QCS8550 (Proxy) | 5.833 ms | 5 - 15 MB | NPU
51
+ | YOLOv8-Detection | ONNX | float | Qualcomm® QCS9075 | 6.763 ms | 5 - 7 MB | NPU
52
+ | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.875 ms | 0 - 213 MB | NPU
53
+ | YOLOv8-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.523 ms | 0 - 217 MB | NPU
54
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 1.99 ms | 0 - 0 MB | NPU
55
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® X Elite | 4.916 ms | 2 - 2 MB | NPU
56
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.754 ms | 2 - 96 MB | NPU
57
+ | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS6490 | 334.407 ms | 64 - 69 MB | CPU
58
+ | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 4.465 ms | 2 - 7 MB | NPU
59
+ | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCS9075 | 5.718 ms | 2 - 5 MB | NPU
60
+ | YOLOv8-Detection | ONNX | w8a16 | Qualcomm® QCM6690 | 171.943 ms | 65 - 74 MB | CPU
61
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 2.027 ms | 0 - 65 MB | NPU
62
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 158.047 ms | 68 - 76 MB | CPU
63
+ | YOLOv8-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.835 ms | 0 - 71 MB | NPU
64
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 0.705 ms | 0 - 0 MB | NPU
65
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® X Elite | 1.764 ms | 2 - 2 MB | NPU
66
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.036 ms | 0 - 65 MB | NPU
67
+ | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS6490 | 58.165 ms | 20 - 28 MB | CPU
68
+ | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.532 ms | 0 - 16 MB | NPU
69
+ | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCS9075 | 1.832 ms | 0 - 3 MB | NPU
70
+ | YOLOv8-Detection | ONNX | w8a8 | Qualcomm® QCM6690 | 43.275 ms | 21 - 31 MB | CPU
71
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.753 ms | 0 - 52 MB | NPU
72
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 33.391 ms | 25 - 35 MB | CPU
73
+ | YOLOv8-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.646 ms | 0 - 51 MB | NPU
74
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X2 Elite | 3.368 ms | 5 - 5 MB | NPU
75
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® X Elite | 8.355 ms | 3 - 3 MB | NPU
76
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 5.239 ms | 3 - 146 MB | NPU
77
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS6490 | 118.055 ms | 59 - 69 MB | CPU
78
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS8550 (Proxy) | 7.694 ms | 0 - 10 MB | NPU
79
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCS9075 | 9.931 ms | 2 - 5 MB | NPU
80
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Qualcomm® QCM6690 | 75.866 ms | 57 - 69 MB | CPU
81
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite For Galaxy Mobile | 3.892 ms | 2 - 224 MB | NPU
82
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 67.628 ms | 66 - 76 MB | CPU
83
+ | YOLOv8-Detection | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.121 ms | 0 - 112 MB | NPU
84
+ | YOLOv8-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 2.409 ms | 5 - 5 MB | NPU
85
+ | YOLOv8-Detection | QNN_DLC | float | Snapdragon® X Elite | 4.006 ms | 5 - 5 MB | NPU
86
+ | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 2.709 ms | 0 - 204 MB | NPU
87
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 13.564 ms | 0 - 177 MB | NPU
88
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 3.607 ms | 5 - 20 MB | NPU
89
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8775P | 21.268 ms | 0 - 178 MB | NPU
90
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS9075 | 4.919 ms | 5 - 11 MB | NPU
91
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.099 ms | 5 - 190 MB | NPU
92
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA7255P | 13.564 ms | 0 - 177 MB | NPU
93
+ | YOLOv8-Detection | QNN_DLC | float | Qualcomm® SA8295P | 7.903 ms | 0 - 159 MB | NPU
94
+ | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.006 ms | 0 - 179 MB | NPU
95
+ | YOLOv8-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.836 ms | 4 - 185 MB | NPU
96
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1.707 ms | 2 - 2 MB | NPU
97
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 3.719 ms | 2 - 2 MB | NPU
98
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.259 ms | 0 - 74 MB | NPU
99
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 8.665 ms | 2 - 6 MB | NPU
100
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 6.887 ms | 0 - 51 MB | NPU
101
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.334 ms | 2 - 4 MB | NPU
102
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 3.911 ms | 0 - 54 MB | NPU
103
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 3.728 ms | 2 - 6 MB | NPU
104
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 19.554 ms | 2 - 169 MB | NPU
105
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 3.995 ms | 2 - 73 MB | NPU
106
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 6.887 ms | 0 - 51 MB | NPU
107
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 4.613 ms | 1 - 50 MB | NPU
108
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.554 ms | 2 - 54 MB | NPU
109
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.689 ms | 2 - 170 MB | NPU
110
+ | YOLOv8-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.251 ms | 2 - 60 MB | NPU
111
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.837 ms | 1 - 1 MB | NPU
112
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.605 ms | 1 - 1 MB | NPU
113
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.942 ms | 1 - 53 MB | NPU
114
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3.454 ms | 1 - 4 MB | NPU
115
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.291 ms | 1 - 37 MB | NPU
116
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.388 ms | 1 - 3 MB | NPU
117
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.792 ms | 1 - 40 MB | NPU
118
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 1.699 ms | 3 - 6 MB | NPU
119
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 8.475 ms | 1 - 153 MB | NPU
120
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.658 ms | 1 - 53 MB | NPU
121
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.291 ms | 1 - 37 MB | NPU
122
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.222 ms | 0 - 34 MB | NPU
123
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.698 ms | 1 - 37 MB | NPU
124
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.507 ms | 1 - 37 MB | NPU
125
+ | YOLOv8-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.578 ms | 1 - 39 MB | NPU
126
+ | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 2.397 ms | 0 - 110 MB | NPU
127
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.92 ms | 0 - 78 MB | NPU
128
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 3.269 ms | 0 - 3 MB | NPU
129
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® SA8775P | 4.873 ms | 0 - 84 MB | NPU
130
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS9075 | 4.622 ms | 0 - 14 MB | NPU
131
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 6.233 ms | 0 - 79 MB | NPU
132
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® SA7255P | 12.92 ms | 0 - 78 MB | NPU
133
+ | YOLOv8-Detection | TFLITE | float | Qualcomm® SA8295P | 7.192 ms | 0 - 50 MB | NPU
134
+ | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.797 ms | 0 - 81 MB | NPU
135
+ | YOLOv8-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.376 ms | 0 - 94 MB | NPU
136
+ | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 0.898 ms | 0 - 52 MB | NPU
137
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS6490 | 3.653 ms | 0 - 7 MB | NPU
138
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.154 ms | 0 - 35 MB | NPU
139
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.318 ms | 0 - 10 MB | NPU
140
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 6.807 ms | 0 - 37 MB | NPU
141
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS9075 | 1.676 ms | 0 - 7 MB | NPU
142
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCM6690 | 8.352 ms | 0 - 151 MB | NPU
143
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 1.612 ms | 0 - 52 MB | NPU
144
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 3.154 ms | 0 - 35 MB | NPU
145
+ | YOLOv8-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 2.161 ms | 0 - 34 MB | NPU
146
+ | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.661 ms | 0 - 34 MB | NPU
147
+ | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.481 ms | 0 - 35 MB | NPU
148
+ | YOLOv8-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.574 ms | 0 - 40 MB | NPU
149
 
150
  ## License
151
  * The license for the original implementation of YOLOv8-Detection can be found