Hugging Face's logo

qualcomm
/
YOLOv8-Detection

Object Detection
PyTorch
real_time
android
Model card Files
xet
Community
1
qaihm-bot commited on
Commit
1ac884e
·
verified ·
1 Parent(s): 3d09354

v0.42.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (1) hide show
  1. README.md +107 -100
README.md CHANGED
@@ -38,102 +38,109 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 13.467 ms | 0 - 81 MB | NPU | -- |
42
- | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.009 ms | 0 - 120 MB | NPU | -- |
43
- | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.131 ms | 0 - 40 MB | NPU | -- |
44
- | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 7.56 ms | 5 - 41 MB | NPU | -- |
45
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.473 ms | 0 - 82 MB | NPU | -- |
46
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.301 ms | 0 - 66 MB | NPU | -- |
47
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.338 ms | 0 - 59 MB | NPU | -- |
48
- | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 20.509 ms | 0 - 81 MB | NPU | -- |
49
- | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.904 ms | 1 - 105 MB | NPU | -- |
50
- | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 13.467 ms | 0 - 81 MB | NPU | -- |
51
- | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.009 ms | 0 - 120 MB | NPU | -- |
52
- | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.488 ms | 0 - 88 MB | NPU | -- |
53
- | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.287 ms | 5 - 83 MB | NPU | -- |
54
- | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.219 ms | 0 - 34 MB | NPU | -- |
55
- | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.175 ms | 0 - 32 MB | NPU | -- |
56
- | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.484 ms | 0 - 87 MB | NPU | -- |
57
- | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.296 ms | 5 - 79 MB | NPU | -- |
58
- | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 20.509 ms | 0 - 81 MB | NPU | -- |
59
- | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.904 ms | 1 - 105 MB | NPU | -- |
60
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.586 ms | 0 - 162 MB | NPU | -- |
61
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.453 ms | 5 - 261 MB | NPU | -- |
62
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.454 ms | 0 - 102 MB | NPU | -- |
63
- | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.039 ms | 0 - 87 MB | NPU | -- |
64
- | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.862 ms | 5 - 107 MB | NPU | -- |
65
- | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.905 ms | 2 - 85 MB | NPU | -- |
66
- | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.565 ms | 0 - 82 MB | NPU | -- |
67
- | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.461 ms | 5 - 128 MB | NPU | -- |
68
- | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.422 ms | 1 - 69 MB | NPU | -- |
69
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.702 ms | 141 - 141 MB | NPU | -- |
70
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.607 ms | 5 - 5 MB | NPU | -- |
71
- | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.289 ms | 2 - 32 MB | NPU | -- |
72
- | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.948 ms | 2 - 43 MB | NPU | -- |
73
- | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.173 ms | 2 - 13 MB | NPU | -- |
74
- | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.112 ms | 1 - 56 MB | NPU | -- |
75
- | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.762 ms | 2 - 31 MB | NPU | -- |
76
- | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 164.771 ms | 65 - 79 MB | CPU | -- |
77
- | YOLOv8-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 136.502 ms | 62 - 66 MB | CPU | -- |
78
- | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.289 ms | 2 - 32 MB | NPU | -- |
79
- | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.18 ms | 1 - 13 MB | NPU | -- |
80
- | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.345 ms | 2 - 41 MB | NPU | -- |
81
- | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.185 ms | 2 - 13 MB | NPU | -- |
82
- | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.762 ms | 2 - 31 MB | NPU | -- |
83
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.105 ms | 2 - 38 MB | NPU | -- |
84
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.068 ms | 0 - 106 MB | NPU | -- |
85
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.476 ms | 2 - 38 MB | NPU | -- |
86
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.392 ms | 0 - 76 MB | NPU | -- |
87
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.201 ms | 2 - 40 MB | NPU | -- |
88
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.147 ms | 1 - 78 MB | NPU | -- |
89
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.568 ms | 5 - 5 MB | NPU | -- |
90
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.257 ms | 2 - 2 MB | NPU | -- |
91
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.182 ms | 0 - 24 MB | NPU | -- |
92
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.047 ms | 1 - 25 MB | NPU | -- |
93
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.585 ms | 0 - 35 MB | NPU | -- |
94
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.595 ms | 1 - 33 MB | NPU | -- |
95
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.416 ms | 0 - 14 MB | NPU | -- |
96
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.308 ms | 1 - 15 MB | NPU | -- |
97
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.196 ms | 0 - 45 MB | NPU | -- |
98
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.865 ms | 0 - 24 MB | NPU | -- |
99
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.678 ms | 1 - 25 MB | NPU | -- |
100
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.697 ms | 0 - 32 MB | NPU | -- |
101
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.409 ms | 0 - 33 MB | NPU | -- |
102
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 40.749 ms | 22 - 38 MB | CPU | -- |
103
- | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 43.901 ms | 3 - 11 MB | NPU | -- |
104
- | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 36.395 ms | 21 - 27 MB | CPU | -- |
105
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.182 ms | 0 - 24 MB | NPU | -- |
106
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.047 ms | 1 - 25 MB | NPU | -- |
107
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.41 ms | 0 - 15 MB | NPU | -- |
108
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.311 ms | 1 - 16 MB | NPU | -- |
109
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.245 ms | 0 - 31 MB | NPU | -- |
110
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.073 ms | 1 - 31 MB | NPU | -- |
111
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.412 ms | 0 - 15 MB | NPU | -- |
112
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.311 ms | 1 - 16 MB | NPU | -- |
113
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.865 ms | 0 - 24 MB | NPU | -- |
114
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.678 ms | 1 - 25 MB | NPU | -- |
115
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.935 ms | 0 - 36 MB | NPU | -- |
116
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.899 ms | 1 - 32 MB | NPU | -- |
117
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.465 ms | 0 - 147 MB | NPU | -- |
118
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.729 ms | 0 - 28 MB | NPU | -- |
119
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.644 ms | 1 - 29 MB | NPU | -- |
120
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.09 ms | 0 - 81 MB | NPU | -- |
121
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.652 ms | 0 - 29 MB | NPU | -- |
122
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.583 ms | 1 - 35 MB | NPU | -- |
123
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.956 ms | 0 - 85 MB | NPU | -- |
124
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.546 ms | 2 - 2 MB | NPU | -- |
125
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.192 ms | 2 - 2 MB | NPU | -- |
126
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.367 ms | 1 - 25 MB | NPU | -- |
127
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.035 ms | 2 - 12 MB | NPU | -- |
128
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.544 ms | 1 - 25 MB | NPU | -- |
129
- | YOLOv8-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.367 ms | 1 - 25 MB | NPU | -- |
130
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.037 ms | 2 - 12 MB | NPU | -- |
131
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.04 ms | 2 - 12 MB | NPU | -- |
132
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.544 ms | 1 - 25 MB | NPU | -- |
133
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.369 ms | 2 - 38 MB | NPU | -- |
134
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.984 ms | 2 - 36 MB | NPU | -- |
135
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.819 ms | 2 - 32 MB | NPU | -- |
136
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.318 ms | 2 - 2 MB | NPU | -- |
 
 
 
 
 
 
 
137
 
138
 
139
 
@@ -148,9 +155,9 @@ pip install "qai-hub-models[yolov8-det]"
148
  ```
149
 
150
 
151
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
152
 
153
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
154
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
155
 
156
  With this API token, you can configure your client to run models on the cloud
@@ -158,7 +165,7 @@ hosted devices.
158
  ```bash
159
  qai-hub configure --api_token API_TOKEN
160
  ```
161
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
162
 
163
 
164
 
@@ -269,7 +276,7 @@ With the output of the model, you can compute like PSNR, relative errors or
269
  spot check the output with expected output.
270
 
271
  **Note**: This on-device profiling and inference requires access to Qualcomm®
272
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
273
 
274
 
275
 
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 13.463 ms | 0 - 82 MB | NPU | -- |
42
+ | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.006 ms | 2 - 124 MB | NPU | -- |
43
+ | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.16 ms | 0 - 45 MB | NPU | -- |
44
+ | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 6.869 ms | 5 - 43 MB | NPU | -- |
45
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 3.494 ms | 0 - 84 MB | NPU | -- |
46
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.285 ms | 5 - 75 MB | NPU | -- |
47
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.389 ms | 0 - 74 MB | NPU | -- |
48
+ | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 4.998 ms | 0 - 82 MB | NPU | -- |
49
+ | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.934 ms | 1 - 106 MB | NPU | -- |
50
+ | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 13.463 ms | 0 - 82 MB | NPU | -- |
51
+ | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.006 ms | 2 - 124 MB | NPU | -- |
52
+ | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 3.493 ms | 0 - 87 MB | NPU | -- |
53
+ | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.293 ms | 0 - 73 MB | NPU | -- |
54
+ | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.208 ms | 0 - 35 MB | NPU | -- |
55
+ | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.141 ms | 0 - 33 MB | NPU | -- |
56
+ | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 3.484 ms | 0 - 84 MB | NPU | -- |
57
+ | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.3 ms | 0 - 73 MB | NPU | -- |
58
+ | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 4.998 ms | 0 - 82 MB | NPU | -- |
59
+ | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.934 ms | 1 - 106 MB | NPU | -- |
60
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.585 ms | 0 - 162 MB | NPU | -- |
61
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.454 ms | 5 - 262 MB | NPU | -- |
62
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.447 ms | 0 - 108 MB | NPU | -- |
63
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.056 ms | 0 - 89 MB | NPU | -- |
64
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.896 ms | 5 - 112 MB | NPU | -- |
65
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.048 ms | 3 - 84 MB | NPU | -- |
66
+ | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.567 ms | 0 - 83 MB | NPU | -- |
67
+ | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.457 ms | 5 - 129 MB | NPU | -- |
68
+ | YOLOv8-Detection | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.418 ms | 4 - 72 MB | NPU | -- |
69
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.696 ms | 117 - 117 MB | NPU | -- |
70
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.664 ms | 5 - 5 MB | NPU | -- |
71
+ | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.356 ms | 2 - 30 MB | NPU | -- |
72
+ | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.828 ms | 2 - 39 MB | NPU | -- |
73
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.19 ms | 2 - 13 MB | NPU | -- |
74
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.068 ms | 0 - 57 MB | NPU | -- |
75
+ | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.746 ms | 1 - 29 MB | NPU | -- |
76
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 12.454 ms | 2 - 41 MB | NPU | -- |
77
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 163.928 ms | 65 - 80 MB | CPU | -- |
78
+ | YOLOv8-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 135.474 ms | 61 - 65 MB | CPU | -- |
79
+ | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.356 ms | 2 - 30 MB | NPU | -- |
80
+ | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.195 ms | 2 - 12 MB | NPU | -- |
81
+ | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.424 ms | 0 - 34 MB | NPU | -- |
82
+ | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.198 ms | 2 - 11 MB | NPU | -- |
83
+ | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.746 ms | 1 - 29 MB | NPU | -- |
84
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.107 ms | 2 - 38 MB | NPU | -- |
85
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.065 ms | 2 - 105 MB | NPU | -- |
86
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.458 ms | 2 - 40 MB | NPU | -- |
87
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.402 ms | 0 - 77 MB | NPU | -- |
88
+ | YOLOv8-Detection | w8a16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 3.665 ms | 2 - 41 MB | NPU | -- |
89
+ | YOLOv8-Detection | w8a16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 156.14 ms | 68 - 85 MB | CPU | -- |
90
+ | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.231 ms | 2 - 39 MB | NPU | -- |
91
+ | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.142 ms | 1 - 75 MB | NPU | -- |
92
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.544 ms | 5 - 5 MB | NPU | -- |
93
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.212 ms | 2 - 2 MB | NPU | -- |
94
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.159 ms | 0 - 26 MB | NPU | -- |
95
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.01 ms | 1 - 27 MB | NPU | -- |
96
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.594 ms | 0 - 37 MB | NPU | -- |
97
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.564 ms | 1 - 36 MB | NPU | -- |
98
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.436 ms | 0 - 5 MB | NPU | -- |
99
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.322 ms | 0 - 15 MB | NPU | -- |
100
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.192 ms | 0 - 45 MB | NPU | -- |
101
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.847 ms | 0 - 26 MB | NPU | -- |
102
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.695 ms | 1 - 27 MB | NPU | -- |
103
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.591 ms | 0 - 32 MB | NPU | -- |
104
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.43 ms | 0 - 34 MB | NPU | -- |
105
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 40.939 ms | 19 - 36 MB | CPU | -- |
106
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 44.624 ms | 3 - 12 MB | NPU | -- |
107
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 36.284 ms | 21 - 28 MB | CPU | -- |
108
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.159 ms | 0 - 26 MB | NPU | -- |
109
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.01 ms | 1 - 27 MB | NPU | -- |
110
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.42 ms | 0 - 15 MB | NPU | -- |
111
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.319 ms | 1 - 16 MB | NPU | -- |
112
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.231 ms | 0 - 32 MB | NPU | -- |
113
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.065 ms | 1 - 33 MB | NPU | -- |
114
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.436 ms | 0 - 15 MB | NPU | -- |
115
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.309 ms | 0 - 14 MB | NPU | -- |
116
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.847 ms | 0 - 26 MB | NPU | -- |
117
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.695 ms | 1 - 27 MB | NPU | -- |
118
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.944 ms | 0 - 43 MB | NPU | -- |
119
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.907 ms | 1 - 37 MB | NPU | -- |
120
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.469 ms | 0 - 144 MB | NPU | -- |
121
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.733 ms | 0 - 30 MB | NPU | -- |
122
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.646 ms | 1 - 31 MB | NPU | -- |
123
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.088 ms | 0 - 81 MB | NPU | -- |
124
+ | YOLOv8-Detection | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 1.491 ms | 0 - 32 MB | NPU | -- |
125
+ | YOLOv8-Detection | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 1.417 ms | 1 - 32 MB | NPU | -- |
126
+ | YOLOv8-Detection | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 37.933 ms | 22 - 41 MB | CPU | -- |
127
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.656 ms | 0 - 32 MB | NPU | -- |
128
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.589 ms | 1 - 36 MB | NPU | -- |
129
+ | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.95 ms | 1 - 84 MB | NPU | -- |
130
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.525 ms | 3 - 3 MB | NPU | -- |
131
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.17 ms | 2 - 2 MB | NPU | -- |
132
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.343 ms | 2 - 29 MB | NPU | -- |
133
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.041 ms | 2 - 13 MB | NPU | -- |
134
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.555 ms | 2 - 28 MB | NPU | -- |
135
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.343 ms | 2 - 29 MB | NPU | -- |
136
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.042 ms | 2 - 11 MB | NPU | -- |
137
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.049 ms | 2 - 11 MB | NPU | -- |
138
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.555 ms | 2 - 28 MB | NPU | -- |
139
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.37 ms | 2 - 39 MB | NPU | -- |
140
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.984 ms | 2 - 33 MB | NPU | -- |
141
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 2.413 ms | 2 - 37 MB | NPU | -- |
142
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.825 ms | 2 - 38 MB | NPU | -- |
143
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.326 ms | 2 - 2 MB | NPU | -- |
144
 
145
 
146
 
 
155
  ```
156
 
157
 
158
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
159
 
160
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
161
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
162
 
163
  With this API token, you can configure your client to run models on the cloud
 
165
  ```bash
166
  qai-hub configure --api_token API_TOKEN
167
  ```
168
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
169
 
170
 
171
 
 
276
  spot check the output with expected output.
277
 
278
  **Note**: This on-device profiling and inference requires access to Qualcomm®
279
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
280
 
281
 
282