qaihm-bot commited on
Commit
90debd8
·
verified ·
1 Parent(s): 759f460

See https://github.com/qualcomm/ai-hub-models/releases/v0.53.0 for changelog.

Files changed (2) hide show
  1. README.md +220 -166
  2. release_assets.json +17 -17
README.md CHANGED
@@ -27,13 +27,13 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-float.zip)
31
- | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-w8a16.zip)
32
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-w8a8.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
@@ -62,166 +62,220 @@ See our repository for [Detectron2-Detection on GitHub](https://github.com/qualc
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 14.764 ms | 35 - 492 MB | NPU
66
- | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 15.275 ms | 65 - 65 MB | NPU
67
- | proposal_generator | ONNX | float | Snapdragon® X Elite | 32.041 ms | 66 - 66 MB | NPU
68
- | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 24.126 ms | 3 - 538 MB | NPU
69
- | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 32.084 ms | 11 - 46 MB | NPU
70
- | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 59.183 ms | 7 - 17 MB | NPU
71
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 19.048 ms | 2 - 444 MB | NPU
72
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 8.533 ms | 10 - 509 MB | NPU
73
- | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 9.79 ms | 35 - 35 MB | NPU
74
- | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.909 ms | 33 - 33 MB | NPU
75
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.657 ms | 17 - 557 MB | NPU
76
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 2949.748 ms | 187 - 204 MB | CPU
77
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.337 ms | 6 - 28 MB | NPU
78
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 28.746 ms | 16 - 19 MB | NPU
79
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 11.019 ms | 14 - 498 MB | NPU
80
- | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1404.84 ms | 190 - 197 MB | CPU
81
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.805 ms | 8 - 427 MB | NPU
82
- | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.97 ms | 19 - 19 MB | NPU
83
- | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.625 ms | 19 - 19 MB | NPU
84
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.547 ms | 9 - 473 MB | NPU
85
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 444.574 ms | 151 - 178 MB | CPU
86
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.962 ms | 0 - 26 MB | NPU
87
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 15.718 ms | 7 - 10 MB | NPU
88
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.276 ms | 6 - 426 MB | NPU
89
- | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 357.745 ms | 152 - 160 MB | CPU
90
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.226 ms | 7 - 493 MB | NPU
91
- | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.33 ms | 7 - 7 MB | NPU
92
- | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.164 ms | 7 - 7 MB | NPU
93
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 37.347 ms | 7 - 557 MB | NPU
94
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 184.315 ms | 2 - 469 MB | NPU
95
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 53.332 ms | 7 - 10 MB | NPU
96
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.435 ms | 1 - 468 MB | NPU
97
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 78.863 ms | 7 - 27 MB | NPU
98
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 87.073 ms | 7 - 502 MB | NPU
99
- | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.315 ms | 2 - 469 MB | NPU
100
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 76.9 ms | 0 - 433 MB | NPU
101
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 28.107 ms | 0 - 478 MB | NPU
102
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 22.928 ms | 4 - 452 MB | NPU
103
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.603 ms | 4 - 4 MB | NPU
104
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 55.76 ms | 4 - 4 MB | NPU
105
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.194 ms | 4 - 756 MB | NPU
106
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 163.95 ms | 1 - 12 MB | NPU
107
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 97.338 ms | 1 - 547 MB | NPU
108
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.604 ms | 4 - 367 MB | NPU
109
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.322 ms | 1 - 547 MB | NPU
110
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.989 ms | 0 - 11 MB | NPU
111
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 463.997 ms | 4 - 541 MB | NPU
112
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 61.636 ms | 4 - 737 MB | NPU
113
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.338 ms | 1 - 547 MB | NPU
114
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.549 ms | 0 - 542 MB | NPU
115
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 25.416 ms | 4 - 444 MB | NPU
116
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 63.812 ms | 4 - 532 MB | NPU
117
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.803 ms | 2 - 436 MB | NPU
118
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.291 ms | 2 - 2 MB | NPU
119
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.322 ms | 2 - 2 MB | NPU
120
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.277 ms | 2 - 496 MB | NPU
121
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 64.955 ms | 2 - 8 MB | NPU
122
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 71.627 ms | 2 - 439 MB | NPU
123
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.263 ms | 2 - 6 MB | NPU
124
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.354 ms | 2 - 440 MB | NPU
125
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.701 ms | 4 - 10 MB | NPU
126
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 196.887 ms | 2 - 443 MB | NPU
127
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 47.242 ms | 2 - 491 MB | NPU
128
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.627 ms | 2 - 439 MB | NPU
129
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.15 ms | 2 - 439 MB | NPU
130
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 23.73 ms | 2 - 441 MB | NPU
131
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 28.887 ms | 2 - 437 MB | NPU
132
- | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 16.174 ms | 10 - 494 MB | NPU
133
- | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 54.6 ms | 11 - 446 MB | NPU
134
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.02 ms | 2 - 444 MB | NPU
135
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.505 ms | 2 - 485 MB | NPU
136
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 29.659 ms | 3 - 427 MB | NPU
137
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 16.623 ms | 3 - 5 MB | NPU
138
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 16.615 ms | 3 - 427 MB | NPU
139
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 20.505 ms | 1 - 30 MB | NPU
140
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 21.651 ms | 3 - 478 MB | NPU
141
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 29.659 ms | 3 - 427 MB | NPU
142
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 21.267 ms | 3 - 427 MB | NPU
143
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 8.849 ms | 2 - 437 MB | NPU
144
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 23.656 ms | 2 - 443 MB | NPU
145
- | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.727 ms | 10 - 1471 MB | NPU
146
- | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.36 ms | 32 - 32 MB | NPU
147
- | roi_head | ONNX | float | Snapdragon® X Elite | 67.563 ms | 29 - 29 MB | NPU
148
- | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 47.86 ms | 10 - 1540 MB | NPU
149
- | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.037 ms | 0 - 33 MB | NPU
150
- | roi_head | ONNX | float | Qualcomm® QCS9075 | 115.33 ms | 10 - 22 MB | NPU
151
- | roi_head | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 44.3 ms | 0 - 1374 MB | NPU
152
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.713 ms | 0 - 473 MB | NPU
153
- | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 17.074 ms | 14 - 14 MB | NPU
154
- | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.224 ms | 12 - 12 MB | NPU
155
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.842 ms | 5 - 484 MB | NPU
156
- | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 8663.527 ms | 3029 - 3042 MB | CPU
157
- | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 33.315 ms | 0 - 436 MB | NPU
158
- | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 45.693 ms | 5 - 8 MB | NPU
159
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 20.748 ms | 0 - 461 MB | NPU
160
- | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3801.914 ms | 2951 - 2958 MB | CPU
161
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.997 ms | 0 - 310 MB | NPU
162
- | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 8.751 ms | 15 - 15 MB | NPU
163
- | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.074 ms | 14 - 14 MB | NPU
164
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.567 ms | 2 - 358 MB | NPU
165
- | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 1711.233 ms | 2531 - 2540 MB | CPU
166
- | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.496 ms | 0 - 20 MB | NPU
167
- | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 70.04 ms | 2 - 5 MB | NPU
168
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.399 ms | 0 - 311 MB | NPU
169
- | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 985.728 ms | 2555 - 2562 MB | CPU
170
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.13 ms | 1 - 1308 MB | NPU
171
- | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.238 ms | 10 - 10 MB | NPU
172
- | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.755 ms | 10 - 10 MB | NPU
173
- | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.044 ms | 10 - 1516 MB | NPU
174
- | roi_head | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 332.686 ms | 0 - 1315 MB | NPU
175
- | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 64.278 ms | 0 - 25 MB | NPU
176
- | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.188 ms | 0 - 1315 MB | NPU
177
- | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 103.692 ms | 12 - 23 MB | NPU
178
- | roi_head | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 116.599 ms | 4 - 433 MB | NPU
179
- | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.686 ms | 0 - 1315 MB | NPU
180
- | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.71 ms | 0 - 386 MB | NPU
181
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 40.868 ms | 10 - 1234 MB | NPU
182
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 13.414 ms | 5 - 418 MB | NPU
183
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 16.055 ms | 5 - 5 MB | NPU
184
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.05 ms | 5 - 5 MB | NPU
185
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.612 ms | 5 - 428 MB | NPU
186
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 147.728 ms | 7 - 13 MB | NPU
187
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 95.064 ms | 5 - 375 MB | NPU
188
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 30.857 ms | 5 - 7 MB | NPU
189
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.375 ms | 5 - 373 MB | NPU
190
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 45.125 ms | 1 - 7 MB | NPU
191
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 656.52 ms | 5 - 517 MB | NPU
192
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 46.096 ms | 5 - 427 MB | NPU
193
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 95.064 ms | 5 - 375 MB | NPU
194
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 50.546 ms | 0 - 371 MB | NPU
195
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 19.274 ms | 5 - 421 MB | NPU
196
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 55.938 ms | 5 - 462 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
197
  | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.845 ms | 2 - 307 MB | NPU
198
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.113 ms | 2 - 2 MB | NPU
199
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 18.943 ms | 2 - 2 MB | NPU
200
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.492 ms | 2 - 340 MB | NPU
201
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 82.875 ms | 2 - 7 MB | NPU
202
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 51.504 ms | 2 - 291 MB | NPU
203
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.467 ms | 2 - 5 MB | NPU
204
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.618 ms | 1 - 291 MB | NPU
205
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 75.795 ms | 0 - 4 MB | NPU
206
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 333.381 ms | 2 - 376 MB | NPU
207
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 38.572 ms | 2 - 337 MB | NPU
208
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 51.504 ms | 2 - 291 MB | NPU
209
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.345 ms | 2 - 294 MB | NPU
210
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.501 ms | 2 - 306 MB | NPU
211
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.44 ms | 2 - 321 MB | NPU
212
- | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1990.26 ms | 0 - 2959 MB | NPU
213
- | roi_head | TFLITE | float | Qualcomm® SA8295P | 517.528 ms | 0 - 1601 MB | CPU
214
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 171.788 ms | 0 - 1454 MB | NPU
215
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 285.243 ms | 0 - 1598 MB | NPU
216
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 515.787 ms | 0 - 1280 MB | NPU
217
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 362.898 ms | 0 - 4 MB | NPU
218
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.49 ms | 0 - 1279 MB | NPU
219
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 396.042 ms | 0 - 33 MB | NPU
220
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 873.023 ms | 1 - 805 MB | NPU
221
- | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 515.787 ms | 0 - 1280 MB | NPU
222
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 385.004 ms | 0 - 665 MB | NPU
223
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 196.723 ms | 0 - 1348 MB | NPU
224
- | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1832.743 ms | 1060 - 2306 MB | NPU
 
 
 
 
 
 
 
 
 
 
225
 
226
  ## License
227
  * The license for the original implementation of Detectron2-Detection can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-float.zip)
31
+ | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-w8a16.zip)
32
+ | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-w8a8.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-float.zip)
34
+ | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
 
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 14.76 ms | 34 - 491 MB | NPU
66
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite Mobile | 19.195 ms | 24 - 468 MB | NPU
67
+ | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 15.394 ms | 65 - 65 MB | NPU
68
+ | proposal_generator | ONNX | float | Snapdragon® X Elite | 32.028 ms | 66 - 66 MB | NPU
69
+ | proposal_generator | ONNX | float | Snapdragon® X Elite | 32.028 ms | 66 - 66 MB | NPU
70
+ | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 23.873 ms | 2 - 536 MB | NPU
71
+ | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 32.935 ms | 11 - 46 MB | NPU
72
+ | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 58.672 ms | 7 - 17 MB | NPU
73
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 19.195 ms | 24 - 468 MB | NPU
74
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 8.563 ms | 0 - 501 MB | NPU
75
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 11.034 ms | 12 - 496 MB | NPU
76
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 9.778 ms | 35 - 35 MB | NPU
77
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.927 ms | 33 - 33 MB | NPU
78
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.927 ms | 33 - 33 MB | NPU
79
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.558 ms | 19 - 555 MB | NPU
80
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 3016.408 ms | 187 - 204 MB | CPU
81
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.454 ms | 6 - 30 MB | NPU
82
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 29.615 ms | 17 - 20 MB | NPU
83
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 11.034 ms | 12 - 496 MB | NPU
84
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1402.793 ms | 191 - 198 MB | CPU
85
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1402.793 ms | 191 - 198 MB | CPU
86
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.795 ms | 8 - 428 MB | NPU
87
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 6.255 ms | 10 - 433 MB | NPU
88
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.961 ms | 19 - 19 MB | NPU
89
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.629 ms | 19 - 19 MB | NPU
90
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.629 ms | 19 - 19 MB | NPU
91
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.587 ms | 9 - 474 MB | NPU
92
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 440.21 ms | 153 - 180 MB | CPU
93
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.901 ms | 0 - 27 MB | NPU
94
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 16.175 ms | 9 - 12 MB | NPU
95
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.255 ms | 10 - 433 MB | NPU
96
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 354.389 ms | 152 - 161 MB | CPU
97
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 354.389 ms | 152 - 161 MB | CPU
98
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 21.886 ms | 5 - 491 MB | NPU
99
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 28.236 ms | 7 - 486 MB | NPU
100
+ | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.306 ms | 7 - 7 MB | NPU
101
+ | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.481 ms | 7 - 7 MB | NPU
102
+ | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.481 ms | 7 - 7 MB | NPU
103
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 36.414 ms | 7 - 552 MB | NPU
104
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 184.316 ms | 1 - 467 MB | NPU
105
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 53.638 ms | 7 - 10 MB | NPU
106
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.499 ms | 1 - 467 MB | NPU
107
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.499 ms | 1 - 467 MB | NPU
108
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.499 ms | 1 - 467 MB | NPU
109
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 78.772 ms | 7 - 27 MB | NPU
110
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 85.561 ms | 7 - 500 MB | NPU
111
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.316 ms | 1 - 467 MB | NPU
112
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 76.92 ms | 0 - 433 MB | NPU
113
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 28.236 ms | 7 - 486 MB | NPU
114
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 22.907 ms | 4 - 451 MB | NPU
115
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 25.301 ms | 4 - 442 MB | NPU
116
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.661 ms | 4 - 4 MB | NPU
117
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 55.983 ms | 4 - 4 MB | NPU
118
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 55.983 ms | 4 - 4 MB | NPU
119
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.58 ms | 4 - 756 MB | NPU
120
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 163.794 ms | 3 - 13 MB | NPU
121
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 97.47 ms | 1 - 546 MB | NPU
122
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.433 ms | 4 - 8 MB | NPU
123
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.354 ms | 0 - 546 MB | NPU
124
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.354 ms | 0 - 546 MB | NPU
125
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.354 ms | 0 - 546 MB | NPU
126
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.409 ms | 4 - 14 MB | NPU
127
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 471.459 ms | 4 - 539 MB | NPU
128
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 61.433 ms | 4 - 736 MB | NPU
129
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.47 ms | 1 - 546 MB | NPU
130
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.69 ms | 0 - 541 MB | NPU
131
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 25.301 ms | 4 - 442 MB | NPU
132
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 64.836 ms | 4 - 531 MB | NPU
133
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 64.836 ms | 4 - 531 MB | NPU
134
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.878 ms | 2 - 436 MB | NPU
135
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 23.72 ms | 2 - 441 MB | NPU
136
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.207 ms | 2 - 2 MB | NPU
137
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.427 ms | 2 - 2 MB | NPU
138
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.427 ms | 2 - 2 MB | NPU
139
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.336 ms | 2 - 495 MB | NPU
140
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 65.174 ms | 2 - 8 MB | NPU
141
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 71.623 ms | 2 - 439 MB | NPU
142
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.119 ms | 2 - 6 MB | NPU
143
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.428 ms | 2 - 439 MB | NPU
144
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.428 ms | 2 - 439 MB | NPU
145
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.428 ms | 2 - 439 MB | NPU
146
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.597 ms | 2 - 8 MB | NPU
147
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 183.049 ms | 2 - 442 MB | NPU
148
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.985 ms | 2 - 488 MB | NPU
149
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.623 ms | 2 - 439 MB | NPU
150
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.076 ms | 2 - 439 MB | NPU
151
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 23.72 ms | 2 - 441 MB | NPU
152
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 28.929 ms | 2 - 437 MB | NPU
153
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 28.929 ms | 2 - 437 MB | NPU
154
+ | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 21.67 ms | 10 - 504 MB | NPU
155
+ | proposal_generator | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 37.815 ms | 9 - 582 MB | NPU
156
+ | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 77.718 ms | 11 - 452 MB | NPU
157
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 23.8 ms | 2 - 446 MB | NPU
158
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 25.183 ms | 2 - 432 MB | NPU
159
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 29.756 ms | 1 - 501 MB | NPU
160
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 73.101 ms | 3 - 444 MB | NPU
161
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 43.188 ms | 3 - 6 MB | NPU
162
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
163
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
164
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
165
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 46.042 ms | 1 - 30 MB | NPU
166
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.806 ms | 0 - 490 MB | NPU
167
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 73.101 ms | 3 - 444 MB | NPU
168
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 49.76 ms | 3 - 444 MB | NPU
169
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 25.183 ms | 2 - 432 MB | NPU
170
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 37.145 ms | 1 - 451 MB | NPU
171
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 37.145 ms | 1 - 451 MB | NPU
172
+ | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.594 ms | 10 - 1471 MB | NPU
173
+ | roi_head | ONNX | float | Snapdragon® 8 Elite Mobile | 43.687 ms | 0 - 1376 MB | NPU
174
+ | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.554 ms | 32 - 32 MB | NPU
175
+ | roi_head | ONNX | float | Snapdragon® X Elite | 67.658 ms | 29 - 29 MB | NPU
176
+ | roi_head | ONNX | float | Snapdragon® X Elite | 67.658 ms | 29 - 29 MB | NPU
177
+ | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 49.134 ms | 10 - 1540 MB | NPU
178
+ | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.629 ms | 0 - 33 MB | NPU
179
+ | roi_head | ONNX | float | Qualcomm® QCS9075 | 115.915 ms | 10 - 22 MB | NPU
180
+ | roi_head | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 43.687 ms | 0 - 1376 MB | NPU
181
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.745 ms | 5 - 477 MB | NPU
182
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 20.852 ms | 2 - 463 MB | NPU
183
+ | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 17.157 ms | 14 - 14 MB | NPU
184
+ | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.281 ms | 12 - 12 MB | NPU
185
+ | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.281 ms | 12 - 12 MB | NPU
186
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.862 ms | 5 - 482 MB | NPU
187
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 8758.485 ms | 3029 - 3042 MB | CPU
188
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 33.367 ms | 0 - 18 MB | NPU
189
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 45.734 ms | 5 - 8 MB | NPU
190
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 20.852 ms | 2 - 463 MB | NPU
191
+ | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3804.954 ms | 2957 - 2964 MB | CPU
192
+ | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3804.954 ms | 2957 - 2964 MB | CPU
193
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.996 ms | 2 - 312 MB | NPU
194
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 9.405 ms | 0 - 314 MB | NPU
195
+ | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 8.78 ms | 15 - 15 MB | NPU
196
+ | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.064 ms | 14 - 14 MB | NPU
197
+ | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.064 ms | 14 - 14 MB | NPU
198
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.594 ms | 3 - 355 MB | NPU
199
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 1700.45 ms | 2531 - 2540 MB | CPU
200
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.827 ms | 0 - 19 MB | NPU
201
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 70.67 ms | 2 - 5 MB | NPU
202
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.405 ms | 0 - 314 MB | NPU
203
+ | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 978.086 ms | 2443 - 2451 MB | CPU
204
+ | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 978.086 ms | 2443 - 2451 MB | CPU
205
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.89 ms | 10 - 1444 MB | NPU
206
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 41.089 ms | 0 - 1350 MB | NPU
207
+ | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.415 ms | 10 - 10 MB | NPU
208
+ | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.726 ms | 10 - 10 MB | NPU
209
+ | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.726 ms | 10 - 10 MB | NPU
210
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.061 ms | 10 - 1603 MB | NPU
211
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 332.768 ms | 1 - 1398 MB | NPU
212
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 63.386 ms | 10 - 13 MB | NPU
213
+ | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.098 ms | 1 - 1398 MB | NPU
214
+ | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.098 ms | 1 - 1398 MB | NPU
215
+ | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.098 ms | 1 - 1398 MB | NPU
216
+ | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 103.699 ms | 12 - 23 MB | NPU
217
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 119.213 ms | 9 - 439 MB | NPU
218
+ | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.768 ms | 1 - 1398 MB | NPU
219
+ | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.661 ms | 0 - 386 MB | NPU
220
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 41.089 ms | 0 - 1350 MB | NPU
221
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 13.433 ms | 5 - 420 MB | NPU
222
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 19.243 ms | 5 - 421 MB | NPU
223
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 16.088 ms | 5 - 5 MB | NPU
224
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.076 ms | 5 - 5 MB | NPU
225
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.076 ms | 5 - 5 MB | NPU
226
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.846 ms | 5 - 430 MB | NPU
227
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 147.475 ms | 4 - 10 MB | NPU
228
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8275 (Proxy) | 95.051 ms | 5 - 374 MB | NPU
229
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 30.506 ms | 5 - 7 MB | NPU
230
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.403 ms | 5 - 374 MB | NPU
231
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.403 ms | 5 - 374 MB | NPU
232
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.403 ms | 5 - 374 MB | NPU
233
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 44.687 ms | 0 - 7 MB | NPU
234
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 648.918 ms | 5 - 515 MB | NPU
235
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 45.884 ms | 5 - 428 MB | NPU
236
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 95.051 ms | 5 - 374 MB | NPU
237
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 50.526 ms | 2 - 373 MB | NPU
238
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 19.243 ms | 5 - 421 MB | NPU
239
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 56.342 ms | 5 - 463 MB | NPU
240
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 56.342 ms | 5 - 463 MB | NPU
241
  | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.845 ms | 2 - 307 MB | NPU
242
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 9.483 ms | 2 - 305 MB | NPU
243
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.167 ms | 2 - 2 MB | NPU
244
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 18.913 ms | 2 - 2 MB | NPU
245
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 18.913 ms | 2 - 2 MB | NPU
246
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.467 ms | 2 - 344 MB | NPU
247
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 82.872 ms | 2 - 7 MB | NPU
248
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 51.481 ms | 2 - 293 MB | NPU
249
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.248 ms | 3 - 5 MB | NPU
250
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.595 ms | 1 - 292 MB | NPU
251
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.595 ms | 1 - 292 MB | NPU
252
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.595 ms | 1 - 292 MB | NPU
253
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 75.373 ms | 2 - 7 MB | NPU
254
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 309.811 ms | 2 - 376 MB | NPU
255
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 38.637 ms | 2 - 337 MB | NPU
256
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 51.481 ms | 2 - 293 MB | NPU
257
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.31 ms | 0 - 292 MB | NPU
258
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.483 ms | 2 - 305 MB | NPU
259
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.754 ms | 2 - 321 MB | NPU
260
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.754 ms | 2 - 321 MB | NPU
261
+ | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1995.437 ms | 0 - 2959 MB | NPU
262
+ | roi_head | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 481.174 ms | 0 - 3364 MB | CPU
263
+ | roi_head | TFLITE | float | Qualcomm® SA8295P | 1020.197 ms | 0 - 1601 MB | CPU
264
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 160.252 ms | 0 - 1453 MB | NPU
265
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 197.006 ms | 0 - 1349 MB | NPU
266
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 288.91 ms | 0 - 1597 MB | NPU
267
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 516.62 ms | 0 - 1279 MB | NPU
268
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 378.691 ms | 0 - 4 MB | NPU
269
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
270
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
271
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
272
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 396.44 ms | 0 - 33 MB | NPU
273
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 901.915 ms | 0 - 803 MB | NPU
274
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 516.62 ms | 0 - 1279 MB | NPU
275
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 385.446 ms | 0 - 665 MB | NPU
276
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 197.006 ms | 0 - 1349 MB | NPU
277
+ | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1837.531 ms | 1071 - 2318 MB | NPU
278
+ | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1837.531 ms | 1071 - 2318 MB | NPU
279
 
280
  ## License
281
  * The license for the original implementation of Detectron2-Detection can be found
release_assets.json CHANGED
@@ -1,61 +1,61 @@
1
  {
2
- "version": "0.52.0",
3
  "precisions": {
4
- "w8a16": {
5
  "universal_assets": {
6
  "qnn_dlc": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327"
9
  },
10
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-w8a16.zip"
11
  },
12
  "onnx": {
13
  "tool_versions": {
14
  "qairt": "2.42.0.251225135753_193295",
15
  "onnx_runtime": "1.24.3"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-w8a16.zip"
18
  }
19
  }
20
  },
21
- "float": {
22
  "universal_assets": {
 
 
 
 
 
 
 
23
  "qnn_dlc": {
24
  "tool_versions": {
25
  "qairt": "2.45.0.260326154327"
26
  },
27
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-float.zip"
28
  },
29
  "onnx": {
30
  "tool_versions": {
31
  "qairt": "2.42.0.251225135753_193295",
32
  "onnx_runtime": "1.24.3"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-float.zip"
35
  }
36
  }
37
  },
38
- "w8a8": {
39
  "universal_assets": {
40
- "tflite": {
41
- "tool_versions": {
42
- "qairt": "2.45.0.260326154327",
43
- "litert": "1.4.2"
44
- },
45
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-tflite-w8a8.zip"
46
- },
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-qnn_dlc-w8a8.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
  "qairt": "2.42.0.251225135753_193295",
56
  "onnx_runtime": "1.24.3"
57
  },
58
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.52.0/detectron2_detection-onnx-w8a8.zip"
59
  }
60
  }
61
  }
 
1
  {
2
+ "version": "0.53.0",
3
  "precisions": {
4
+ "float": {
5
  "universal_assets": {
6
  "qnn_dlc": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327"
9
  },
10
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-float.zip"
11
  },
12
  "onnx": {
13
  "tool_versions": {
14
  "qairt": "2.42.0.251225135753_193295",
15
  "onnx_runtime": "1.24.3"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-float.zip"
18
  }
19
  }
20
  },
21
+ "w8a8": {
22
  "universal_assets": {
23
+ "tflite": {
24
+ "tool_versions": {
25
+ "qairt": "2.45.0.260326154327",
26
+ "litert": "1.4.3"
27
+ },
28
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-tflite-w8a8.zip"
29
+ },
30
  "qnn_dlc": {
31
  "tool_versions": {
32
  "qairt": "2.45.0.260326154327"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-w8a8.zip"
35
  },
36
  "onnx": {
37
  "tool_versions": {
38
  "qairt": "2.42.0.251225135753_193295",
39
  "onnx_runtime": "1.24.3"
40
  },
41
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-w8a8.zip"
42
  }
43
  }
44
  },
45
+ "w8a16": {
46
  "universal_assets": {
 
 
 
 
 
 
 
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-qnn_dlc-w8a16.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
  "qairt": "2.42.0.251225135753_193295",
56
  "onnx_runtime": "1.24.3"
57
  },
58
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.53.0/detectron2_detection-onnx-w8a16.zip"
59
  }
60
  }
61
  }