qaihm-bot commited on
Commit
b354e3b
·
verified ·
1 Parent(s): 26b1041

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

Files changed (1) hide show
  1. README.md +95 -105
README.md CHANGED
@@ -38,110 +38,100 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
42
- | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.359 ms | 4 - 96 MB | NPU | -- |
43
- | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.584 ms | 0 - 40 MB | NPU | -- |
44
- | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.016 ms | 5 - 42 MB | NPU | -- |
45
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.13 ms | 0 - 38 MB | NPU | -- |
46
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.458 ms | 0 - 70 MB | NPU | -- |
47
- | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.481 ms | 0 - 100 MB | NPU | -- |
48
- | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
49
- | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.092 ms | 0 - 95 MB | NPU | -- |
50
- | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.24 ms | 0 - 66 MB | NPU | -- |
51
- | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.359 ms | 4 - 96 MB | NPU | -- |
52
- | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.115 ms | 0 - 40 MB | NPU | -- |
53
- | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.464 ms | 0 - 81 MB | NPU | -- |
54
- | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.643 ms | 0 - 34 MB | NPU | -- |
55
- | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.243 ms | 2 - 33 MB | NPU | -- |
56
- | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.123 ms | 0 - 38 MB | NPU | -- |
57
- | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.461 ms | 0 - 71 MB | NPU | -- |
58
- | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.589 ms | 0 - 65 MB | NPU | -- |
59
- | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.092 ms | 0 - 95 MB | NPU | -- |
60
- | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 4.13 ms | 0 - 39 MB | NPU | -- |
61
- | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.459 ms | 5 - 86 MB | NPU | -- |
62
- | YOLOv8-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.563 ms | 0 - 117 MB | NPU | -- |
63
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.038 ms | 0 - 85 MB | NPU | -- |
64
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.542 ms | 5 - 232 MB | NPU | -- |
65
- | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.977 ms | 0 - 170 MB | NPU | -- |
66
- | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 2.948 ms | 0 - 73 MB | NPU | -- |
67
- | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.371 ms | 5 - 135 MB | NPU | -- |
68
- | YOLOv8-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 2.964 ms | 1 - 89 MB | NPU | -- |
69
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.898 ms | 114 - 114 MB | NPU | -- |
70
- | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.453 ms | 5 - 5 MB | NPU | -- |
71
- | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.602 ms | 1 - 30 MB | NPU | -- |
72
- | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.982 ms | 2 - 41 MB | NPU | -- |
73
- | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.276 ms | 2 - 14 MB | NPU | -- |
74
- | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 48.464 ms | 14 - 170 MB | NPU | -- |
75
- | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.821 ms | 2 - 31 MB | NPU | -- |
76
- | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 13.469 ms | 0 - 36 MB | NPU | -- |
77
- | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 172.32 ms | 61 - 76 MB | CPU | -- |
78
- | YOLOv8-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 151.387 ms | 60 - 66 MB | CPU | -- |
79
- | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.602 ms | 1 - 30 MB | NPU | -- |
80
- | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.278 ms | 2 - 13 MB | NPU | -- |
81
- | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.47 ms | 0 - 32 MB | NPU | -- |
82
- | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.273 ms | 2 - 14 MB | NPU | -- |
83
- | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.821 ms | 2 - 31 MB | NPU | -- |
84
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.275 ms | 2 - 14 MB | NPU | -- |
85
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 48.607 ms | 14 - 159 MB | NPU | -- |
86
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.174 ms | 3 - 39 MB | NPU | -- |
87
- | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 38.66 ms | 2 - 1433 MB | NPU | -- |
88
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.87 ms | 2 - 45 MB | NPU | -- |
89
- | YOLOv8-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 41.953 ms | 2 - 515 MB | NPU | -- |
90
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.636 ms | 8 - 8 MB | NPU | -- |
91
- | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 48.518 ms | 24 - 24 MB | NPU | -- |
92
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.333 ms | 0 - 23 MB | NPU | -- |
93
- | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.142 ms | 1 - 25 MB | NPU | -- |
94
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.662 ms | 0 - 37 MB | NPU | -- |
95
- | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.675 ms | 1 - 36 MB | NPU | -- |
96
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.493 ms | 0 - 15 MB | NPU | -- |
97
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.44 ms | 1 - 17 MB | NPU | -- |
98
- | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.298 ms | 0 - 32 MB | NPU | -- |
99
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.894 ms | 0 - 24 MB | NPU | -- |
100
- | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.815 ms | 1 - 25 MB | NPU | -- |
101
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.805 ms | 0 - 31 MB | NPU | -- |
102
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.815 ms | 1 - 32 MB | NPU | -- |
103
- | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 44.018 ms | 22 - 38 MB | CPU | -- |
104
- | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 49.231 ms | 2 - 11 MB | NPU | -- |
105
- | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 39.153 ms | 16 - 20 MB | CPU | -- |
106
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.333 ms | 0 - 23 MB | NPU | -- |
107
- | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.142 ms | 1 - 25 MB | NPU | -- |
108
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.5 ms | 0 - 15 MB | NPU | -- |
109
- | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.415 ms | 1 - 17 MB | NPU | -- |
110
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.358 ms | 0 - 30 MB | NPU | -- |
111
- | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.167 ms | 1 - 33 MB | NPU | -- |
112
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.496 ms | 0 - 15 MB | NPU | -- |
113
- | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.421 ms | 1 - 16 MB | NPU | -- |
114
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.894 ms | 0 - 24 MB | NPU | -- |
115
- | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.815 ms | 1 - 25 MB | NPU | -- |
116
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.497 ms | 0 - 5 MB | NPU | -- |
117
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.419 ms | 0 - 16 MB | NPU | -- |
118
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.212 ms | 0 - 33 MB | NPU | -- |
119
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.99 ms | 0 - 36 MB | NPU | -- |
120
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.959 ms | 1 - 36 MB | NPU | -- |
121
- | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.781 ms | 1 - 89 MB | NPU | -- |
122
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.91 ms | 0 - 31 MB | NPU | -- |
123
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.844 ms | 1 - 37 MB | NPU | -- |
124
- | YOLOv8-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.013 ms | 0 - 76 MB | NPU | -- |
125
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.651 ms | 4 - 4 MB | NPU | -- |
126
- | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.422 ms | 3 - 3 MB | NPU | -- |
127
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.455 ms | 2 - 27 MB | NPU | -- |
128
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.132 ms | 2 - 11 MB | NPU | -- |
129
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 47.189 ms | 27 - 160 MB | NPU | -- |
130
- | YOLOv8-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.661 ms | 2 - 27 MB | NPU | -- |
131
- | YOLOv8-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 130.503 ms | 56 - 72 MB | CPU | -- |
132
- | YOLOv8-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 123.606 ms | 52 - 59 MB | CPU | -- |
133
- | YOLOv8-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.455 ms | 2 - 27 MB | NPU | -- |
134
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.149 ms | 2 - 11 MB | NPU | -- |
135
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.148 ms | 2 - 11 MB | NPU | -- |
136
- | YOLOv8-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.661 ms | 2 - 27 MB | NPU | -- |
137
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.148 ms | 2 - 12 MB | NPU | -- |
138
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 48.269 ms | 13 - 161 MB | NPU | -- |
139
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.445 ms | 2 - 37 MB | NPU | -- |
140
- | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 38.324 ms | 2 - 1750 MB | NPU | -- |
141
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.248 ms | 2 - 31 MB | NPU | -- |
142
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 39.884 ms | 6 - 521 MB | NPU | -- |
143
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.449 ms | 2 - 2 MB | NPU | -- |
144
- | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 49.345 ms | 25 - 25 MB | NPU | -- |
145
 
146
 
147
 
@@ -223,7 +213,7 @@ from qai_hub_models.models.yolov8_det import Model
223
  torch_model = Model.from_pretrained()
224
 
225
  # Device
226
- device = hub.Device("Samsung Galaxy S24")
227
 
228
  # Trace model
229
  input_shape = torch_model.get_input_spec()
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 14.287 ms | 0 - 64 MB | NPU | -- |
42
+ | YOLOv8-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.295 ms | 1 - 93 MB | NPU | -- |
43
+ | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 6.618 ms | 0 - 41 MB | NPU | -- |
44
+ | YOLOv8-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.04 ms | 5 - 46 MB | NPU | -- |
45
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.137 ms | 0 - 37 MB | NPU | -- |
46
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.474 ms | 0 - 83 MB | NPU | -- |
47
+ | YOLOv8-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.496 ms | 0 - 53 MB | NPU | -- |
48
+ | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.582 ms | 0 - 65 MB | NPU | -- |
49
+ | YOLOv8-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.112 ms | 1 - 97 MB | NPU | -- |
50
+ | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 14.287 ms | 0 - 64 MB | NPU | -- |
51
+ | YOLOv8-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 13.295 ms | 1 - 93 MB | NPU | -- |
52
+ | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.144 ms | 0 - 36 MB | NPU | -- |
53
+ | YOLOv8-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.46 ms | 2 - 84 MB | NPU | -- |
54
+ | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 7.65 ms | 0 - 33 MB | NPU | -- |
55
+ | YOLOv8-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 7.278 ms | 2 - 33 MB | NPU | -- |
56
+ | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.143 ms | 0 - 37 MB | NPU | -- |
57
+ | YOLOv8-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.465 ms | 0 - 78 MB | NPU | -- |
58
+ | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.582 ms | 0 - 65 MB | NPU | -- |
59
+ | YOLOv8-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.112 ms | 1 - 97 MB | NPU | -- |
60
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.045 ms | 0 - 85 MB | NPU | -- |
61
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.536 ms | 5 - 233 MB | NPU | -- |
62
+ | YOLOv8-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.528 ms | 0 - 207 MB | NPU | -- |
63
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.435 ms | 0 - 76 MB | NPU | -- |
64
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.978 ms | 5 - 102 MB | NPU | -- |
65
+ | YOLOv8-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.588 ms | 2 - 88 MB | NPU | -- |
66
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.848 ms | 137 - 137 MB | NPU | -- |
67
+ | YOLOv8-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.756 ms | 5 - 5 MB | NPU | -- |
68
+ | YOLOv8-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.458 ms | 2 - 32 MB | NPU | -- |
69
+ | YOLOv8-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.104 ms | 2 - 41 MB | NPU | -- |
70
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.271 ms | 2 - 14 MB | NPU | -- |
71
+ | YOLOv8-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 45.392 ms | 12 - 161 MB | NPU | -- |
72
+ | YOLOv8-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.837 ms | 1 - 31 MB | NPU | -- |
73
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 11.929 ms | 2 - 35 MB | NPU | -- |
74
+ | YOLOv8-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 167.488 ms | 62 - 77 MB | CPU | -- |
75
+ | YOLOv8-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 137.286 ms | 58 - 65 MB | CPU | -- |
76
+ | YOLOv8-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.458 ms | 2 - 32 MB | NPU | -- |
77
+ | YOLOv8-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.272 ms | 2 - 11 MB | NPU | -- |
78
+ | YOLOv8-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.467 ms | 2 - 39 MB | NPU | -- |
79
+ | YOLOv8-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.27 ms | 2 - 14 MB | NPU | -- |
80
+ | YOLOv8-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.837 ms | 1 - 31 MB | NPU | -- |
81
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.15 ms | 2 - 41 MB | NPU | -- |
82
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 37.47 ms | 2 - 1522 MB | NPU | -- |
83
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.52 ms | 2 - 44 MB | NPU | -- |
84
+ | YOLOv8-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 31.308 ms | 26 - 817 MB | NPU | -- |
85
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.65 ms | 13 - 13 MB | NPU | -- |
86
+ | YOLOv8-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 46.531 ms | 25 - 25 MB | NPU | -- |
87
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.338 ms | 0 - 24 MB | NPU | -- |
88
+ | YOLOv8-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.128 ms | 1 - 26 MB | NPU | -- |
89
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.662 ms | 0 - 35 MB | NPU | -- |
90
+ | YOLOv8-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.696 ms | 1 - 38 MB | NPU | -- |
91
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.511 ms | 0 - 15 MB | NPU | -- |
92
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.414 ms | 0 - 16 MB | NPU | -- |
93
+ | YOLOv8-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.603 ms | 0 - 31 MB | NPU | -- |
94
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.927 ms | 0 - 24 MB | NPU | -- |
95
+ | YOLOv8-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.791 ms | 1 - 26 MB | NPU | -- |
96
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 3.692 ms | 0 - 34 MB | NPU | -- |
97
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 4.846 ms | 1 - 33 MB | NPU | -- |
98
+ | YOLOv8-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 43.911 ms | 21 - 37 MB | CPU | -- |
99
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 49.888 ms | 3 - 12 MB | NPU | -- |
100
+ | YOLOv8-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 38.312 ms | 20 - 25 MB | CPU | -- |
101
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.338 ms | 0 - 24 MB | NPU | -- |
102
+ | YOLOv8-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.128 ms | 1 - 26 MB | NPU | -- |
103
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.504 ms | 0 - 14 MB | NPU | -- |
104
+ | YOLOv8-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.417 ms | 2 - 15 MB | NPU | -- |
105
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.334 ms | 0 - 30 MB | NPU | -- |
106
+ | YOLOv8-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.201 ms | 1 - 31 MB | NPU | -- |
107
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.509 ms | 0 - 16 MB | NPU | -- |
108
+ | YOLOv8-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.412 ms | 0 - 14 MB | NPU | -- |
109
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.927 ms | 0 - 24 MB | NPU | -- |
110
+ | YOLOv8-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.791 ms | 1 - 26 MB | NPU | -- |
111
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.99 ms | 0 - 32 MB | NPU | -- |
112
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.963 ms | 1 - 37 MB | NPU | -- |
113
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.148 ms | 1 - 83 MB | NPU | -- |
114
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.775 ms | 0 - 27 MB | NPU | -- |
115
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.693 ms | 1 - 29 MB | NPU | -- |
116
+ | YOLOv8-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.788 ms | 0 - 77 MB | NPU | -- |
117
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.629 ms | 6 - 6 MB | NPU | -- |
118
+ | YOLOv8-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.779 ms | 3 - 3 MB | NPU | -- |
119
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.42 ms | 1 - 26 MB | NPU | -- |
120
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.153 ms | 2 - 11 MB | NPU | -- |
121
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 49.975 ms | 13 - 156 MB | NPU | -- |
122
+ | YOLOv8-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.669 ms | 1 - 26 MB | NPU | -- |
123
+ | YOLOv8-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 130.747 ms | 56 - 71 MB | CPU | -- |
124
+ | YOLOv8-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 115.362 ms | 55 - 62 MB | CPU | -- |
125
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.42 ms | 1 - 26 MB | NPU | -- |
126
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.157 ms | 2 - 10 MB | NPU | -- |
127
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.159 ms | 2 - 13 MB | NPU | -- |
128
+ | YOLOv8-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.669 ms | 1 - 26 MB | NPU | -- |
129
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.535 ms | 2 - 31 MB | NPU | -- |
130
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 38.535 ms | 2 - 1806 MB | NPU | -- |
131
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.029 ms | 2 - 36 MB | NPU | -- |
132
+ | YOLOv8-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 33.3 ms | 25 - 744 MB | NPU | -- |
133
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.414 ms | 2 - 2 MB | NPU | -- |
134
+ | YOLOv8-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 50.853 ms | 25 - 25 MB | NPU | -- |
 
 
 
 
 
 
 
 
 
 
135
 
136
 
137
 
 
213
  torch_model = Model.from_pretrained()
214
 
215
  # Device
216
+ device = hub.Device("Samsung Galaxy S25")
217
 
218
  # Trace model
219
  input_shape = torch_model.get_input_spec()