qaihm-bot commited on
Commit
68b30be
·
verified ·
1 Parent(s): d976e18

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

Files changed (1) hide show
  1. README.md +94 -104
README.md CHANGED
@@ -38,110 +38,100 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | YOLOv11-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 13.544 ms | 0 - 65 MB | NPU | -- |
42
- | YOLOv11-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.427 ms | 1 - 95 MB | NPU | -- |
43
- | YOLOv11-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 7.285 ms | 0 - 40 MB | NPU | -- |
44
- | YOLOv11-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.669 ms | 4 - 43 MB | NPU | -- |
45
- | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.286 ms | 0 - 22 MB | NPU | -- |
46
- | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.836 ms | 0 - 92 MB | NPU | -- |
47
- | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.801 ms | 0 - 39 MB | NPU | -- |
48
- | YOLOv11-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.576 ms | 0 - 65 MB | NPU | -- |
49
- | YOLOv11-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.216 ms | 2 - 120 MB | NPU | -- |
50
- | YOLOv11-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 13.544 ms | 0 - 65 MB | NPU | -- |
51
- | YOLOv11-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.427 ms | 1 - 95 MB | NPU | -- |
52
- | YOLOv11-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.304 ms | 0 - 22 MB | NPU | -- |
53
- | YOLOv11-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.835 ms | 0 - 94 MB | NPU | -- |
54
- | YOLOv11-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.427 ms | 0 - 33 MB | NPU | -- |
55
- | YOLOv11-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.027 ms | 0 - 34 MB | NPU | -- |
56
- | YOLOv11-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.305 ms | 0 - 22 MB | NPU | -- |
57
- | YOLOv11-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.825 ms | 5 - 94 MB | NPU | -- |
58
- | YOLOv11-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.576 ms | 0 - 65 MB | NPU | -- |
59
- | YOLOv11-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.216 ms | 2 - 120 MB | NPU | -- |
60
- | YOLOv11-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 4.302 ms | 0 - 23 MB | NPU | -- |
61
- | YOLOv11-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.827 ms | 0 - 88 MB | NPU | -- |
62
- | YOLOv11-Detection | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 5.963 ms | 0 - 57 MB | NPU | -- |
63
- | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.133 ms | 0 - 77 MB | NPU | -- |
64
- | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.752 ms | 0 - 222 MB | NPU | -- |
65
- | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.855 ms | 0 - 157 MB | NPU | -- |
66
- | YOLOv11-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 3.087 ms | 0 - 70 MB | NPU | -- |
67
- | YOLOv11-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 2.567 ms | 5 - 119 MB | NPU | -- |
68
- | YOLOv11-Detection | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.514 ms | 5 - 87 MB | NPU | -- |
69
- | YOLOv11-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.277 ms | 156 - 156 MB | NPU | -- |
70
- | YOLOv11-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 5.717 ms | 5 - 5 MB | NPU | -- |
71
- | YOLOv11-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.137 ms | 2 - 31 MB | NPU | -- |
72
- | YOLOv11-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.399 ms | 2 - 45 MB | NPU | -- |
73
- | YOLOv11-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.788 ms | 2 - 14 MB | NPU | -- |
74
- | YOLOv11-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 61.358 ms | 10 - 195 MB | NPU | -- |
75
- | YOLOv11-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.399 ms | 2 - 31 MB | NPU | -- |
76
- | YOLOv11-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 13.278 ms | 2 - 38 MB | NPU | -- |
77
- | YOLOv11-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 170.117 ms | 88 - 104 MB | CPU | -- |
78
- | YOLOv11-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 140.755 ms | 90 - 97 MB | CPU | -- |
79
- | YOLOv11-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.137 ms | 2 - 31 MB | NPU | -- |
80
- | YOLOv11-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.777 ms | 4 - 16 MB | NPU | -- |
81
- | YOLOv11-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.007 ms | 0 - 37 MB | NPU | -- |
82
- | YOLOv11-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.784 ms | 4 - 15 MB | NPU | -- |
83
- | YOLOv11-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.399 ms | 2 - 31 MB | NPU | -- |
84
- | YOLOv11-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 3.788 ms | 2 - 15 MB | NPU | -- |
85
- | YOLOv11-Detection | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 63.013 ms | 10 - 195 MB | NPU | -- |
86
- | YOLOv11-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.526 ms | 2 - 44 MB | NPU | -- |
87
- | YOLOv11-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 49.278 ms | 4 - 2109 MB | NPU | -- |
88
- | YOLOv11-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.816 ms | 2 - 43 MB | NPU | -- |
89
- | YOLOv11-Detection | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 51.107 ms | 7 - 653 MB | NPU | -- |
90
- | YOLOv11-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.207 ms | 7 - 7 MB | NPU | -- |
91
- | YOLOv11-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 59.34 ms | 31 - 31 MB | NPU | -- |
92
- | YOLOv11-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.672 ms | 0 - 26 MB | NPU | -- |
93
- | YOLOv11-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.538 ms | 1 - 27 MB | NPU | -- |
94
- | YOLOv11-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.972 ms | 0 - 38 MB | NPU | -- |
95
- | YOLOv11-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.938 ms | 1 - 38 MB | NPU | -- |
96
- | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.823 ms | 0 - 12 MB | NPU | -- |
97
- | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.718 ms | 1 - 13 MB | NPU | -- |
98
- | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.355 ms | 0 - 27 MB | NPU | -- |
99
- | YOLOv11-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.282 ms | 0 - 26 MB | NPU | -- |
100
- | YOLOv11-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.134 ms | 1 - 27 MB | NPU | -- |
101
- | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.238 ms | 0 - 33 MB | NPU | -- |
102
- | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 5.278 ms | 1 - 36 MB | NPU | -- |
103
- | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 44.328 ms | 23 - 40 MB | CPU | -- |
104
- | YOLOv11-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 57.878 ms | 2 - 9 MB | NPU | -- |
105
- | YOLOv11-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 44.199 ms | 24 - 29 MB | CPU | -- |
106
- | YOLOv11-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.672 ms | 0 - 26 MB | NPU | -- |
107
- | YOLOv11-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.538 ms | 1 - 27 MB | NPU | -- |
108
- | YOLOv11-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.829 ms | 0 - 12 MB | NPU | -- |
109
- | YOLOv11-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.722 ms | 1 - 13 MB | NPU | -- |
110
- | YOLOv11-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.649 ms | 0 - 31 MB | NPU | -- |
111
- | YOLOv11-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.504 ms | 1 - 34 MB | NPU | -- |
112
- | YOLOv11-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.839 ms | 0 - 12 MB | NPU | -- |
113
- | YOLOv11-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.718 ms | 1 - 14 MB | NPU | -- |
114
- | YOLOv11-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.282 ms | 0 - 26 MB | NPU | -- |
115
- | YOLOv11-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.134 ms | 1 - 27 MB | NPU | -- |
116
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.824 ms | 0 - 13 MB | NPU | -- |
117
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.714 ms | 1 - 13 MB | NPU | -- |
118
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 6.298 ms | 0 - 26 MB | NPU | -- |
119
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.204 ms | 0 - 42 MB | NPU | -- |
120
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.179 ms | 1 - 37 MB | NPU | -- |
121
- | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.57 ms | 0 - 88 MB | NPU | -- |
122
- | YOLOv11-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.11 ms | 0 - 28 MB | NPU | -- |
123
- | YOLOv11-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.041 ms | 1 - 31 MB | NPU | -- |
124
- | YOLOv11-Detection | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 3.409 ms | 1 - 60 MB | NPU | -- |
125
- | YOLOv11-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.96 ms | 4 - 4 MB | NPU | -- |
126
- | YOLOv11-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.774 ms | 1 - 1 MB | NPU | -- |
127
- | YOLOv11-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.51 ms | 1 - 28 MB | NPU | -- |
128
- | YOLOv11-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.777 ms | 2 - 13 MB | NPU | -- |
129
- | YOLOv11-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 60.911 ms | 10 - 194 MB | NPU | -- |
130
- | YOLOv11-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.381 ms | 1 - 30 MB | NPU | -- |
131
- | YOLOv11-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 141.375 ms | 75 - 92 MB | CPU | -- |
132
- | YOLOv11-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 116.765 ms | 70 - 77 MB | CPU | -- |
133
- | YOLOv11-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.51 ms | 1 - 28 MB | NPU | -- |
134
  | YOLOv11-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.811 ms | 2 - 13 MB | NPU | -- |
135
- | YOLOv11-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.805 ms | 2 - 12 MB | NPU | -- |
136
- | YOLOv11-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.381 ms | 1 - 30 MB | NPU | -- |
137
- | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.806 ms | 4 - 14 MB | NPU | -- |
138
- | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 61.57 ms | 10 - 190 MB | NPU | -- |
139
- | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.882 ms | 2 - 37 MB | NPU | -- |
140
- | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 47.321 ms | 0 - 689 MB | NPU | -- |
141
- | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.652 ms | 2 - 38 MB | NPU | -- |
142
- | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 47.264 ms | 8 - 656 MB | NPU | -- |
143
- | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.144 ms | 5 - 5 MB | NPU | -- |
144
- | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 61.883 ms | 25 - 25 MB | NPU | -- |
145
 
146
 
147
 
@@ -223,7 +213,7 @@ from qai_hub_models.models.yolov11_det import Model
223
  torch_model = Model.from_pretrained()
224
 
225
  # Device
226
- device = hub.Device("Samsung Galaxy S24")
227
 
228
  # Trace model
229
  input_shape = torch_model.get_input_spec()
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | YOLOv11-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 13.477 ms | 0 - 65 MB | NPU | -- |
42
+ | YOLOv11-Detection | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 12.411 ms | 2 - 96 MB | NPU | -- |
43
+ | YOLOv11-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 7.309 ms | 0 - 40 MB | NPU | -- |
44
+ | YOLOv11-Detection | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.662 ms | 5 - 44 MB | NPU | -- |
45
+ | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 4.298 ms | 0 - 23 MB | NPU | -- |
46
+ | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.845 ms | 1 - 101 MB | NPU | -- |
47
+ | YOLOv11-Detection | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.698 ms | 0 - 103 MB | NPU | -- |
48
+ | YOLOv11-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.595 ms | 0 - 65 MB | NPU | -- |
49
+ | YOLOv11-Detection | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 5.222 ms | 2 - 121 MB | NPU | -- |
50
+ | YOLOv11-Detection | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 13.477 ms | 0 - 65 MB | NPU | -- |
51
+ | YOLOv11-Detection | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 12.411 ms | 2 - 96 MB | NPU | -- |
52
+ | YOLOv11-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 4.305 ms | 0 - 23 MB | NPU | -- |
53
+ | YOLOv11-Detection | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.838 ms | 5 - 103 MB | NPU | -- |
54
+ | YOLOv11-Detection | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 8.499 ms | 0 - 33 MB | NPU | -- |
55
+ | YOLOv11-Detection | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 8.14 ms | 4 - 38 MB | NPU | -- |
56
+ | YOLOv11-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 4.309 ms | 0 - 22 MB | NPU | -- |
57
+ | YOLOv11-Detection | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.852 ms | 5 - 91 MB | NPU | -- |
58
+ | YOLOv11-Detection | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.595 ms | 0 - 65 MB | NPU | -- |
59
+ | YOLOv11-Detection | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 5.222 ms | 2 - 121 MB | NPU | -- |
60
+ | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 3.13 ms | 0 - 82 MB | NPU | -- |
61
+ | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.742 ms | 5 - 229 MB | NPU | -- |
62
+ | YOLOv11-Detection | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.694 ms | 0 - 202 MB | NPU | -- |
63
+ | YOLOv11-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 2.552 ms | 0 - 74 MB | NPU | -- |
64
+ | YOLOv11-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 2.293 ms | 5 - 120 MB | NPU | -- |
65
+ | YOLOv11-Detection | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.741 ms | 1 - 95 MB | NPU | -- |
66
+ | YOLOv11-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.296 ms | 118 - 118 MB | NPU | -- |
67
+ | YOLOv11-Detection | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.021 ms | 5 - 5 MB | NPU | -- |
68
+ | YOLOv11-Detection | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 7.214 ms | 2 - 37 MB | NPU | -- |
69
+ | YOLOv11-Detection | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.599 ms | 2 - 45 MB | NPU | -- |
70
+ | YOLOv11-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 3.837 ms | 2 - 11 MB | NPU | -- |
71
+ | YOLOv11-Detection | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 59.052 ms | 10 - 195 MB | NPU | -- |
72
+ | YOLOv11-Detection | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 4.425 ms | 2 - 35 MB | NPU | -- |
73
+ | YOLOv11-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 13.725 ms | 2 - 40 MB | NPU | -- |
74
+ | YOLOv11-Detection | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 169.623 ms | 93 - 109 MB | CPU | -- |
75
+ | YOLOv11-Detection | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 132.002 ms | 92 - 98 MB | CPU | -- |
76
+ | YOLOv11-Detection | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 7.214 ms | 2 - 37 MB | NPU | -- |
77
+ | YOLOv11-Detection | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 3.847 ms | 2 - 13 MB | NPU | -- |
78
+ | YOLOv11-Detection | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 5.076 ms | 2 - 40 MB | NPU | -- |
79
+ | YOLOv11-Detection | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 3.843 ms | 2 - 13 MB | NPU | -- |
80
+ | YOLOv11-Detection | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 4.425 ms | 2 - 35 MB | NPU | -- |
81
+ | YOLOv11-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.537 ms | 2 - 47 MB | NPU | -- |
82
+ | YOLOv11-Detection | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 45.285 ms | 3 - 1738 MB | NPU | -- |
83
+ | YOLOv11-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.802 ms | 2 - 44 MB | NPU | -- |
84
+ | YOLOv11-Detection | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 41.236 ms | 23 - 958 MB | NPU | -- |
85
+ | YOLOv11-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 4.224 ms | 10 - 10 MB | NPU | -- |
86
+ | YOLOv11-Detection | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 57.198 ms | 29 - 29 MB | NPU | -- |
87
+ | YOLOv11-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.713 ms | 0 - 26 MB | NPU | -- |
88
+ | YOLOv11-Detection | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.526 ms | 1 - 27 MB | NPU | -- |
89
+ | YOLOv11-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.978 ms | 0 - 43 MB | NPU | -- |
90
+ | YOLOv11-Detection | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.937 ms | 1 - 39 MB | NPU | -- |
91
+ | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.83 ms | 0 - 12 MB | NPU | -- |
92
+ | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.714 ms | 1 - 13 MB | NPU | -- |
93
+ | YOLOv11-Detection | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.597 ms | 0 - 28 MB | NPU | -- |
94
+ | YOLOv11-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.291 ms | 0 - 26 MB | NPU | -- |
95
+ | YOLOv11-Detection | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.174 ms | 0 - 26 MB | NPU | -- |
96
+ | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 4.088 ms | 0 - 33 MB | NPU | -- |
97
+ | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 5.487 ms | 1 - 38 MB | NPU | -- |
98
+ | YOLOv11-Detection | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 50.335 ms | 24 - 41 MB | CPU | -- |
99
+ | YOLOv11-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 56.373 ms | 1 - 8 MB | NPU | -- |
100
+ | YOLOv11-Detection | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 44.157 ms | 22 - 27 MB | CPU | -- |
101
+ | YOLOv11-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.713 ms | 0 - 26 MB | NPU | -- |
102
+ | YOLOv11-Detection | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.526 ms | 1 - 27 MB | NPU | -- |
103
+ | YOLOv11-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.835 ms | 0 - 12 MB | NPU | -- |
104
+ | YOLOv11-Detection | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.721 ms | 1 - 13 MB | NPU | -- |
105
+ | YOLOv11-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.676 ms | 0 - 32 MB | NPU | -- |
106
+ | YOLOv11-Detection | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.536 ms | 1 - 33 MB | NPU | -- |
107
+ | YOLOv11-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.827 ms | 0 - 7 MB | NPU | -- |
108
+ | YOLOv11-Detection | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.723 ms | 2 - 13 MB | NPU | -- |
109
+ | YOLOv11-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.291 ms | 0 - 26 MB | NPU | -- |
110
+ | YOLOv11-Detection | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.174 ms | 0 - 26 MB | NPU | -- |
111
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.215 ms | 0 - 38 MB | NPU | -- |
112
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.186 ms | 1 - 37 MB | NPU | -- |
113
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.749 ms | 1 - 86 MB | NPU | -- |
114
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.927 ms | 0 - 28 MB | NPU | -- |
115
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.84 ms | 1 - 29 MB | NPU | -- |
116
+ | YOLOv11-Detection | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 3.415 ms | 0 - 66 MB | NPU | -- |
117
+ | YOLOv11-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.988 ms | 0 - 0 MB | NPU | -- |
118
+ | YOLOv11-Detection | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.813 ms | 1 - 1 MB | NPU | -- |
119
+ | YOLOv11-Detection | w8a8_mixed_int16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.535 ms | 2 - 30 MB | NPU | -- |
120
+ | YOLOv11-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.812 ms | 2 - 11 MB | NPU | -- |
121
+ | YOLOv11-Detection | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 63.077 ms | 10 - 196 MB | NPU | -- |
122
+ | YOLOv11-Detection | w8a8_mixed_int16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.377 ms | 2 - 30 MB | NPU | -- |
123
+ | YOLOv11-Detection | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 144.543 ms | 75 - 92 MB | CPU | -- |
124
+ | YOLOv11-Detection | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 112.679 ms | 79 - 93 MB | CPU | -- |
125
+ | YOLOv11-Detection | w8a8_mixed_int16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.535 ms | 2 - 30 MB | NPU | -- |
 
 
 
 
 
 
 
 
126
  | YOLOv11-Detection | w8a8_mixed_int16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.811 ms | 2 - 13 MB | NPU | -- |
127
+ | YOLOv11-Detection | w8a8_mixed_int16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.804 ms | 2 - 12 MB | NPU | -- |
128
+ | YOLOv11-Detection | w8a8_mixed_int16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.377 ms | 2 - 30 MB | NPU | -- |
129
+ | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.882 ms | 2 - 36 MB | NPU | -- |
130
+ | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 50.069 ms | 0 - 891 MB | NPU | -- |
131
+ | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.343 ms | 2 - 39 MB | NPU | -- |
132
+ | YOLOv11-Detection | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 42.955 ms | 23 - 898 MB | NPU | -- |
133
+ | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.154 ms | 5 - 5 MB | NPU | -- |
134
+ | YOLOv11-Detection | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 65.943 ms | 29 - 29 MB | NPU | -- |
 
 
135
 
136
 
137
 
 
213
  torch_model = Model.from_pretrained()
214
 
215
  # Device
216
+ device = hub.Device("Samsung Galaxy S25")
217
 
218
  # Trace model
219
  input_shape = torch_model.get_input_spec()