qaihm-bot commited on
Commit
5f8ea25
·
verified ·
1 Parent(s): 2197db4

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

README.md CHANGED
@@ -37,70 +37,65 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.098 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
41
- | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.879 ms | 1 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
42
- | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.971 ms | 0 - 53 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
43
- | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.352 ms | 1 - 26 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
44
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.362 ms | 0 - 222 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
45
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.265 ms | 1 - 84 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
46
- | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.129 ms | 0 - 78 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
47
- | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.123 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
48
- | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.922 ms | 0 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
49
- | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.098 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
50
- | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.879 ms | 1 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
51
- | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.36 ms | 0 - 222 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
52
- | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.268 ms | 0 - 86 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
53
- | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.506 ms | 0 - 24 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
54
- | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.291 ms | 1 - 23 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
55
- | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.358 ms | 0 - 220 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
56
- | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.267 ms | 0 - 80 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
57
- | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.123 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
58
- | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.922 ms | 0 - 17 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
59
- | ResNet18 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 1.356 ms | 0 - 226 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
60
- | ResNet18 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 1.266 ms | 0 - 80 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
61
- | ResNet18 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 1.156 ms | 0 - 60 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
62
- | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.947 ms | 0 - 50 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
63
  | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.881 ms | 1 - 28 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
64
- | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.836 ms | 0 - 24 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
65
- | ResNet18 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.872 ms | 0 - 27 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
66
- | ResNet18 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.823 ms | 1 - 24 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
67
- | ResNet18 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.84 ms | 1 - 17 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
68
- | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.413 ms | 79 - 79 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
69
- | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.138 ms | 22 - 22 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
70
- | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.034 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
71
- | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.276 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
72
- | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.471 ms | 0 - 43 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
73
- | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.738 ms | 0 - 48 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
74
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.401 ms | 0 - 89 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
75
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.542 ms | 0 - 87 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
76
- | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 20.121 ms | 36 - 156 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
77
- | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.57 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
78
- | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.697 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
79
- | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.392 ms | 0 - 33 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
80
- | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 2.017 ms | 0 - 31 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
81
- | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 29.289 ms | 11 - 25 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
82
- | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.426 ms | 0 - 3 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
83
- | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 26.877 ms | 10 - 35 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
84
- | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.034 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
85
- | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.276 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
86
- | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.404 ms | 0 - 89 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
87
- | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.547 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
88
- | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.745 ms | 0 - 23 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
89
- | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.888 ms | 0 - 26 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
90
- | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.402 ms | 0 - 87 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
91
- | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.543 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
92
- | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.57 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
93
- | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.697 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
94
- | ResNet18 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 0.541 ms | 0 - 87 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
95
- | ResNet18 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 20.045 ms | 35 - 193 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
96
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.312 ms | 0 - 42 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
97
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.415 ms | 0 - 41 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
98
- | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 16.965 ms | 37 - 560 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
99
- | ResNet18 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.307 ms | 0 - 22 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
100
- | ResNet18 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 0.346 ms | 0 - 24 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
101
- | ResNet18 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 17.252 ms | 36 - 401 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
102
- | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.622 ms | 70 - 70 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
103
- | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 19.173 ms | 58 - 58 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
104
 
105
 
106
 
@@ -182,7 +177,7 @@ from qai_hub_models.models.resnet18 import Model
182
  torch_model = Model.from_pretrained()
183
 
184
  # Device
185
- device = hub.Device("Samsung Galaxy S24")
186
 
187
  # Trace model
188
  input_shape = torch_model.get_input_spec()
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.11 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
41
+ | ResNet18 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 5.881 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
42
+ | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.99 ms | 0 - 52 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
43
+ | ResNet18 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.372 ms | 1 - 27 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
44
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.361 ms | 0 - 226 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
45
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.265 ms | 0 - 83 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
46
+ | ResNet18 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.243 ms | 0 - 71 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
47
+ | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.114 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
48
+ | ResNet18 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.915 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
49
+ | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.11 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
50
+ | ResNet18 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 5.881 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
51
+ | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.36 ms | 0 - 221 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
52
+ | ResNet18 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.268 ms | 0 - 85 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
53
+ | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.5 ms | 0 - 24 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
54
+ | ResNet18 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.297 ms | 0 - 22 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
55
+ | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.361 ms | 0 - 219 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
56
+ | ResNet18 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.268 ms | 0 - 82 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
57
+ | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.114 ms | 0 - 20 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
58
+ | ResNet18 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.915 ms | 1 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
59
+ | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.942 ms | 0 - 49 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
 
 
 
60
  | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.881 ms | 1 - 28 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
61
+ | ResNet18 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.873 ms | 0 - 27 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
62
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.757 ms | 0 - 28 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.tflite) |
63
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.702 ms | 1 - 23 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
64
+ | ResNet18 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.725 ms | 0 - 22 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
65
+ | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.397 ms | 89 - 89 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.dlc) |
66
+ | ResNet18 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.154 ms | 23 - 23 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18.onnx.zip) |
67
+ | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.038 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
68
+ | ResNet18 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1.287 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
69
+ | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.471 ms | 0 - 46 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
70
+ | ResNet18 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.738 ms | 0 - 46 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
71
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.392 ms | 0 - 88 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
72
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.544 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
73
+ | ResNet18 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 20.182 ms | 25 - 153 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
74
+ | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.59 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
75
+ | ResNet18 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.725 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
76
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.451 ms | 0 - 33 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
77
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 2.034 ms | 0 - 30 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
78
+ | ResNet18 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 28.474 ms | 10 - 22 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
79
+ | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.307 ms | 0 - 2 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
80
+ | ResNet18 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 28.93 ms | 11 - 36 MB | CPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
81
+ | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.038 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
82
+ | ResNet18 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1.287 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
83
+ | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.403 ms | 0 - 89 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
84
+ | ResNet18 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.548 ms | 0 - 87 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
85
+ | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.748 ms | 0 - 24 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
86
+ | ResNet18 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.897 ms | 0 - 24 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
87
+ | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.401 ms | 0 - 88 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
88
+ | ResNet18 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.551 ms | 0 - 88 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
89
+ | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.59 ms | 0 - 18 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
90
+ | ResNet18 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.725 ms | 0 - 18 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
91
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.299 ms | 0 - 39 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
92
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.41 ms | 0 - 43 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
93
+ | ResNet18 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 15.156 ms | 38 - 550 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
94
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.255 ms | 0 - 21 MB | NPU | [ResNet18.tflite](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.tflite) |
95
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.295 ms | 0 - 25 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
96
+ | ResNet18 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 12.485 ms | 38 - 403 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
97
+ | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.61 ms | 71 - 71 MB | NPU | [ResNet18.dlc](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.dlc) |
98
+ | ResNet18 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 18.99 ms | 58 - 58 MB | NPU | [ResNet18.onnx.zip](https://huggingface.co/qualcomm/ResNet18/blob/main/ResNet18_w8a8.onnx.zip) |
 
 
99
 
100
 
101
 
 
177
  torch_model = Model.from_pretrained()
178
 
179
  # Device
180
+ device = hub.Device("Samsung Galaxy S25")
181
 
182
  # Trace model
183
  input_shape = torch_model.get_input_spec()
ResNet18_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7324218cb722e8d294f4e9fa0d9894377577268b19b24380cf669b680a60bfec
3
- size 46801708
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7941642bc122ccd6513099cfa43a0ef1dc33adf322baff6345c9d63d2757b93
3
+ size 46801796
ResNet18_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c519a4198d170bd871fa79e96b7a5616b37977ba10f2b8187d48b25162274f7
3
- size 43534188
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d1198af3a7d0ebebde1b9761c5b37823938a79a487ffa81d177514acb66fafa
3
+ size 43534296
ResNet18_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ccd705f65096a159ccec9f2ec71059394b03f9d1842ccc691382f52bc609742a
3
  size 12036780
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a178db9d0feacfe25a392e9a314fbbda2badf6c332fe0dc6f5fef57f9fbe86d
3
  size 12036780
ResNet18_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:499bfb808afd5f668d5d288967851f8d4c71adc5fed7808237854d8f61523895
3
- size 19307617
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c8a90e3798e6266531e02290d17d4d8813da2f5af60b02f9b3fabae5981efd5
3
+ size 19310437
ResNet18_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:23ef557943bea43b7c73af7cadac4748494aea9189cfa4047c4b3dd1ba3994a1
3
  size 11848936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7986f14745422ee6f75220dfa069a7ae4cd9fe2c6de6e08b3a79aa72fd77867
3
  size 11848936
precompiled/qualcomm-qcs6490-proxy/ResNet18_w8a8.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d43b6f06c0dbeb127c54f107e1fd38cda91f3726bb842239832075c012e2672f
3
- size 11849728
 
 
 
 
precompiled/qualcomm-qcs6490-proxy/ResNet18_w8a8.onnx.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:7438b52d3772b17db670bc590d937dbc15201046391fbfbc995e8f0fd5194303
3
- size 9940534
 
 
 
 
precompiled/qualcomm-qcs6490-proxy/tool-versions.yaml DELETED
@@ -1,3 +0,0 @@
1
- tool_versions:
2
- precompiled_qnn_onnx:
3
- qairt: 2.36.4.250725200057_123280
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/ResNet18_float.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:d94d94c5da43a55bc8c4265f489580c16902d351fd8d8306ee2b9c32b0bf1ad9
3
- size 23740416
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/ResNet18_float.onnx.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0cfda72ff6b1362833348c6c25e268d5161da370ee17d29b8820512a6804104
3
- size 21770376
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/ResNet18_w8a8.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f9bc50d5080224e475b598cccbe2bb0513a6e5ca1239a3fc20705c9891e57ae
3
- size 11841536
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/ResNet18_w8a8.onnx.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:f39cc25e19ce95c4b7a256ff0e8221b68c929c5ff6ef1ddb7cac8e2d88c442ec
3
- size 9935154
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml DELETED
@@ -1,3 +0,0 @@
1
- tool_versions:
2
- precompiled_qnn_onnx:
3
- qairt: 2.36.4.250725200057_123280
 
 
 
 
tool-versions.yaml CHANGED
@@ -1,4 +1,4 @@
1
  tool_versions:
2
- tflite:
3
- qairt: 2.37.0.250724175447_124859
4
- tflite: 2.17.0
 
1
  tool_versions:
2
+ onnx:
3
+ qairt: 2.37.1.250807093845_124904
4
+ onnx_runtime: 1.22.2