qaihm-bot commited on
Commit
9d03952
·
verified ·
1 Parent(s): 5ab7215

See https://github.com/quic/ai-hub-models/releases/v0.30.5 for changelog.

Files changed (2) hide show
  1. README.md +65 -65
  2. Shufflenet-v2_w8a8.onnx +2 -2
README.md CHANGED
@@ -35,67 +35,67 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | Shufflenet-v2 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.625 ms | 0 - 15 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
39
- | Shufflenet-v2 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 1.595 ms | 1 - 10 MB | NPU | Use Export Script |
40
- | Shufflenet-v2 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.872 ms | 0 - 29 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
41
- | Shufflenet-v2 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 1.299 ms | 1 - 26 MB | NPU | Use Export Script |
42
- | Shufflenet-v2 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.692 ms | 0 - 28 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
43
- | Shufflenet-v2 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.689 ms | 1 - 3 MB | NPU | Use Export Script |
44
- | Shufflenet-v2 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.954 ms | 0 - 17 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
45
- | Shufflenet-v2 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.916 ms | 1 - 15 MB | NPU | Use Export Script |
46
- | Shufflenet-v2 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.625 ms | 0 - 15 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
47
- | Shufflenet-v2 | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 1.595 ms | 1 - 10 MB | NPU | Use Export Script |
48
- | Shufflenet-v2 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.693 ms | 0 - 28 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
49
- | Shufflenet-v2 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.69 ms | 1 - 3 MB | NPU | Use Export Script |
50
- | Shufflenet-v2 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.203 ms | 0 - 19 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
51
- | Shufflenet-v2 | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 1.173 ms | 0 - 18 MB | NPU | Use Export Script |
52
- | Shufflenet-v2 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.693 ms | 0 - 27 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
53
- | Shufflenet-v2 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.698 ms | 1 - 3 MB | NPU | Use Export Script |
54
- | Shufflenet-v2 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.954 ms | 0 - 17 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
55
- | Shufflenet-v2 | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.916 ms | 1 - 15 MB | NPU | Use Export Script |
56
- | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 0.692 ms | 0 - 27 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
57
- | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.69 ms | 0 - 17 MB | NPU | Use Export Script |
58
- | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 0.956 ms | 0 - 12 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
59
- | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.452 ms | 0 - 24 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
60
- | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.463 ms | 0 - 26 MB | NPU | Use Export Script |
61
- | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.59 ms | 0 - 26 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
62
- | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.363 ms | 0 - 22 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
63
- | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.43 ms | 0 - 23 MB | NPU | Use Export Script |
64
- | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.652 ms | 1 - 23 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
65
- | Shufflenet-v2 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.841 ms | 1 - 1 MB | NPU | Use Export Script |
66
- | Shufflenet-v2 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.023 ms | 0 - 0 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
67
- | Shufflenet-v2 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 0.792 ms | 0 - 12 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
68
- | Shufflenet-v2 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 1.075 ms | 0 - 10 MB | NPU | Use Export Script |
69
- | Shufflenet-v2 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.423 ms | 0 - 22 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
70
- | Shufflenet-v2 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 0.614 ms | 0 - 25 MB | NPU | Use Export Script |
71
- | Shufflenet-v2 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.322 ms | 0 - 10 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
72
- | Shufflenet-v2 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.474 ms | 0 - 3 MB | NPU | Use Export Script |
73
- | Shufflenet-v2 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.518 ms | 0 - 14 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
74
- | Shufflenet-v2 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.668 ms | 0 - 15 MB | NPU | Use Export Script |
75
- | Shufflenet-v2 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 0.619 ms | 0 - 20 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
76
- | Shufflenet-v2 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN | 1.01 ms | 0 - 14 MB | NPU | Use Export Script |
77
- | Shufflenet-v2 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.356 ms | 0 - 17 MB | CPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
78
- | Shufflenet-v2 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 0.792 ms | 0 - 12 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
79
- | Shufflenet-v2 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN | 1.075 ms | 0 - 10 MB | NPU | Use Export Script |
80
- | Shufflenet-v2 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.326 ms | 0 - 9 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
81
- | Shufflenet-v2 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.477 ms | 0 - 2 MB | NPU | Use Export Script |
82
- | Shufflenet-v2 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.634 ms | 0 - 16 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
83
- | Shufflenet-v2 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN | 0.794 ms | 0 - 17 MB | NPU | Use Export Script |
84
- | Shufflenet-v2 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.32 ms | 0 - 9 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
85
- | Shufflenet-v2 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.473 ms | 0 - 2 MB | NPU | Use Export Script |
86
- | Shufflenet-v2 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.518 ms | 0 - 14 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
87
- | Shufflenet-v2 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.668 ms | 0 - 15 MB | NPU | Use Export Script |
88
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 0.312 ms | 0 - 9 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
89
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.475 ms | 2 - 11 MB | NPU | Use Export Script |
90
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 0.766 ms | 0 - 9 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
91
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.23 ms | 0 - 25 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
92
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.343 ms | 0 - 25 MB | NPU | Use Export Script |
93
- | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.537 ms | 0 - 31 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
94
- | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.276 ms | 0 - 19 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
95
- | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.335 ms | 0 - 18 MB | NPU | Use Export Script |
96
- | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.492 ms | 0 - 21 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
97
- | Shufflenet-v2 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.581 ms | 0 - 0 MB | NPU | Use Export Script |
98
- | Shufflenet-v2 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 0.784 ms | 0 - 0 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
99
 
100
 
101
 
@@ -159,8 +159,8 @@ Profiling Results
159
  Shufflenet-v2
160
  Device : cs_8275 (ANDROID 14)
161
  Runtime : TFLITE
162
- Estimated inference time (ms) : 1.6
163
- Estimated peak memory usage (MB): [0, 15]
164
  Total # Ops : 159
165
  Compute Unit(s) : npu (159 ops) gpu (0 ops) cpu (0 ops)
166
  ```
@@ -249,13 +249,13 @@ AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
249
  You can also run the demo on-device.
250
 
251
  ```bash
252
- python -m qai_hub_models.models.shufflenet_v2.demo --on-device
253
  ```
254
 
255
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
256
  environment, please add the following to your cell (instead of the above).
257
  ```
258
- %run -m qai_hub_models.models.shufflenet_v2.demo -- --on-device
259
  ```
260
 
261
 
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | Shufflenet-v2 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.225 ms | 0 - 16 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
39
+ | Shufflenet-v2 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 4.096 ms | 1 - 10 MB | NPU | Use Export Script |
40
+ | Shufflenet-v2 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.791 ms | 0 - 31 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
41
+ | Shufflenet-v2 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 1.178 ms | 1 - 29 MB | NPU | Use Export Script |
42
+ | Shufflenet-v2 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.696 ms | 0 - 29 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
43
+ | Shufflenet-v2 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.691 ms | 1 - 3 MB | NPU | Use Export Script |
44
+ | Shufflenet-v2 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.948 ms | 0 - 18 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
45
+ | Shufflenet-v2 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.914 ms | 1 - 12 MB | NPU | Use Export Script |
46
+ | Shufflenet-v2 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.225 ms | 0 - 16 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
47
+ | Shufflenet-v2 | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 4.096 ms | 1 - 10 MB | NPU | Use Export Script |
48
+ | Shufflenet-v2 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.698 ms | 0 - 30 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
49
+ | Shufflenet-v2 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.692 ms | 1 - 3 MB | NPU | Use Export Script |
50
+ | Shufflenet-v2 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.131 ms | 0 - 26 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
51
+ | Shufflenet-v2 | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 1.137 ms | 0 - 17 MB | NPU | Use Export Script |
52
+ | Shufflenet-v2 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.696 ms | 0 - 29 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
53
+ | Shufflenet-v2 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.685 ms | 1 - 3 MB | NPU | Use Export Script |
54
+ | Shufflenet-v2 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.948 ms | 0 - 18 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
55
+ | Shufflenet-v2 | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.914 ms | 1 - 12 MB | NPU | Use Export Script |
56
+ | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 0.69 ms | 0 - 29 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
57
+ | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.686 ms | 1 - 19 MB | NPU | Use Export Script |
58
+ | Shufflenet-v2 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 0.982 ms | 0 - 13 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
59
+ | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.451 ms | 0 - 27 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
60
+ | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.464 ms | 0 - 26 MB | NPU | Use Export Script |
61
+ | Shufflenet-v2 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.598 ms | 0 - 28 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
62
+ | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.454 ms | 0 - 19 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.tflite) |
63
+ | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.467 ms | 1 - 19 MB | NPU | Use Export Script |
64
+ | Shufflenet-v2 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.654 ms | 1 - 23 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
65
+ | Shufflenet-v2 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.851 ms | 1 - 1 MB | NPU | Use Export Script |
66
+ | Shufflenet-v2 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.007 ms | 0 - 0 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2.onnx) |
67
+ | Shufflenet-v2 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.011 ms | 0 - 13 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
68
+ | Shufflenet-v2 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 1.255 ms | 0 - 9 MB | NPU | Use Export Script |
69
+ | Shufflenet-v2 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.368 ms | 0 - 32 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
70
+ | Shufflenet-v2 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 0.548 ms | 0 - 27 MB | NPU | Use Export Script |
71
+ | Shufflenet-v2 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.314 ms | 0 - 10 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
72
+ | Shufflenet-v2 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 0.475 ms | 0 - 3 MB | NPU | Use Export Script |
73
+ | Shufflenet-v2 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.511 ms | 0 - 14 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
74
+ | Shufflenet-v2 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 0.653 ms | 0 - 13 MB | NPU | Use Export Script |
75
+ | Shufflenet-v2 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 0.672 ms | 0 - 16 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
76
+ | Shufflenet-v2 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN | 1.118 ms | 0 - 12 MB | NPU | Use Export Script |
77
+ | Shufflenet-v2 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 7.293 ms | 0 - 7 MB | CPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
78
+ | Shufflenet-v2 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.011 ms | 0 - 13 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
79
+ | Shufflenet-v2 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN | 1.255 ms | 0 - 9 MB | NPU | Use Export Script |
80
+ | Shufflenet-v2 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.319 ms | 0 - 10 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
81
+ | Shufflenet-v2 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 0.478 ms | 0 - 2 MB | NPU | Use Export Script |
82
+ | Shufflenet-v2 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.657 ms | 0 - 16 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
83
+ | Shufflenet-v2 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN | 0.81 ms | 0 - 17 MB | NPU | Use Export Script |
84
+ | Shufflenet-v2 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.327 ms | 0 - 10 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
85
+ | Shufflenet-v2 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 0.464 ms | 0 - 11 MB | NPU | Use Export Script |
86
+ | Shufflenet-v2 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.511 ms | 0 - 14 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
87
+ | Shufflenet-v2 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN | 0.653 ms | 0 - 13 MB | NPU | Use Export Script |
88
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 0.324 ms | 0 - 10 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
89
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 0.468 ms | 0 - 10 MB | NPU | Use Export Script |
90
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 0.757 ms | 0 - 9 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
91
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.216 ms | 0 - 27 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
92
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 0.342 ms | 0 - 26 MB | NPU | Use Export Script |
93
+ | Shufflenet-v2 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.526 ms | 0 - 26 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
94
+ | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 0.267 ms | 0 - 21 MB | NPU | [Shufflenet-v2.tflite](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.tflite) |
95
+ | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 0.256 ms | 0 - 19 MB | NPU | Use Export Script |
96
+ | Shufflenet-v2 | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 0.607 ms | 0 - 19 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
97
+ | Shufflenet-v2 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 0.578 ms | 0 - 0 MB | NPU | Use Export Script |
98
+ | Shufflenet-v2 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 0.783 ms | 0 - 0 MB | NPU | [Shufflenet-v2.onnx](https://huggingface.co/qualcomm/Shufflenet-v2/blob/main/Shufflenet-v2_w8a8.onnx) |
99
 
100
 
101
 
 
159
  Shufflenet-v2
160
  Device : cs_8275 (ANDROID 14)
161
  Runtime : TFLITE
162
+ Estimated inference time (ms) : 4.2
163
+ Estimated peak memory usage (MB): [0, 16]
164
  Total # Ops : 159
165
  Compute Unit(s) : npu (159 ops) gpu (0 ops) cpu (0 ops)
166
  ```
 
249
  You can also run the demo on-device.
250
 
251
  ```bash
252
+ python -m qai_hub_models.models.shufflenet_v2.demo --eval-mode on-device
253
  ```
254
 
255
  **NOTE**: If you want running in a Jupyter Notebook or Google Colab like
256
  environment, please add the following to your cell (instead of the above).
257
  ```
258
+ %run -m qai_hub_models.models.shufflenet_v2.demo -- --eval-mode on-device
259
  ```
260
 
261
 
Shufflenet-v2_w8a8.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff6a04bcf60bb90b1f1db184862e67fec87162e262a66bb26b6a004c49b574d6
3
- size 5582995
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:149c85077c6a2253274224732179eb34abd60e9ddaa0b1778498c815dbd24d52
3
+ size 5593658