qaihm-bot commited on
Commit
c57cb31
·
verified ·
1 Parent(s): 7bb4462

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

README.md CHANGED
@@ -37,70 +37,74 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | ResNeXt101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 36.585 ms | 0 - 293 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
41
- | ResNeXt101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 36.045 ms | 1 - 122 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
42
- | ResNeXt101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 9.567 ms | 0 - 257 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
43
- | ResNeXt101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 9.847 ms | 0 - 83 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
44
- | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 6.667 ms | 0 - 36 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
45
- | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 6.636 ms | 1 - 41 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
46
- | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.783 ms | 1 - 41 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
47
- | ResNeXt101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 10.481 ms | 0 - 293 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
48
- | ResNeXt101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.212 ms | 0 - 111 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
49
- | ResNeXt101 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 36.585 ms | 0 - 293 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
50
- | ResNeXt101 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 36.045 ms | 1 - 122 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
51
- | ResNeXt101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 6.691 ms | 0 - 32 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
52
- | ResNeXt101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 6.636 ms | 0 - 41 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
53
- | ResNeXt101 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 11.151 ms | 0 - 260 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
54
- | ResNeXt101 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 10.837 ms | 1 - 80 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
55
- | ResNeXt101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 6.684 ms | 0 - 34 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
56
- | ResNeXt101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 6.704 ms | 0 - 42 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
57
- | ResNeXt101 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 10.481 ms | 0 - 293 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
58
- | ResNeXt101 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.212 ms | 0 - 111 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
59
- | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 4.706 ms | 0 - 291 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
60
- | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.894 ms | 1 - 125 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
61
- | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.687 ms | 1 - 109 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
62
- | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.056 ms | 0 - 289 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
63
- | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 3.938 ms | 1 - 114 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
64
- | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 4.028 ms | 0 - 114 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
65
- | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.374 ms | 0 - 290 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
66
- | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 3.109 ms | 1 - 117 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
67
- | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 3.26 ms | 1 - 116 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
68
- | ResNeXt101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 6.735 ms | 545 - 545 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
69
- | ResNeXt101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.573 ms | 173 - 173 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
70
- | ResNeXt101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.316 ms | 0 - 143 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
71
- | ResNeXt101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.468 ms | 0 - 136 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
72
- | ResNeXt101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 3.189 ms | 0 - 154 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
73
- | ResNeXt101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.927 ms | 0 - 149 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
74
- | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.702 ms | 0 - 36 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
75
- | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.891 ms | 0 - 35 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
76
- | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.295 ms | 0 - 227 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
77
- | ResNeXt101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 3.328 ms | 0 - 143 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
78
- | ResNeXt101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.434 ms | 0 - 138 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
79
- | ResNeXt101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 10.599 ms | 0 - 216 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
80
- | ResNeXt101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 88.46 ms | 0 - 26 MB | CPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
81
- | ResNeXt101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 129.712 ms | 0 - 87 MB | GPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
82
- | ResNeXt101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 77.841 ms | 8 - 42 MB | CPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
83
- | ResNeXt101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.316 ms | 0 - 143 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
84
- | ResNeXt101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.468 ms | 0 - 136 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
85
- | ResNeXt101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.747 ms | 0 - 37 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
86
- | ResNeXt101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.876 ms | 0 - 34 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
87
- | ResNeXt101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 4.082 ms | 0 - 144 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
88
- | ResNeXt101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.242 ms | 0 - 140 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
89
- | ResNeXt101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.747 ms | 0 - 35 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
90
- | ResNeXt101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.883 ms | 0 - 33 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
91
- | ResNeXt101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 3.328 ms | 0 - 143 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
92
- | ResNeXt101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.434 ms | 0 - 138 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
93
- | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.104 ms | 0 - 150 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
94
- | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.152 ms | 0 - 147 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
95
- | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.397 ms | 0 - 162 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
96
- | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.783 ms | 0 - 143 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
97
- | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.822 ms | 0 - 141 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
98
- | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.096 ms | 0 - 152 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
99
- | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.597 ms | 0 - 145 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
100
- | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.478 ms | 0 - 142 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
101
- | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.813 ms | 0 - 153 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
102
- | ResNeXt101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.065 ms | 260 - 260 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
103
- | ResNeXt101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.253 ms | 89 - 89 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
 
 
 
 
104
 
105
 
106
 
@@ -114,9 +118,9 @@ pip install qai-hub-models
114
  ```
115
 
116
 
117
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
118
 
119
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
120
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
121
 
122
  With this API token, you can configure your client to run models on the cloud
@@ -124,7 +128,7 @@ hosted devices.
124
  ```bash
125
  qai-hub configure --api_token API_TOKEN
126
  ```
127
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
128
 
129
 
130
 
@@ -235,7 +239,7 @@ With the output of the model, you can compute like PSNR, relative errors or
235
  spot check the output with expected output.
236
 
237
  **Note**: This on-device profiling and inference requires access to Qualcomm®
238
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
239
 
240
 
241
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | ResNeXt101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 36.293 ms | 0 - 295 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
41
+ | ResNeXt101 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 36.039 ms | 1 - 127 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
42
+ | ResNeXt101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 9.515 ms | 0 - 262 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
43
+ | ResNeXt101 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 9.902 ms | 0 - 85 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
44
+ | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 6.526 ms | 0 - 35 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
45
+ | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 6.619 ms | 1 - 41 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
46
+ | ResNeXt101 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 6.727 ms | 1 - 38 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
47
+ | ResNeXt101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 45.768 ms | 0 - 295 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
48
+ | ResNeXt101 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 10.18 ms | 1 - 112 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
49
+ | ResNeXt101 | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 36.293 ms | 0 - 295 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
50
+ | ResNeXt101 | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 36.039 ms | 1 - 127 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
51
+ | ResNeXt101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 6.521 ms | 0 - 33 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
52
+ | ResNeXt101 | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 6.693 ms | 1 - 40 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
53
+ | ResNeXt101 | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 10.977 ms | 0 - 261 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
54
+ | ResNeXt101 | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 10.795 ms | 1 - 81 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
55
+ | ResNeXt101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 6.583 ms | 0 - 31 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
56
+ | ResNeXt101 | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 6.541 ms | 0 - 43 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
57
+ | ResNeXt101 | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 45.768 ms | 0 - 295 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
58
+ | ResNeXt101 | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 10.18 ms | 1 - 112 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
59
+ | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 4.623 ms | 0 - 286 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
60
+ | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.956 ms | 1 - 126 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
61
+ | ResNeXt101 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 4.724 ms | 1 - 108 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
62
+ | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.011 ms | 0 - 291 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
63
+ | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 3.972 ms | 1 - 113 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
64
+ | ResNeXt101 | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 4.063 ms | 0 - 111 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
65
+ | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.26 ms | 0 - 291 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.tflite) |
66
+ | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 3.1 ms | 0 - 119 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
67
+ | ResNeXt101 | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 3.281 ms | 1 - 117 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
68
+ | ResNeXt101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 6.713 ms | 545 - 545 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.dlc) |
69
+ | ResNeXt101 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.566 ms | 172 - 172 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101.onnx.zip) |
70
+ | ResNeXt101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 6.295 ms | 0 - 145 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
71
+ | ResNeXt101 | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 6.491 ms | 0 - 137 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
72
+ | ResNeXt101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 3.235 ms | 0 - 155 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
73
+ | ResNeXt101 | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 4.215 ms | 0 - 148 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
74
+ | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.719 ms | 0 - 38 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
75
+ | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.852 ms | 0 - 33 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
76
+ | ResNeXt101 | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 3.323 ms | 0 - 227 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
77
+ | ResNeXt101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 3.253 ms | 0 - 144 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
78
+ | ResNeXt101 | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 3.397 ms | 0 - 139 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
79
+ | ResNeXt101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 10.39 ms | 0 - 215 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
80
+ | ResNeXt101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 14.827 ms | 0 - 226 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
81
+ | ResNeXt101 | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 87.44 ms | 0 - 26 MB | CPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
82
+ | ResNeXt101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 129.971 ms | 0 - 159 MB | GPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
83
+ | ResNeXt101 | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 79.388 ms | 6 - 49 MB | CPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
84
+ | ResNeXt101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 6.295 ms | 0 - 145 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
85
+ | ResNeXt101 | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 6.491 ms | 0 - 137 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
86
+ | ResNeXt101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.738 ms | 0 - 35 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
87
+ | ResNeXt101 | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.873 ms | 0 - 35 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
88
+ | ResNeXt101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.963 ms | 0 - 145 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
89
+ | ResNeXt101 | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 4.2 ms | 0 - 141 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
90
+ | ResNeXt101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.722 ms | 0 - 40 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
91
+ | ResNeXt101 | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.838 ms | 0 - 35 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
92
+ | ResNeXt101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 3.253 ms | 0 - 144 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
93
+ | ResNeXt101 | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 3.397 ms | 0 - 139 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
94
+ | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 2.071 ms | 0 - 153 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
95
+ | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 2.146 ms | 0 - 147 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
96
+ | ResNeXt101 | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 2.367 ms | 0 - 161 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
97
+ | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.753 ms | 0 - 142 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
98
+ | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.791 ms | 0 - 141 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
99
+ | ResNeXt101 | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.117 ms | 0 - 152 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
100
+ | ResNeXt101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 3.832 ms | 0 - 234 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
101
+ | ResNeXt101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 4.044 ms | 0 - 174 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
102
+ | ResNeXt101 | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 69.603 ms | 0 - 18 MB | CPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
103
+ | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.536 ms | 0 - 146 MB | NPU | [ResNeXt101.tflite](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.tflite) |
104
+ | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.487 ms | 0 - 144 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
105
+ | ResNeXt101 | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.814 ms | 0 - 154 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
106
+ | ResNeXt101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 3.032 ms | 295 - 295 MB | NPU | [ResNeXt101.dlc](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.dlc) |
107
+ | ResNeXt101 | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 3.241 ms | 89 - 89 MB | NPU | [ResNeXt101.onnx.zip](https://huggingface.co/qualcomm/ResNeXt101/blob/main/ResNeXt101_w8a8.onnx.zip) |
108
 
109
 
110
 
 
118
  ```
119
 
120
 
121
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
122
 
123
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
124
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
125
 
126
  With this API token, you can configure your client to run models on the cloud
 
128
  ```bash
129
  qai-hub configure --api_token API_TOKEN
130
  ```
131
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
132
 
133
 
134
 
 
239
  spot check the output with expected output.
240
 
241
  **Note**: This on-device profiling and inference requires access to Qualcomm®
242
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
243
 
244
 
245
 
ResNeXt101_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:446237cd2c6fb72139769bf0bc697c3d1f83d13b2fecc864fc641c44e504d8bd
3
- size 355016508
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6e9f2b58433baa40573d595b555bfbb830c797d7f2c9b68abbddccf1d0499ef
3
+ size 355016612
ResNeXt101_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06b76bf230e4278c5121b5dce71253486246380603a95797041eb1d41905484f
3
  size 333208549
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61a9eaa146de71e5d70b8b4d66e57396f5d2d300e2f9e36885aa1845a31f28a5
3
  size 333208549
ResNeXt101_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e8d6249b7174641010fe8f5d801be851a9f6b3686858257eb6acb56fcf5eeb5e
3
- size 94948028
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79d690b4d7eb54817e2e7b7daea9d7932909d2258a1a5d25667aae8d567aeda9
3
+ size 94948132
ResNeXt101_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08e5d46b515d9ebfaee970cd8e76fbdfd0db9df74d778a3f0d3b7892f0eb98a0
3
- size 154795221
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9382c5b20abcb3a2de6c506de4276e1e2334fd60c409ae35d43974c09192df5f
3
+ size 154795683
ResNeXt101_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01f4ef16bd36424fec51fca356d7693da96b083bd70082adc7bdaaf9545da30e
3
  size 91516264
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57e532a3387cee6946dd228b433c973c5faea5493fae37bb1fbe5d59e867673a
3
  size 91516264