Hugging Face's logo

qualcomm
/
VIT

Image Classification
PyTorch
backbone
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
d48044c
·
verified ·
1 Parent(s): b65154b

v0.62.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.62.0 for changelog.

Files changed (2) hide show
  1. README.md +172 -156
  2. release_assets.json +16 -10
README.md CHANGED
@@ -15,7 +15,7 @@ pipeline_tag: image-classification
15
  VIT is a machine learning model that can classify images from the Imagenet dataset. It can also be used as a backbone in building more complex models for specific use cases.
16
 
17
  This is based on the implementation of VIT found [here](https://github.com/pytorch/vision/blob/main/torchvision/models/vision_transformer.py).
18
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/vit) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
@@ -28,29 +28,30 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-float.zip)
32
- | ONNX | w8a16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a16.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a8.zip)
34
- | ONNX | w8a8_mixed_int16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a8_mixed_int16.zip)
35
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-float.zip)
36
- | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-w8a16.zip)
37
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-w8a8.zip)
38
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-tflite-float.zip)
39
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-tflite-w8a8.zip)
 
40
 
41
  For more device-specific assets and performance metrics, visit **[VIT on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/vit)**.
42
 
43
 
44
  ### Option 2: Export with Custom Configurations
45
 
46
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/vit) Python library to compile and export the model with your own:
47
  - Custom weights (e.g., fine-tuned checkpoints)
48
  - Custom input shapes
49
  - Target device and runtime configurations
50
 
51
  This option is ideal if you need to customize the model beyond the default configuration provided here.
52
 
53
- See our repository for [VIT on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/vit) for usage instructions.
54
 
55
  ## Model Details
56
 
@@ -67,151 +68,166 @@ See our repository for [VIT on GitHub](https://github.com/qualcomm/ai-hub-models
67
  ## Performance Summary
68
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
69
  |---|---|---|---|---|---|---
70
- | VIT | ONNX | float | Snapdragon® X2 Elite | 3.869 ms | 2 - 2 MB | NPU
71
- | VIT | ONNX | float | Snapdragon® X Elite | 9.697 ms | 171 - 171 MB | NPU
72
- | VIT | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 6.479 ms | 0 - 302 MB | NPU
73
- | VIT | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 14.151 ms | 1 - 299 MB | NPU
74
- | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 12.647 ms | 0 - 4 MB | NPU
75
- | VIT | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.244 ms | 0 - 422 MB | NPU
76
- | VIT | ONNX | float | Qualcomm® QCS8450 | 14.151 ms | 1 - 299 MB | NPU
77
- | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.098 ms | 0 - 4 MB | NPU
78
- | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 9.697 ms | 171 - 171 MB | NPU
79
- | VIT | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.636 ms | 0 - 170 MB | NPU
80
- | VIT | ONNX | float | Snapdragon® 8 Elite Mobile | 4.636 ms | 0 - 170 MB | NPU
81
- | VIT | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.564 ms | 0 - 159 MB | NPU
82
  | VIT | ONNX | w8a16 | Snapdragon® X2 Elite | 3.572 ms | 1 - 1 MB | NPU
83
- | VIT | ONNX | w8a16 | Snapdragon® X Elite | 8.223 ms | 85 - 85 MB | NPU
84
- | VIT | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 5.344 ms | 0 - 320 MB | NPU
85
- | VIT | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 9.255 ms | 0 - 323 MB | NPU
86
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 38.332 ms | 0 - 3 MB | NPU
87
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 7.47 ms | 0 - 4 MB | NPU
88
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.825 ms | 0 - 98 MB | NPU
89
- | VIT | ONNX | w8a16 | Qualcomm® QCS8450 | 9.255 ms | 0 - 323 MB | NPU
90
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 7.935 ms | 0 - 3 MB | NPU
91
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 8.223 ms | 85 - 85 MB | NPU
92
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 106.969 ms | 0 - 465 MB | NPU
93
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 9.753 ms | 0 - 401 MB | NPU
94
- | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 4.091 ms | 0 - 264 MB | NPU
95
- | VIT | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 4.091 ms | 0 - 264 MB | NPU
96
- | VIT | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.089 ms | 0 - 266 MB | NPU
97
- | VIT | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 9.753 ms | 0 - 401 MB | NPU
98
- | VIT | ONNX | w8a8 | Snapdragon® X2 Elite | 4.944 ms | 1 - 1 MB | NPU
99
- | VIT | ONNX | w8a8 | Snapdragon® X Elite | 10.979 ms | 86 - 86 MB | NPU
100
- | VIT | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.058 ms | 0 - 334 MB | NPU
101
- | VIT | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 14.661 ms | 0 - 342 MB | NPU
102
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 74.034 ms | 0 - 3 MB | NPU
103
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 10.181 ms | 0 - 4 MB | NPU
104
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.507 ms | 0 - 98 MB | NPU
105
- | VIT | ONNX | w8a8 | Qualcomm® QCS8450 | 14.661 ms | 0 - 342 MB | NPU
106
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.9 ms | 0 - 3 MB | NPU
107
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 10.979 ms | 86 - 86 MB | NPU
108
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 166.993 ms | 0 - 509 MB | NPU
109
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 18.871 ms | 0 - 336 MB | NPU
110
- | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 5.951 ms | 0 - 214 MB | NPU
111
- | VIT | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 5.951 ms | 0 - 214 MB | NPU
112
- | VIT | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.301 ms | 0 - 221 MB | NPU
113
- | VIT | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 18.871 ms | 0 - 336 MB | NPU
114
- | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 15.976 ms | 17 - 499 MB | NPU
115
- | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 1 Mobile | 31.408 ms | 13 - 481 MB | NPU
116
- | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-8275 | 24.238 ms | 16 - 19 MB | NPU
117
- | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 22.09 ms | 16 - 19 MB | NPU
118
- | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® QCS8450 | 31.408 ms | 13 - 481 MB | NPU
119
- | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-9075 | 26.202 ms | 20 - 22 MB | NPU
120
- | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 12.745 ms | 93 - 446 MB | NPU
121
- | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Mobile | 12.745 ms | 93 - 446 MB | NPU
122
- | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 10.123 ms | 18 - 386 MB | NPU
123
- | VIT | QNN_DLC | float | Snapdragon® X2 Elite | 5.73 ms | 1 - 1 MB | NPU
124
- | VIT | QNN_DLC | float | Snapdragon® X Elite | 12.692 ms | 1 - 1 MB | NPU
125
- | VIT | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.262 ms | 0 - 303 MB | NPU
126
- | VIT | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 15.564 ms | 0 - 303 MB | NPU
127
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 14.924 ms | 1 - 4 MB | NPU
128
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 42.297 ms | 1 - 168 MB | NPU
129
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 11.866 ms | 1 - 2 MB | NPU
130
- | VIT | QNN_DLC | float | Qualcomm® SA8775P | 14.651 ms | 1 - 169 MB | NPU
131
- | VIT | QNN_DLC | float | Qualcomm® SA8650P | 14.651 ms | 1 - 169 MB | NPU
132
- | VIT | QNN_DLC | float | Qualcomm® SA8255P | 14.651 ms | 1 - 169 MB | NPU
133
- | VIT | QNN_DLC | float | Qualcomm® QCS8450 | 15.564 ms | 0 - 303 MB | NPU
134
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 14.839 ms | 1 - 3 MB | NPU
135
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 12.692 ms | 1 - 1 MB | NPU
136
- | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.187 ms | 1 - 172 MB | NPU
137
- | VIT | QNN_DLC | float | Qualcomm® SA7255P | 42.297 ms | 1 - 168 MB | NPU
138
- | VIT | QNN_DLC | float | Qualcomm® SA8295P | 16.192 ms | 1 - 164 MB | NPU
139
- | VIT | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.187 ms | 1 - 172 MB | NPU
140
- | VIT | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.183 ms | 1 - 159 MB | NPU
141
- | VIT | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 9.168 ms | 0 - 0 MB | NPU
142
- | VIT | QNN_DLC | w8a16 | Snapdragon® X Elite | 13.315 ms | 0 - 0 MB | NPU
143
- | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 8.688 ms | 0 - 336 MB | NPU
144
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 11.821 ms | 0 - 3 MB | NPU
145
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 28.652 ms | 0 - 276 MB | NPU
146
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 12.404 ms | 0 - 2 MB | NPU
147
- | VIT | QNN_DLC | w8a16 | Qualcomm® SA8775P | 12.798 ms | 0 - 278 MB | NPU
148
- | VIT | QNN_DLC | w8a16 | Qualcomm® SA8650P | 12.798 ms | 0 - 278 MB | NPU
149
- | VIT | QNN_DLC | w8a16 | Qualcomm® SA8255P | 12.798 ms | 0 - 278 MB | NPU
150
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 12.627 ms | 2 - 4 MB | NPU
151
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 13.315 ms | 0 - 0 MB | NPU
152
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 122.065 ms | 0 - 477 MB | NPU
153
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 18.092 ms | 0 - 430 MB | NPU
154
- | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 6.315 ms | 0 - 277 MB | NPU
155
- | VIT | QNN_DLC | w8a16 | Qualcomm® SA7255P | 28.652 ms | 0 - 276 MB | NPU
156
- | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 6.315 ms | 0 - 277 MB | NPU
157
- | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 4.778 ms | 0 - 280 MB | NPU
158
- | VIT | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 18.092 ms | 0 - 430 MB | NPU
159
- | VIT | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 5.371 ms | 0 - 0 MB | NPU
160
- | VIT | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.302 ms | 0 - 0 MB | NPU
161
- | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.035 ms | 0 - 321 MB | NPU
162
- | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 15.37 ms | 0 - 333 MB | NPU
163
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 74.159 ms | 0 - 2 MB | NPU
164
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 10.163 ms | 0 - 3 MB | NPU
165
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 31.163 ms | 0 - 202 MB | NPU
166
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.613 ms | 0 - 2 MB | NPU
167
- | VIT | QNN_DLC | w8a8 | Qualcomm® SA8775P | 10.352 ms | 0 - 201 MB | NPU
168
- | VIT | QNN_DLC | w8a8 | Qualcomm® SA8650P | 10.352 ms | 0 - 201 MB | NPU
169
- | VIT | QNN_DLC | w8a8 | Qualcomm® SA8255P | 10.352 ms | 0 - 201 MB | NPU
170
- | VIT | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 15.37 ms | 0 - 333 MB | NPU
171
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 10.043 ms | 0 - 2 MB | NPU
172
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.302 ms | 0 - 0 MB | NPU
173
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 259.059 ms | 0 - 508 MB | NPU
174
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 18.558 ms | 0 - 331 MB | NPU
175
- | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 6.012 ms | 0 - 203 MB | NPU
176
- | VIT | QNN_DLC | w8a8 | Qualcomm® SA7255P | 31.163 ms | 0 - 202 MB | NPU
177
- | VIT | QNN_DLC | w8a8 | Qualcomm® SA8295P | 17.412 ms | 0 - 211 MB | NPU
178
- | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 6.012 ms | 0 - 203 MB | NPU
179
- | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.342 ms | 0 - 209 MB | NPU
180
- | VIT | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 18.558 ms | 0 - 331 MB | NPU
181
- | VIT | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.802 ms | 0 - 296 MB | NPU
182
- | VIT | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 15.181 ms | 0 - 300 MB | NPU
183
- | VIT | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 13.011 ms | 0 - 173 MB | NPU
184
- | VIT | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 38.525 ms | 0 - 169 MB | NPU
185
- | VIT | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.335 ms | 0 - 2 MB | NPU
186
- | VIT | TFLITE | float | Qualcomm® SA8775P | 12.566 ms | 0 - 169 MB | NPU
187
- | VIT | TFLITE | float | Qualcomm® SA8650P | 12.566 ms | 0 - 169 MB | NPU
188
- | VIT | TFLITE | float | Qualcomm® SA8255P | 12.566 ms | 0 - 169 MB | NPU
189
- | VIT | TFLITE | float | Qualcomm® QCS8450 | 15.181 ms | 0 - 300 MB | NPU
190
- | VIT | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 12.543 ms | 0 - 173 MB | NPU
191
- | VIT | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 4.84 ms | 0 - 178 MB | NPU
192
- | VIT | TFLITE | float | Qualcomm® SA7255P | 38.525 ms | 0 - 169 MB | NPU
193
- | VIT | TFLITE | float | Qualcomm® SA8295P | 15.709 ms | 0 - 163 MB | NPU
194
- | VIT | TFLITE | float | Snapdragon® 8 Elite Mobile | 4.84 ms | 0 - 178 MB | NPU
195
- | VIT | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.742 ms | 0 - 166 MB | NPU
196
- | VIT | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.526 ms | 0 - 477 MB | NPU
197
- | VIT | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 21.586 ms | 0 - 467 MB | NPU
198
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 140.58 ms | 1 - 100 MB | NPU
199
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 13.606 ms | 0 - 87 MB | NPU
200
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 37.357 ms | 0 - 341 MB | NPU
201
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 13.765 ms | 0 - 2 MB | NPU
202
- | VIT | TFLITE | w8a8 | Qualcomm® SA8775P | 13.786 ms | 0 - 342 MB | NPU
203
- | VIT | TFLITE | w8a8 | Qualcomm® SA8650P | 13.786 ms | 0 - 342 MB | NPU
204
- | VIT | TFLITE | w8a8 | Qualcomm® SA8255P | 13.786 ms | 0 - 342 MB | NPU
205
- | VIT | TFLITE | w8a8 | Qualcomm® QCS8450 | 21.586 ms | 0 - 467 MB | NPU
206
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 13.915 ms | 0 - 87 MB | NPU
207
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 201.664 ms | 2 - 259 MB | NPU
208
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 30.919 ms | 1 - 187 MB | NPU
209
- | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 7.781 ms | 0 - 333 MB | NPU
210
- | VIT | TFLITE | w8a8 | Qualcomm® SA7255P | 37.357 ms | 0 - 341 MB | NPU
211
- | VIT | TFLITE | w8a8 | Qualcomm® SA8295P | 21.436 ms | 0 - 333 MB | NPU
212
- | VIT | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 7.781 ms | 0 - 333 MB | NPU
213
- | VIT | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.511 ms | 0 - 351 MB | NPU
214
- | VIT | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.919 ms | 1 - 187 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
215
 
216
  ## License
217
  * The license for the original implementation of VIT can be found
 
15
  VIT is a machine learning model that can classify images from the Imagenet dataset. It can also be used as a backbone in building more complex models for specific use cases.
16
 
17
  This is based on the implementation of VIT found [here](https://github.com/pytorch/vision/blob/main/torchvision/models/vision_transformer.py).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/vit) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-float.zip)
32
+ | ONNX | w8a16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a16.zip)
33
+ | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a8.zip)
34
+ | ONNX | w8a8_mixed_int16 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a8_mixed_int16.zip)
35
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-float.zip)
36
+ | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a16.zip)
37
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a8.zip)
38
+ | QNN_DLC | w8a8_mixed_int16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a8_mixed_int16.zip)
39
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-tflite-float.zip)
40
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-tflite-w8a8.zip)
41
 
42
  For more device-specific assets and performance metrics, visit **[VIT on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/vit)**.
43
 
44
 
45
  ### Option 2: Export with Custom Configurations
46
 
47
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/vit) Python library to compile and export the model with your own:
48
  - Custom weights (e.g., fine-tuned checkpoints)
49
  - Custom input shapes
50
  - Target device and runtime configurations
51
 
52
  This option is ideal if you need to customize the model beyond the default configuration provided here.
53
 
54
+ See our repository for [VIT on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/vit) for usage instructions.
55
 
56
  ## Model Details
57
 
 
68
  ## Performance Summary
69
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
70
  |---|---|---|---|---|---|---
71
+ | VIT | ONNX | float | Snapdragon® X2 Elite | 3.86 ms | 2 - 2 MB | NPU
72
+ | VIT | ONNX | float | Snapdragon® X Elite | 9.709 ms | 170 - 170 MB | NPU
73
+ | VIT | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 6.469 ms | 0 - 300 MB | NPU
74
+ | VIT | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 14.097 ms | 0 - 297 MB | NPU
75
+ | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 12.78 ms | 0 - 4 MB | NPU
76
+ | VIT | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.245 ms | 0 - 193 MB | NPU
77
+ | VIT | ONNX | float | Qualcomm® QCS8450 | 14.097 ms | 0 - 297 MB | NPU
78
+ | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 11.949 ms | 1 - 4 MB | NPU
79
+ | VIT | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 9.709 ms | 170 - 170 MB | NPU
80
+ | VIT | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.592 ms | 0 - 170 MB | NPU
81
+ | VIT | ONNX | float | Snapdragon® 8 Elite Mobile | 4.592 ms | 0 - 170 MB | NPU
82
+ | VIT | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.544 ms | 0 - 158 MB | NPU
83
  | VIT | ONNX | w8a16 | Snapdragon® X2 Elite | 3.572 ms | 1 - 1 MB | NPU
84
+ | VIT | ONNX | w8a16 | Snapdragon® X Elite | 8.19 ms | 86 - 86 MB | NPU
85
+ | VIT | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 5.343 ms | 0 - 320 MB | NPU
86
+ | VIT | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 9.332 ms | 0 - 322 MB | NPU
87
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 38.497 ms | 0 - 3 MB | NPU
88
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 7.445 ms | 0 - 4 MB | NPU
89
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.795 ms | 0 - 3 MB | NPU
90
+ | VIT | ONNX | w8a16 | Qualcomm® QCS8450 | 9.332 ms | 0 - 322 MB | NPU
91
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 7.927 ms | 0 - 3 MB | NPU
92
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 8.19 ms | 86 - 86 MB | NPU
93
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 112.719 ms | 0 - 464 MB | NPU
94
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 9.696 ms | 0 - 403 MB | NPU
95
+ | VIT | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 4.081 ms | 0 - 263 MB | NPU
96
+ | VIT | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 4.081 ms | 0 - 263 MB | NPU
97
+ | VIT | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.091 ms | 0 - 267 MB | NPU
98
+ | VIT | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 9.696 ms | 0 - 403 MB | NPU
99
+ | VIT | ONNX | w8a8 | Snapdragon® X2 Elite | 15.354 ms | 1 - 1 MB | NPU
100
+ | VIT | ONNX | w8a8 | Snapdragon® X Elite | 10.946 ms | 86 - 86 MB | NPU
101
+ | VIT | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.055 ms | 0 - 335 MB | NPU
102
+ | VIT | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 14.568 ms | 0 - 342 MB | NPU
103
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 74.031 ms | 0 - 3 MB | NPU
104
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 10.17 ms | 0 - 4 MB | NPU
105
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.468 ms | 0 - 98 MB | NPU
106
+ | VIT | ONNX | w8a8 | Qualcomm® QCS8450 | 14.568 ms | 0 - 342 MB | NPU
107
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 9.903 ms | 0 - 3 MB | NPU
108
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 10.946 ms | 86 - 86 MB | NPU
109
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 212.002 ms | 0 - 505 MB | NPU
110
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 18.888 ms | 0 - 338 MB | NPU
111
+ | VIT | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 5.957 ms | 0 - 211 MB | NPU
112
+ | VIT | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 5.957 ms | 0 - 211 MB | NPU
113
+ | VIT | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.297 ms | 0 - 220 MB | NPU
114
+ | VIT | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 18.888 ms | 0 - 338 MB | NPU
115
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® X2 Elite | 10.713 ms | 22 - 22 MB | NPU
116
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® X Elite | 19.714 ms | 83 - 83 MB | NPU
117
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 14.923 ms | 16 - 518 MB | NPU
118
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Gen 1 Mobile | 31.574 ms | 16 - 485 MB | NPU
119
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-8275 | 22.533 ms | 14 - 17 MB | NPU
120
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 20.342 ms | 14 - 18 MB | NPU
121
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® QCS8450 | 31.574 ms | 16 - 485 MB | NPU
122
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-9075 | 22.113 ms | 16 - 18 MB | NPU
123
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-X7181 | 19.714 ms | 83 - 83 MB | NPU
124
+ | VIT | ONNX | w8a8_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 11.764 ms | 16 - 386 MB | NPU
125
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Mobile | 11.764 ms | 16 - 386 MB | NPU
126
+ | VIT | ONNX | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 9.625 ms | 16 - 399 MB | NPU
127
+ | VIT | QNN_DLC | float | Snapdragon® X2 Elite | 6.978 ms | 1 - 1 MB | NPU
128
+ | VIT | QNN_DLC | float | Snapdragon® X Elite | 12.669 ms | 1 - 1 MB | NPU
129
+ | VIT | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.268 ms | 0 - 303 MB | NPU
130
+ | VIT | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 15.455 ms | 0 - 303 MB | NPU
131
+ | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 14.939 ms | 1 - 4 MB | NPU
132
+ | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 11.846 ms | 1 - 2 MB | NPU
133
+ | VIT | QNN_DLC | float | Qualcomm® SA8775P | 14.649 ms | 1 - 169 MB | NPU
134
+ | VIT | QNN_DLC | float | Qualcomm® SA8650P | 14.649 ms | 1 - 169 MB | NPU
135
+ | VIT | QNN_DLC | float | Qualcomm® SA8255P | 14.649 ms | 1 - 169 MB | NPU
136
+ | VIT | QNN_DLC | float | Qualcomm® QCS8450 | 15.455 ms | 0 - 303 MB | NPU
137
+ | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 14.892 ms | 1 - 3 MB | NPU
138
+ | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 12.669 ms | 1 - 1 MB | NPU
139
+ | VIT | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.204 ms | 1 - 173 MB | NPU
140
+ | VIT | QNN_DLC | float | Qualcomm® SA7255P | 42.295 ms | 1 - 168 MB | NPU
141
+ | VIT | QNN_DLC | float | Qualcomm® SA8295P | 16.197 ms | 1 - 164 MB | NPU
142
+ | VIT | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.204 ms | 1 - 173 MB | NPU
143
+ | VIT | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.178 ms | 1 - 158 MB | NPU
144
+ | VIT | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 5.744 ms | 0 - 0 MB | NPU
145
+ | VIT | QNN_DLC | w8a16 | Snapdragon® X Elite | 13.235 ms | 0 - 0 MB | NPU
146
+ | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 8.698 ms | 0 - 338 MB | NPU
147
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 11.779 ms | 0 - 3 MB | NPU
148
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 12.392 ms | 0 - 2 MB | NPU
149
+ | VIT | QNN_DLC | w8a16 | Qualcomm® SA8775P | 12.776 ms | 0 - 277 MB | NPU
150
+ | VIT | QNN_DLC | w8a16 | Qualcomm® SA8650P | 12.776 ms | 0 - 277 MB | NPU
151
+ | VIT | QNN_DLC | w8a16 | Qualcomm® SA8255P | 12.776 ms | 0 - 277 MB | NPU
152
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 12.858 ms | 0 - 2 MB | NPU
153
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 13.235 ms | 0 - 0 MB | NPU
154
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 154.402 ms | 0 - 477 MB | NPU
155
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 18.368 ms | 0 - 429 MB | NPU
156
+ | VIT | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 6.319 ms | 0 - 277 MB | NPU
157
+ | VIT | QNN_DLC | w8a16 | Qualcomm® SA7255P | 28.685 ms | 0 - 276 MB | NPU
158
+ | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 6.319 ms | 0 - 277 MB | NPU
159
+ | VIT | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 4.782 ms | 0 - 281 MB | NPU
160
+ | VIT | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 18.368 ms | 0 - 429 MB | NPU
161
+ | VIT | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 5.366 ms | 0 - 0 MB | NPU
162
+ | VIT | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.333 ms | 0 - 0 MB | NPU
163
+ | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.075 ms | 0 - 323 MB | NPU
164
+ | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 14.532 ms | 0 - 333 MB | NPU
165
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 74.196 ms | 0 - 2 MB | NPU
166
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 10.161 ms | 0 - 3 MB | NPU
167
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.585 ms | 0 - 2 MB | NPU
168
+ | VIT | QNN_DLC | w8a8 | Qualcomm® SA8775P | 10.361 ms | 0 - 201 MB | NPU
169
+ | VIT | QNN_DLC | w8a8 | Qualcomm® SA8650P | 10.361 ms | 0 - 201 MB | NPU
170
+ | VIT | QNN_DLC | w8a8 | Qualcomm® SA8255P | 10.361 ms | 0 - 201 MB | NPU
171
+ | VIT | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 14.532 ms | 0 - 333 MB | NPU
172
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 10.035 ms | 0 - 2 MB | NPU
173
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 11.333 ms | 0 - 0 MB | NPU
174
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 265.268 ms | 0 - 512 MB | NPU
175
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 18.618 ms | 0 - 332 MB | NPU
176
+ | VIT | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 6.068 ms | 0 - 203 MB | NPU
177
+ | VIT | QNN_DLC | w8a8 | Qualcomm® SA7255P | 31.183 ms | 0 - 202 MB | NPU
178
+ | VIT | QNN_DLC | w8a8 | Qualcomm® SA8295P | 17.423 ms | 0 - 211 MB | NPU
179
+ | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 6.068 ms | 0 - 203 MB | NPU
180
+ | VIT | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.334 ms | 0 - 210 MB | NPU
181
+ | VIT | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 18.618 ms | 0 - 332 MB | NPU
182
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® X2 Elite | 5.571 ms | 0 - 0 MB | NPU
183
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® X Elite | 12.75 ms | 1 - 1 MB | NPU
184
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® 8 Gen 3 Mobile | 8.139 ms | 0 - 478 MB | NPU
185
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-8275 | 11.452 ms | 0 - 3 MB | NPU
186
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 12.059 ms | 0 - 258 MB | NPU
187
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® SA8775P | 11.521 ms | 0 - 349 MB | NPU
188
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® SA8650P | 11.521 ms | 0 - 349 MB | NPU
189
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® SA8255P | 11.521 ms | 0 - 349 MB | NPU
190
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-9075 | 11.292 ms | 2 - 4 MB | NPU
191
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ IQ-X7181 | 12.75 ms | 1 - 1 MB | NPU
192
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ Q-6690 | 220.717 ms | 0 - 538 MB | NPU
193
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ Q-7790 | 19.558 ms | 0 - 372 MB | NPU
194
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® Dragonwing™ Q-8750 | 6.723 ms | 0 - 347 MB | NPU
195
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Qualcomm® SA7255P | 32.512 ms | 0 - 348 MB | NPU
196
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® 8 Elite Mobile | 6.723 ms | 0 - 347 MB | NPU
197
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® 8 Elite Gen 5 Mobile | 4.717 ms | 0 - 343 MB | NPU
198
+ | VIT | QNN_DLC | w8a8_mixed_int16 | Snapdragon® 7 Gen 4 Mobile | 19.558 ms | 0 - 372 MB | NPU
199
+ | VIT | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.802 ms | 0 - 308 MB | NPU
200
+ | VIT | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 15.279 ms | 0 - 298 MB | NPU
201
+ | VIT | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 13.271 ms | 0 - 173 MB | NPU
202
+ | VIT | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.325 ms | 0 - 2 MB | NPU
203
+ | VIT | TFLITE | float | Qualcomm® SA8775P | 12.577 ms | 0 - 170 MB | NPU
204
+ | VIT | TFLITE | float | Qualcomm® SA8650P | 12.577 ms | 0 - 170 MB | NPU
205
+ | VIT | TFLITE | float | Qualcomm® SA8255P | 12.577 ms | 0 - 170 MB | NPU
206
+ | VIT | TFLITE | float | Qualcomm® QCS8450 | 15.279 ms | 0 - 298 MB | NPU
207
+ | VIT | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 12.595 ms | 0 - 173 MB | NPU
208
+ | VIT | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 4.871 ms | 0 - 180 MB | NPU
209
+ | VIT | TFLITE | float | Qualcomm® SA7255P | 38.55 ms | 0 - 169 MB | NPU
210
+ | VIT | TFLITE | float | Qualcomm® SA8295P | 15.705 ms | 0 - 164 MB | NPU
211
+ | VIT | TFLITE | float | Snapdragon® 8 Elite Mobile | 4.871 ms | 0 - 180 MB | NPU
212
+ | VIT | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.741 ms | 0 - 166 MB | NPU
213
+ | VIT | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.524 ms | 0 - 473 MB | NPU
214
+ | VIT | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 21.784 ms | 0 - 464 MB | NPU
215
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 136.865 ms | 1 - 100 MB | NPU
216
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 13.742 ms | 0 - 87 MB | NPU
217
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 13.793 ms | 0 - 2 MB | NPU
218
+ | VIT | TFLITE | w8a8 | Qualcomm® SA8775P | 13.761 ms | 0 - 342 MB | NPU
219
+ | VIT | TFLITE | w8a8 | Qualcomm® SA8650P | 13.761 ms | 0 - 342 MB | NPU
220
+ | VIT | TFLITE | w8a8 | Qualcomm® SA8255P | 13.761 ms | 0 - 342 MB | NPU
221
+ | VIT | TFLITE | w8a8 | Qualcomm® QCS8450 | 21.784 ms | 0 - 464 MB | NPU
222
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 13.65 ms | 0 - 87 MB | NPU
223
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 202.274 ms | 1 - 259 MB | NPU
224
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 30.833 ms | 1 - 188 MB | NPU
225
+ | VIT | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 7.775 ms | 0 - 341 MB | NPU
226
+ | VIT | TFLITE | w8a8 | Qualcomm® SA7255P | 37.333 ms | 0 - 341 MB | NPU
227
+ | VIT | TFLITE | w8a8 | Qualcomm® SA8295P | 21.362 ms | 0 - 333 MB | NPU
228
+ | VIT | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 7.775 ms | 0 - 341 MB | NPU
229
+ | VIT | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.553 ms | 0 - 349 MB | NPU
230
+ | VIT | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.833 ms | 1 - 188 MB | NPU
231
 
232
  ## License
233
  * The license for the original implementation of VIT can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.61.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -8,19 +8,19 @@
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-tflite-float.zip"
24
  }
25
  }
26
  },
@@ -31,13 +31,13 @@
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a16.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-w8a16.zip"
41
  }
42
  }
43
  },
@@ -48,19 +48,19 @@
48
  "qairt": "2.45.0.260326154327",
49
  "onnx_runtime": "1.27.1"
50
  },
51
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a8.zip"
52
  },
53
  "qnn_dlc": {
54
  "tool_versions": {
55
  "qairt": "2.45.0.260326154327"
56
  },
57
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-qnn_dlc-w8a8.zip"
58
  },
59
  "tflite": {
60
  "tool_versions": {
61
  "qairt": "2.45.0.260326154327"
62
  },
63
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-tflite-w8a8.zip"
64
  }
65
  }
66
  },
@@ -71,7 +71,13 @@
71
  "qairt": "2.45.0.260326154327",
72
  "onnx_runtime": "1.27.1"
73
  },
74
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.61.0/vit-onnx-w8a8_mixed_int16.zip"
 
 
 
 
 
 
75
  }
76
  }
77
  }
 
1
  {
2
+ "version": "0.62.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-tflite-float.zip"
24
  }
25
  }
26
  },
 
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a16.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a16.zip"
41
  }
42
  }
43
  },
 
48
  "qairt": "2.45.0.260326154327",
49
  "onnx_runtime": "1.27.1"
50
  },
51
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a8.zip"
52
  },
53
  "qnn_dlc": {
54
  "tool_versions": {
55
  "qairt": "2.45.0.260326154327"
56
  },
57
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a8.zip"
58
  },
59
  "tflite": {
60
  "tool_versions": {
61
  "qairt": "2.45.0.260326154327"
62
  },
63
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-tflite-w8a8.zip"
64
  }
65
  }
66
  },
 
71
  "qairt": "2.45.0.260326154327",
72
  "onnx_runtime": "1.27.1"
73
  },
74
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-onnx-w8a8_mixed_int16.zip"
75
+ },
76
+ "qnn_dlc": {
77
+ "tool_versions": {
78
+ "qairt": "2.45.0.260326154327"
79
+ },
80
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/vit/releases/v0.62.0/vit-qnn_dlc-w8a8_mixed_int16.zip"
81
  }
82
  }
83
  }