qaihm-bot commited on
Commit
f5a8753
·
verified ·
1 Parent(s): 05be37e

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

README.md CHANGED
@@ -38,94 +38,101 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | VIT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 37.327 ms | 0 - 304 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
42
- | VIT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 40.725 ms | 0 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
43
- | VIT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 13.034 ms | 0 - 317 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
44
- | VIT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 19.296 ms | 1 - 303 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
45
- | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 8.93 ms | 0 - 14 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
46
- | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 11.473 ms | 0 - 24 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
47
- | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 13.27 ms | 1 - 28 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
48
- | VIT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 11.819 ms | 0 - 304 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
49
- | VIT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 14.398 ms | 1 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
50
- | VIT | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 37.327 ms | 0 - 304 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
51
- | VIT | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 40.725 ms | 0 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
52
- | VIT | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 8.592 ms | 0 - 19 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
53
- | VIT | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 11.459 ms | 0 - 21 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
54
- | VIT | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 14.687 ms | 0 - 306 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
55
- | VIT | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 17.28 ms | 1 - 306 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
56
- | VIT | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 8.556 ms | 0 - 27 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
57
- | VIT | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 11.473 ms | 0 - 22 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
58
- | VIT | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 11.819 ms | 0 - 304 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
59
- | VIT | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 14.398 ms | 1 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
60
- | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 6.272 ms | 0 - 310 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
61
- | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 8.04 ms | 1 - 313 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
62
- | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 9.08 ms | 0 - 331 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
63
- | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.443 ms | 0 - 308 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
64
- | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.671 ms | 1 - 313 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
65
- | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 6.364 ms | 1 - 325 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
66
- | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.795 ms | 0 - 308 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
67
- | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 4.348 ms | 1 - 304 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
68
- | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 4.856 ms | 1 - 317 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
69
- | VIT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 12.189 ms | 1126 - 1126 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
70
- | VIT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 13.866 ms | 171 - 171 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
71
- | VIT | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 69.629 ms | 0 - 195 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
72
- | VIT | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 26.732 ms | 3 - 47 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
73
- | VIT | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 314.345 ms | 32 - 121 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
74
- | VIT | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 24.548 ms | 0 - 188 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
75
- | VIT | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 524.615 ms | 82 - 100 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
76
- | VIT | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 548.251 ms | 84 - 100 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
77
- | VIT | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 69.629 ms | 0 - 195 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
78
- | VIT | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 26.687 ms | 0 - 44 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
79
- | VIT | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 26.727 ms | 0 - 46 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
80
- | VIT | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 24.548 ms | 0 - 188 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
81
- | VIT | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 20.318 ms | 0 - 200 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
82
- | VIT | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 266.191 ms | 55 - 92 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
83
- | VIT | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 15.988 ms | 0 - 190 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
84
- | VIT | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 230.044 ms | 55 - 95 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
85
- | VIT | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 12.942 ms | 0 - 194 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
86
- | VIT | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 204.577 ms | 53 - 96 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
87
- | VIT | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 26.526 ms | 309 - 309 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
88
- | VIT | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 169.231 ms | 62 - 62 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
89
- | VIT | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 15.527 ms | 0 - 46 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
90
- | VIT | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 29.908 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
91
- | VIT | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.157 ms | 0 - 54 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
92
- | VIT | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 13.244 ms | 0 - 268 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
93
- | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.441 ms | 0 - 22 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
94
- | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.195 ms | 0 - 23 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
95
- | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 288.901 ms | 32 - 121 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
96
- | VIT | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 35.33 ms | 0 - 46 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
97
- | VIT | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 9.538 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
98
- | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 89.098 ms | 2 - 45 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
99
- | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 77.03 ms | 0 - 656 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
100
- | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 434.397 ms | 66 - 83 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
101
- | VIT | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 482.665 ms | 72 - 84 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
102
- | VIT | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 15.527 ms | 0 - 46 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
103
- | VIT | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 29.908 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
104
- | VIT | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.515 ms | 0 - 105 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
105
- | VIT | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.218 ms | 0 - 22 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
106
- | VIT | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.774 ms | 0 - 48 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
107
- | VIT | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 16.411 ms | 0 - 164 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
108
- | VIT | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.444 ms | 0 - 25 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
109
- | VIT | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.233 ms | 0 - 23 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
110
- | VIT | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 35.33 ms | 0 - 46 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
111
- | VIT | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 9.538 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
112
- | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.252 ms | 0 - 52 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
113
- | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.003 ms | 0 - 156 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
114
- | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 253.388 ms | 56 - 94 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
115
- | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.102 ms | 0 - 53 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
116
- | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.886 ms | 0 - 151 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
117
- | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 207.142 ms | 56 - 95 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
118
- | VIT | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.471 ms | 0 - 54 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
119
- | VIT | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 3.782 ms | 0 - 257 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
120
- | VIT | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 10.763 ms | 433 - 433 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
121
- | VIT | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 183.277 ms | 60 - 60 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
122
- | VIT | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 355.411 ms | 43 - 147 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
123
- | VIT | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 456.562 ms | 86 - 105 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
124
- | VIT | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 460.802 ms | 86 - 104 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
125
- | VIT | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 294.86 ms | 79 - 122 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
126
- | VIT | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 254.105 ms | 78 - 120 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
127
- | VIT | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 240.281 ms | 79 - 122 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
128
- | VIT | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 347.308 ms | 130 - 130 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
 
 
 
 
 
 
 
129
 
130
 
131
 
@@ -139,9 +146,9 @@ pip install qai-hub-models
139
  ```
140
 
141
 
142
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
143
 
144
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
145
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
146
 
147
  With this API token, you can configure your client to run models on the cloud
@@ -149,7 +156,7 @@ hosted devices.
149
  ```bash
150
  qai-hub configure --api_token API_TOKEN
151
  ```
152
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
153
 
154
 
155
 
@@ -260,7 +267,7 @@ With the output of the model, you can compute like PSNR, relative errors or
260
  spot check the output with expected output.
261
 
262
  **Note**: This on-device profiling and inference requires access to Qualcomm®
263
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
264
 
265
 
266
 
 
38
 
39
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | VIT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 36.645 ms | 0 - 300 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
42
+ | VIT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 40.171 ms | 1 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
43
+ | VIT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.467 ms | 0 - 310 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
44
+ | VIT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 19.979 ms | 0 - 312 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
45
+ | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 8.494 ms | 0 - 19 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
46
+ | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.929 ms | 0 - 27 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
47
+ | VIT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 13.374 ms | 0 - 26 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
48
+ | VIT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 11.344 ms | 0 - 301 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
49
+ | VIT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 13.943 ms | 0 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
50
+ | VIT | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 36.645 ms | 0 - 300 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
51
+ | VIT | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 40.171 ms | 1 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
52
+ | VIT | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 8.479 ms | 0 - 28 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
53
+ | VIT | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 11.181 ms | 0 - 26 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
54
+ | VIT | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 14.229 ms | 0 - 302 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
55
+ | VIT | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 17.096 ms | 1 - 307 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
56
+ | VIT | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 8.116 ms | 0 - 60 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
57
+ | VIT | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 11.219 ms | 0 - 22 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
58
+ | VIT | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 11.344 ms | 0 - 301 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
59
+ | VIT | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 13.943 ms | 0 - 302 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
60
+ | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.988 ms | 0 - 307 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
61
+ | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.741 ms | 1 - 310 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
62
+ | VIT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 9.113 ms | 0 - 326 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
63
+ | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.142 ms | 0 - 305 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
64
+ | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.549 ms | 0 - 308 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
65
+ | VIT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 6.403 ms | 1 - 325 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
66
+ | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.642 ms | 0 - 303 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT.tflite) |
67
+ | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 4.232 ms | 1 - 305 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
68
+ | VIT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 4.862 ms | 1 - 318 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
69
+ | VIT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 11.88 ms | 1100 - 1100 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT.dlc) |
70
+ | VIT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 13.885 ms | 171 - 171 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT.onnx.zip) |
71
+ | VIT | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 70.308 ms | 0 - 194 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
72
+ | VIT | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 27.051 ms | 0 - 45 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
73
+ | VIT | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 304.034 ms | 30 - 122 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
74
+ | VIT | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 24.559 ms | 0 - 189 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
75
+ | VIT | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 525.765 ms | 85 - 102 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
76
+ | VIT | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 567.411 ms | 87 - 102 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
77
+ | VIT | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 70.308 ms | 0 - 194 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
78
+ | VIT | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 26.91 ms | 0 - 46 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
79
+ | VIT | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 26.873 ms | 0 - 44 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
80
+ | VIT | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 24.559 ms | 0 - 189 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
81
+ | VIT | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 19.879 ms | 0 - 204 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
82
+ | VIT | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 260.409 ms | 53 - 91 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
83
+ | VIT | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 15.874 ms | 0 - 191 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
84
+ | VIT | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 297.138 ms | 55 - 95 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
85
+ | VIT | w8a16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 43.457 ms | 0 - 255 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
86
+ | VIT | w8a16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 595.119 ms | 66 - 82 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
87
+ | VIT | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 12.888 ms | 0 - 195 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
88
+ | VIT | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 198.485 ms | 53 - 97 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
89
+ | VIT | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 27.131 ms | 277 - 277 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.dlc) |
90
+ | VIT | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 159.494 ms | 63 - 63 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a16.onnx.zip) |
91
+ | VIT | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 15.551 ms | 0 - 48 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
92
+ | VIT | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 29.907 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
93
+ | VIT | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.11 ms | 0 - 60 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
94
+ | VIT | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 13.198 ms | 0 - 267 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
95
+ | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.428 ms | 0 - 20 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
96
+ | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 9.673 ms | 0 - 23 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
97
+ | VIT | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 307.251 ms | 31 - 121 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
98
+ | VIT | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 7.844 ms | 0 - 47 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
99
+ | VIT | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 9.511 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
100
+ | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 61.128 ms | 2 - 47 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
101
+ | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 77.949 ms | 0 - 661 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
102
+ | VIT | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 438.387 ms | 68 - 86 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
103
+ | VIT | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 493.483 ms | 73 - 85 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
104
+ | VIT | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 15.551 ms | 0 - 48 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
105
+ | VIT | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 29.907 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
106
+ | VIT | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.42 ms | 0 - 19 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
107
+ | VIT | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 10.22 ms | 0 - 24 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
108
+ | VIT | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.768 ms | 0 - 49 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
109
+ | VIT | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 16.394 ms | 0 - 165 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
110
+ | VIT | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.449 ms | 0 - 21 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
111
+ | VIT | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 10.202 ms | 0 - 22 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
112
+ | VIT | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 7.844 ms | 0 - 47 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
113
+ | VIT | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 9.511 ms | 0 - 150 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
114
+ | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.252 ms | 0 - 57 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
115
+ | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 6.907 ms | 0 - 156 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
116
+ | VIT | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 249.531 ms | 52 - 91 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
117
+ | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 4.078 ms | 0 - 54 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
118
+ | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 5.792 ms | 0 - 153 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
119
+ | VIT | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 205.336 ms | 57 - 95 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
120
+ | VIT | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 22.784 ms | 1 - 33 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
121
+ | VIT | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 18.157 ms | 0 - 170 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
122
+ | VIT | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 483.82 ms | 66 - 84 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
123
+ | VIT | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 3.46 ms | 0 - 55 MB | NPU | [VIT.tflite](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.tflite) |
124
+ | VIT | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 3.782 ms | 0 - 258 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
125
+ | VIT | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 194.367 ms | 52 - 95 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
126
+ | VIT | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 10.809 ms | 439 - 439 MB | NPU | [VIT.dlc](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.dlc) |
127
+ | VIT | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 178.816 ms | 60 - 60 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8.onnx.zip) |
128
+ | VIT | w8a8_mixed_int16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 371.606 ms | 43 - 152 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
129
+ | VIT | w8a8_mixed_int16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 533.886 ms | 72 - 91 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
130
+ | VIT | w8a8_mixed_int16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 515.386 ms | 86 - 106 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
131
+ | VIT | w8a8_mixed_int16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 306.677 ms | 78 - 119 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
132
+ | VIT | w8a8_mixed_int16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 303.831 ms | 78 - 118 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
133
+ | VIT | w8a8_mixed_int16 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 508.832 ms | 91 - 110 MB | CPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
134
+ | VIT | w8a8_mixed_int16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 242.334 ms | 79 - 122 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
135
+ | VIT | w8a8_mixed_int16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 320.981 ms | 133 - 133 MB | NPU | [VIT.onnx.zip](https://huggingface.co/qualcomm/VIT/blob/main/VIT_w8a8_mixed_int16.onnx.zip) |
136
 
137
 
138
 
 
146
  ```
147
 
148
 
149
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
150
 
151
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
152
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
153
 
154
  With this API token, you can configure your client to run models on the cloud
 
156
  ```bash
157
  qai-hub configure --api_token API_TOKEN
158
  ```
159
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
160
 
161
 
162
 
 
267
  spot check the output with expected output.
268
 
269
  **Note**: This on-device profiling and inference requires access to Qualcomm®
270
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
271
 
272
 
273
 
VIT_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d83346d3f434dfe8a6e17b0155f0b1ee648001d54270949087b5d169bd041b2
3
- size 347073372
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:995694da2288c89f64fa2f86761b59e89a8fa30e92b9a8f2caaf47b01a0d4312
3
+ size 347073500
VIT_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:56bc12feb487509d7c5d4a7e22a32add1cb03aa35c374203523710872c22e6f4
3
- size 322933372
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd96ff1be0f782a78539f52e3c256891f9ee2f19bc6854302313e951d88e631b
3
+ size 322932407
VIT_w8a16.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f2f6d6bb4e94f228d5bf053d0d8bdde5d965931ce63625d1874291b192341762
3
- size 90210716
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f9b9d85d6002dfbeeaa3684ac7f61609018c07005c129d02342b6023247c736
3
+ size 90210844
VIT_w8a16.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b165bf6219e73271211ea61daf0f13e25518a9f4bb4a5629dc32259e22b33e2
3
- size 304721545
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af4596649ec089edffb867b032faa4c250d0fa23382b44c78794ca01484f3a7e
3
+ size 304725252
VIT_w8a8.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3c76135e2b75e02b1bb03addd044db4caa1d805ee16c835ed050fd954cee2e1
3
- size 90030996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5140cbaebd23953dc09ca746dd2e5a6181f68fb5326a938834c9940e0d562b80
3
+ size 90031124
VIT_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6508d9761a65e1f01c513d3d1e14af7a48b2bea80254fa6e130eadb591641eff
3
- size 304808220
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92b43a1ce607101f5f55f056ef7c8ba43ee6d3ee8c985cc73c5dcb073e1282d5
3
+ size 304810263
VIT_w8a8.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0f8ce1b132e81bd9ae3b8036bd4c9e9a7d14863655c0dc5f2a517bdca3d48d2a
3
  size 87210560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0db3e06b1bfaaa453b6ab3adad95e9ba84bb1d6ff0d88f9b9b8fb2d8227b38c4
3
  size 87210560
VIT_w8a8_mixed_int16.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2d4e92b84a0dac9de2c8a654a35758675cef8cdff932ea31f4e12585d3c6a30d
3
- size 307377883
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08b39e67b955e445972a61da6d78cebcd467fa5577a6c8b432c3771d90c89455
3
+ size 307378810