qaihm-bot commited on
Commit
8a548a8
·
verified ·
1 Parent(s): b41945e

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (5) hide show
  1. README.md +72 -69
  2. XLSR_float.dlc +2 -2
  3. XLSR_float.onnx.zip +1 -1
  4. XLSR_w8a8.dlc +0 -0
  5. XLSR_w8a8.onnx.zip +1 -1
README.md CHANGED
@@ -36,71 +36,74 @@ More details on model performance across various devices, can be found
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
- | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.924 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
40
- | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.147 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
41
- | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.493 ms | 3 - 33 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
42
- | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.059 ms | 0 - 29 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
43
- | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.302 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
44
- | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.765 ms | 0 - 6 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
45
- | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.173 ms | 0 - 8 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
46
- | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.769 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
- | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.144 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
48
- | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.924 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
- | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.147 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
50
- | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.302 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
- | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.766 ms | 0 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
52
- | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.163 ms | 0 - 22 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
- | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.357 ms | 0 - 21 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
54
- | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.305 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
- | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.784 ms | 0 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
56
- | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.769 ms | 0 - 15 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
- | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.144 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
58
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.461 ms | 0 - 25 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
59
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.468 ms | 0 - 25 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
60
- | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.761 ms | 0 - 27 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
61
- | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.109 ms | 0 - 22 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
62
- | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.35 ms | 0 - 24 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
63
- | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.583 ms | 0 - 21 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
64
- | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.871 ms | 0 - 19 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
65
- | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.349 ms | 0 - 19 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
66
- | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.531 ms | 3 - 20 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
67
- | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.914 ms | 0 - 0 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
68
- | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.093 ms | 8 - 8 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
69
- | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.036 ms | 1 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
70
- | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 0.915 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
71
- | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.529 ms | 1 - 30 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
72
- | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.568 ms | 0 - 29 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
73
- | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.436 ms | 0 - 9 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
74
- | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.368 ms | 0 - 3 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
75
- | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.525 ms | 0 - 17 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
76
- | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.662 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
77
- | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.101 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
78
- | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 9.01 ms | 4 - 33 MB | GPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
79
- | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 1.052 ms | 0 - 20 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
80
- | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 9.311 ms | 18 - 29 MB | CPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
81
- | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 5.294 ms | 4 - 11 MB | GPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
82
- | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 7.126 ms | 18 - 21 MB | CPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
83
- | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.036 ms | 1 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
84
- | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 0.915 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
85
- | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.438 ms | 0 - 4 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
86
- | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.372 ms | 0 - 11 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
87
- | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.863 ms | 0 - 21 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
88
- | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.772 ms | 0 - 21 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
89
- | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.439 ms | 0 - 10 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
90
- | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.37 ms | 0 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
91
- | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.662 ms | 0 - 16 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
92
- | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.101 ms | 0 - 15 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
93
- | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.276 ms | 0 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
94
- | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.241 ms | 0 - 23 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
95
- | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.982 ms | 0 - 25 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
96
- | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.272 ms | 0 - 22 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
97
- | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.187 ms | 0 - 18 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
98
- | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.775 ms | 0 - 19 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
99
- | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.267 ms | 0 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
100
- | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.17 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
101
- | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.712 ms | 3 - 22 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
102
- | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.475 ms | 4 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
103
- | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.525 ms | 9 - 9 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
 
 
 
104
 
105
 
106
 
@@ -114,9 +117,9 @@ pip install qai-hub-models
114
  ```
115
 
116
 
117
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
118
 
119
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
120
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
121
 
122
  With this API token, you can configure your client to run models on the cloud
@@ -124,7 +127,7 @@ hosted devices.
124
  ```bash
125
  qai-hub configure --api_token API_TOKEN
126
  ```
127
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
128
 
129
 
130
 
@@ -235,7 +238,7 @@ With the output of the model, you can compute like PSNR, relative errors or
235
  spot check the output with expected output.
236
 
237
  **Note**: This on-device profiling and inference requires access to Qualcomm®
238
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
239
 
240
 
241
 
 
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
+ | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.894 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
40
+ | XLSR | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.2 ms | 0 - 16 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
41
+ | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.502 ms | 0 - 28 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
42
+ | XLSR | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.04 ms | 0 - 32 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
43
+ | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.298 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
44
+ | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.765 ms | 0 - 3 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
45
+ | XLSR | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.195 ms | 0 - 8 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
46
+ | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.751 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
47
+ | XLSR | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.132 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
48
+ | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.894 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
49
+ | XLSR | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.2 ms | 0 - 16 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
50
+ | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.303 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
51
+ | XLSR | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.769 ms | 0 - 6 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
52
+ | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.161 ms | 0 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
53
+ | XLSR | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.386 ms | 0 - 22 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
54
+ | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.3 ms | 0 - 7 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
55
+ | XLSR | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.766 ms | 0 - 5 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
56
+ | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.751 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
57
+ | XLSR | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.132 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
58
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.467 ms | 0 - 28 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
59
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.473 ms | 0 - 29 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
60
+ | XLSR | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.757 ms | 0 - 24 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
61
+ | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.11 ms | 0 - 21 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
62
+ | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.358 ms | 0 - 29 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
63
+ | XLSR | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.584 ms | 0 - 26 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
64
+ | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.878 ms | 0 - 19 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.tflite) |
65
+ | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.343 ms | 0 - 21 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
66
+ | XLSR | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.546 ms | 3 - 20 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
67
+ | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.908 ms | 0 - 0 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.dlc) |
68
+ | XLSR | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.092 ms | 8 - 8 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR.onnx.zip) |
69
+ | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 1.006 ms | 1 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
70
+ | XLSR | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 0.882 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
71
+ | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 0.507 ms | 1 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
72
+ | XLSR | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 0.531 ms | 0 - 30 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
73
+ | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 0.438 ms | 0 - 10 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
74
+ | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 0.368 ms | 0 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
75
+ | XLSR | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.503 ms | 0 - 4 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
76
+ | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 0.66 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
77
+ | XLSR | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 0.57 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
78
+ | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 1.008 ms | 0 - 21 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
79
+ | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 1.049 ms | 0 - 21 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
80
+ | XLSR | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 9.211 ms | 18 - 29 MB | CPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
81
+ | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | TFLITE | 6.334 ms | 4 - 11 MB | GPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
82
+ | XLSR | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 7.19 ms | 18 - 21 MB | CPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
83
+ | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 1.006 ms | 1 - 18 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
84
+ | XLSR | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 0.882 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
85
+ | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 0.434 ms | 0 - 10 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
86
+ | XLSR | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 0.386 ms | 0 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
87
+ | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 0.839 ms | 0 - 23 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
88
+ | XLSR | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 0.758 ms | 0 - 23 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
89
+ | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 0.436 ms | 0 - 4 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
90
+ | XLSR | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 0.389 ms | 0 - 11 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
91
+ | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 0.66 ms | 0 - 17 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
92
+ | XLSR | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 0.57 ms | 0 - 17 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
93
+ | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.272 ms | 0 - 29 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
94
+ | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.236 ms | 0 - 26 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
95
+ | XLSR | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 0.935 ms | 0 - 24 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
96
+ | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.272 ms | 0 - 24 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
97
+ | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.189 ms | 0 - 21 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
98
+ | XLSR | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.803 ms | 0 - 19 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
99
+ | XLSR | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 0.468 ms | 0 - 27 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
100
+ | XLSR | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | QNN_DLC | 0.414 ms | 0 - 23 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
101
+ | XLSR | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 7.311 ms | 19 - 33 MB | CPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
102
+ | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.267 ms | 0 - 20 MB | NPU | [XLSR.tflite](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.tflite) |
103
+ | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.166 ms | 0 - 19 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
104
+ | XLSR | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.691 ms | 4 - 26 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
105
+ | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 0.496 ms | 4 - 4 MB | NPU | [XLSR.dlc](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.dlc) |
106
+ | XLSR | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.444 ms | 9 - 9 MB | NPU | [XLSR.onnx.zip](https://huggingface.co/qualcomm/XLSR/blob/main/XLSR_w8a8.onnx.zip) |
107
 
108
 
109
 
 
117
  ```
118
 
119
 
120
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
121
 
122
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
123
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
124
 
125
  With this API token, you can configure your client to run models on the cloud
 
127
  ```bash
128
  qai-hub configure --api_token API_TOKEN
129
  ```
130
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
131
 
132
 
133
 
 
238
  spot check the output with expected output.
239
 
240
  **Note**: This on-device profiling and inference requires access to Qualcomm®
241
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
242
 
243
 
244
 
XLSR_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6969428a95dbd3f25b5d363173fecf2f1c48c7700083a7d52f99d1f9f7fc4d81
3
- size 149068
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55fbb5f4d60a11bbcee83546d315a12cc4c4c300910a562558d7000992458251
3
+ size 149164
XLSR_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e83f151709c3e4413a686a77ca8eed182f6969d843e37794d2bac1b3e2d89581
3
  size 106951
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b611e292d2cc158d013f88a9154ee05405645fcf64600df6092b2b60fb6976cc
3
  size 106951
XLSR_w8a8.dlc CHANGED
Binary files a/XLSR_w8a8.dlc and b/XLSR_w8a8.dlc differ
 
XLSR_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63f00a582d2eb04d20d6e29115f553263c670574d16d5680511cb3d331bc6c4c
3
  size 75865
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13fe710d2e8c88acfbd5d3a288fea4e51f2f47b8e046651096ea62f77982acfe
3
  size 75865