Hugging Face's logo

qualcomm
/
MiniLM-v2

Text Generation
PyTorch
foundation
real_time
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
288efa9
·
verified ·
1 Parent(s): 9b0c7cf

v0.58.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.58.0 for changelog.

Files changed (2) hide show
  1. README.md +105 -99
  2. release_assets.json +7 -7
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.57.3/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -29,26 +29,26 @@ Below are pre-exported model assets ready for deployment.
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
- | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-onnx-float.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-onnx-w8a8.zip)
34
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-qnn_dlc-float.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-qnn_dlc-w8a8.zip)
36
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-tflite-float.zip)
37
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.57.3/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
- See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.57.3/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
@@ -64,96 +64,102 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
64
  ## Performance Summary
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
- | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.774 ms | 212 - 212 MB | NPU
68
- | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.769 ms | 149 - 149 MB | NPU
69
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.231 ms | 0 - 93 MB | NPU
70
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.535 ms | 0 - 98 MB | NPU
71
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8550 (Proxy) | 1.772 ms | 0 - 3 MB | NPU
72
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.535 ms | 0 - 98 MB | NPU
73
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.866 ms | 0 - 62 MB | NPU
74
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.698 ms | 0 - 58 MB | NPU
75
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS9075 | 2.964 ms | 0 - 45 MB | NPU
76
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8750 | 0.866 ms | 0 - 62 MB | NPU
77
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS7181 | 1.769 ms | 149 - 149 MB | NPU
78
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.669 ms | 213 - 213 MB | NPU
79
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.788 ms | 149 - 149 MB | NPU
80
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.194 ms | 0 - 78 MB | NPU
81
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.98 ms | 0 - 78 MB | NPU
82
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS6490 | 4.839 ms | 0 - 45 MB | NPU
83
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.716 ms | 0 - 27 MB | NPU
84
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.98 ms | 0 - 78 MB | NPU
85
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.664 ms | 0 - 56 MB | NPU
86
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.943 ms | 0 - 51 MB | NPU
87
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCM6690 | 6.704 ms | 0 - 57 MB | NPU
88
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS9075 | 1.871 ms | 0 - 45 MB | NPU
89
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.84 ms | 0 - 56 MB | NPU
90
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS7790 | 1.943 ms | 0 - 51 MB | NPU
91
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8750 | 0.84 ms | 0 - 56 MB | NPU
92
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS7181 | 1.788 ms | 149 - 149 MB | NPU
93
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.682 ms | 1 - 1 MB | NPU
94
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.302 ms | 1 - 1 MB | NPU
95
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.795 ms | 0 - 101 MB | NPU
96
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.886 ms | 0 - 100 MB | NPU
97
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8275 | 3.561 ms | 0 - 58 MB | NPU
98
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 1.125 ms | 0 - 2 MB | NPU
99
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.886 ms | 0 - 100 MB | NPU
100
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.567 ms | 0 - 60 MB | NPU
101
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.301 ms | 0 - 56 MB | NPU
102
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.461 ms | 0 - 60 MB | NPU
103
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.561 ms | 0 - 58 MB | NPU
104
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS9075 | 1.451 ms | 0 - 2 MB | NPU
105
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8750 | 0.567 ms | 0 - 60 MB | NPU
106
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS7181 | 1.302 ms | 1 - 1 MB | NPU
107
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.819 ms | 1 - 1 MB | NPU
108
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.912 ms | 1 - 1 MB | NPU
109
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.206 ms | 0 - 69 MB | NPU
110
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.952 ms | 0 - 72 MB | NPU
111
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3.699 ms | 0 - 2 MB | NPU
112
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 3.456 ms | 0 - 48 MB | NPU
113
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.715 ms | 0 - 51 MB | NPU
114
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.952 ms | 0 - 72 MB | NPU
115
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.681 ms | 0 - 54 MB | NPU
116
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.694 ms | 0 - 47 MB | NPU
117
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 6.088 ms | 2 - 52 MB | NPU
118
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 1.862 ms | 0 - 2 MB | NPU
119
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.456 ms | 0 - 48 MB | NPU
120
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.839 ms | 0 - 52 MB | NPU
121
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.372 ms | 0 - 46 MB | NPU
122
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 1.694 ms | 0 - 47 MB | NPU
123
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 0.839 ms | 0 - 52 MB | NPU
124
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 1.912 ms | 1 - 1 MB | NPU
125
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.832 ms | 0 - 102 MB | NPU
126
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.932 ms | 0 - 102 MB | NPU
127
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8275 | 3.674 ms | 0 - 63 MB | NPU
128
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 1.127 ms | 0 - 2 MB | NPU
129
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 12.459 ms | 0 - 28 MB | GPU
130
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 12.459 ms | 0 - 28 MB | GPU
131
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 12.459 ms | 0 - 28 MB | GPU
132
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.932 ms | 0 - 102 MB | NPU
133
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.593 ms | 0 - 65 MB | NPU
134
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.366 ms | 0 - 56 MB | NPU
135
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.482 ms | 0 - 58 MB | NPU
136
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.674 ms | 0 - 63 MB | NPU
137
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS9075 | 1.501 ms | 0 - 45 MB | NPU
138
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8750 | 0.593 ms | 0 - 65 MB | NPU
139
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.672 ms | 0 - 83 MB | NPU
140
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.619 ms | 0 - 80 MB | NPU
141
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS6490 | 13.129 ms | 0 - 31 MB | NPU
142
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8275 | 4.618 ms | 0 - 55 MB | NPU
143
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 2.366 ms | 0 - 3 MB | NPU
144
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 12.541 ms | 0 - 30 MB | GPU
145
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 12.541 ms | 0 - 30 MB | GPU
146
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 12.541 ms | 0 - 30 MB | GPU
147
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.619 ms | 0 - 80 MB | NPU
148
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.947 ms | 0 - 54 MB | NPU
149
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.123 ms | 0 - 35 MB | NPU
150
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCM6690 | 12.046 ms | 0 - 35 MB | NPU
151
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS9075 | 2.498 ms | 0 - 24 MB | NPU
152
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.618 ms | 0 - 55 MB | NPU
153
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.134 ms | 0 - 62 MB | NPU
154
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.202 ms | 0 - 48 MB | NPU
155
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS7790 | 5.123 ms | 0 - 35 MB | NPU
156
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8750 | 1.134 ms | 0 - 62 MB | NPU
 
 
 
 
 
 
157
 
158
  ## License
159
  * The license for the original implementation of MiniLM-v2 can be found
 
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.58.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-onnx-float.zip)
33
+ | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-onnx-w8a8.zip)
34
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-qnn_dlc-float.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-qnn_dlc-w8a8.zip)
36
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-tflite-float.zip)
37
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.58.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
+ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.58.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
 
64
  ## Performance Summary
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
+ | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.781 ms | 1 - 1 MB | NPU
68
+ | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.751 ms | 45 - 45 MB | NPU
69
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.227 ms | 0 - 104 MB | NPU
70
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.547 ms | 0 - 108 MB | NPU
71
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.71 ms | 0 - 3 MB | NPU
72
+ | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.547 ms | 0 - 108 MB | NPU
73
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 2.074 ms | 0 - 3 MB | NPU
74
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.7 ms | 0 - 62 MB | NPU
75
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.864 ms | 0 - 60 MB | NPU
76
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.864 ms | 0 - 60 MB | NPU
77
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.751 ms | 45 - 45 MB | NPU
78
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.673 ms | 1 - 1 MB | NPU
79
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.783 ms | 23 - 23 MB | NPU
80
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.202 ms | 0 - 85 MB | NPU
81
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.973 ms | 0 - 87 MB | NPU
82
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 5.522 ms | 0 - 3 MB | NPU
83
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.704 ms | 0 - 2 MB | NPU
84
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.973 ms | 0 - 87 MB | NPU
85
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.845 ms | 0 - 57 MB | NPU
86
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.939 ms | 0 - 55 MB | NPU
87
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.666 ms | 0 - 62 MB | NPU
88
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.8 ms | 0 - 3 MB | NPU
89
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.703 ms | 0 - 61 MB | NPU
90
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.939 ms | 0 - 55 MB | NPU
91
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.845 ms | 0 - 57 MB | NPU
92
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.783 ms | 23 - 23 MB | NPU
93
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.672 ms | 1 - 1 MB | NPU
94
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.3 ms | 1 - 1 MB | NPU
95
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.797 ms | 0 - 100 MB | NPU
96
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.888 ms | 0 - 100 MB | NPU
97
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8275 | 3.554 ms | 0 - 58 MB | NPU
98
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.111 ms | 0 - 20 MB | NPU
99
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.513 ms | 0 - 60 MB | NPU
100
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.513 ms | 0 - 60 MB | NPU
101
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.513 ms | 0 - 60 MB | NPU
102
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.888 ms | 0 - 100 MB | NPU
103
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.389 ms | 0 - 2 MB | NPU
104
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.459 ms | 0 - 61 MB | NPU
105
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.554 ms | 0 - 58 MB | NPU
106
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.563 ms | 0 - 59 MB | NPU
107
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.293 ms | 0 - 56 MB | NPU
108
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.563 ms | 0 - 59 MB | NPU
109
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.3 ms | 1 - 1 MB | NPU
110
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.8 ms | 0 - 0 MB | NPU
111
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.903 ms | 0 - 0 MB | NPU
112
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.211 ms | 3 - 72 MB | NPU
113
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.944 ms | 0 - 74 MB | NPU
114
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.196 ms | 2 - 4 MB | NPU
115
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 3.465 ms | 0 - 48 MB | NPU
116
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.727 ms | 0 - 15 MB | NPU
117
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.951 ms | 0 - 51 MB | NPU
118
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.951 ms | 0 - 51 MB | NPU
119
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.951 ms | 0 - 51 MB | NPU
120
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.944 ms | 0 - 74 MB | NPU
121
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.832 ms | 0 - 48 MB | NPU
122
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.701 ms | 0 - 47 MB | NPU
123
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.677 ms | 0 - 50 MB | NPU
124
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.821 ms | 0 - 2 MB | NPU
125
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.131 ms | 0 - 50 MB | NPU
126
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.465 ms | 0 - 48 MB | NPU
127
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.357 ms | 0 - 46 MB | NPU
128
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.701 ms | 0 - 47 MB | NPU
129
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.832 ms | 0 - 48 MB | NPU
130
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.903 ms | 0 - 0 MB | NPU
131
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.819 ms | 0 - 106 MB | NPU
132
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.966 ms | 0 - 102 MB | NPU
133
+ | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8275 | 3.676 ms | 0 - 63 MB | NPU
134
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.117 ms | 0 - 2 MB | NPU
135
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.565 ms | 0 - 64 MB | NPU
136
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.565 ms | 0 - 64 MB | NPU
137
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.565 ms | 0 - 64 MB | NPU
138
+ | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.966 ms | 0 - 102 MB | NPU
139
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.408 ms | 0 - 45 MB | NPU
140
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.487 ms | 0 - 58 MB | NPU
141
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.676 ms | 0 - 63 MB | NPU
142
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.597 ms | 0 - 60 MB | NPU
143
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.361 ms | 0 - 56 MB | NPU
144
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.597 ms | 0 - 60 MB | NPU
145
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.668 ms | 0 - 80 MB | NPU
146
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.624 ms | 0 - 80 MB | NPU
147
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 16.748 ms | 0 - 31 MB | NPU
148
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8275 | 4.624 ms | 0 - 54 MB | NPU
149
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.367 ms | 0 - 4 MB | NPU
150
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.653 ms | 0 - 59 MB | NPU
151
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.653 ms | 0 - 59 MB | NPU
152
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.653 ms | 0 - 59 MB | NPU
153
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.624 ms | 0 - 80 MB | NPU
154
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.136 ms | 0 - 61 MB | NPU
155
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.071 ms | 0 - 35 MB | NPU
156
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.947 ms | 0 - 53 MB | NPU
157
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.51 ms | 0 - 24 MB | NPU
158
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 11.97 ms | 0 - 37 MB | NPU
159
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.624 ms | 0 - 54 MB | NPU
160
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.209 ms | 0 - 48 MB | NPU
161
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.071 ms | 0 - 35 MB | NPU
162
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.136 ms | 0 - 61 MB | NPU
163
 
164
  ## License
165
  * The license for the original implementation of MiniLM-v2 can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.57.3",
3
  "precisions": {
4
  "w8a8": {
5
  "universal_assets": {
@@ -8,20 +8,20 @@
8
  "qairt": "2.45.0.260326154327",
9
  "litert": "1.4.4"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-tflite-w8a8.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-qnn_dlc-w8a8.zip"
18
  },
19
  "onnx": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327",
22
  "onnx_runtime": "1.25.0"
23
  },
24
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-onnx-w8a8.zip"
25
  }
26
  }
27
  },
@@ -32,20 +32,20 @@
32
  "qairt": "2.45.0.260326154327",
33
  "litert": "1.4.4"
34
  },
35
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-tflite-float.zip"
36
  },
37
  "qnn_dlc": {
38
  "tool_versions": {
39
  "qairt": "2.45.0.260326154327"
40
  },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-qnn_dlc-float.zip"
42
  },
43
  "onnx": {
44
  "tool_versions": {
45
  "qairt": "2.45.0.260326154327",
46
  "onnx_runtime": "1.25.0"
47
  },
48
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.57.3/minilm_v2-onnx-float.zip"
49
  }
50
  }
51
  }
 
1
  {
2
+ "version": "0.58.0",
3
  "precisions": {
4
  "w8a8": {
5
  "universal_assets": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "litert": "1.4.4"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-tflite-w8a8.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-qnn_dlc-w8a8.zip"
18
  },
19
  "onnx": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327",
22
  "onnx_runtime": "1.25.0"
23
  },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-onnx-w8a8.zip"
25
  }
26
  }
27
  },
 
32
  "qairt": "2.45.0.260326154327",
33
  "litert": "1.4.4"
34
  },
35
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-tflite-float.zip"
36
  },
37
  "qnn_dlc": {
38
  "tool_versions": {
39
  "qairt": "2.45.0.260326154327"
40
  },
41
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-qnn_dlc-float.zip"
42
  },
43
  "onnx": {
44
  "tool_versions": {
45
  "qairt": "2.45.0.260326154327",
46
  "onnx_runtime": "1.25.0"
47
  },
48
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.58.0/minilm_v2-onnx-float.zip"
49
  }
50
  }
51
  }