Hugging Face's logo

qualcomm
/
MiniLM-v2

Text Generation
PyTorch
foundation
real_time
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
af88d7d
·
verified ·
1 Parent(s): e9458f6

v0.62.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.62.0 for changelog.

Files changed (2) hide show
  1. README.md +100 -104
  2. release_assets.json +7 -7
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -29,26 +29,26 @@ Below are pre-exported model assets ready for deployment.
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
- | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-onnx-float.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-onnx-w8a8.zip)
34
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-qnn_dlc-float.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-qnn_dlc-w8a8.zip)
36
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-tflite-float.zip)
37
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
- See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.61.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
@@ -65,107 +65,103 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
  | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.671 ms | 1 - 1 MB | NPU
68
- | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.673 ms | 44 - 44 MB | NPU
69
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.128 ms | 0 - 102 MB | NPU
70
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.35 ms | 0 - 107 MB | NPU
71
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 1.785 ms | 0 - 4 MB | NPU
72
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.621 ms | 0 - 50 MB | NPU
73
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.35 ms | 0 - 107 MB | NPU
74
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 2.004 ms | 0 - 3 MB | NPU
75
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.673 ms | 44 - 44 MB | NPU
76
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.789 ms | 0 - 60 MB | NPU
77
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.789 ms | 0 - 60 MB | NPU
78
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.643 ms | 0 - 62 MB | NPU
79
  | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.671 ms | 1 - 1 MB | NPU
80
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.782 ms | 23 - 23 MB | NPU
81
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.207 ms | 0 - 87 MB | NPU
82
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.964 ms | 0 - 87 MB | NPU
83
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 5.267 ms | 0 - 3 MB | NPU
84
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.673 ms | 0 - 4 MB | NPU
85
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.707 ms | 0 - 26 MB | NPU
86
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.964 ms | 0 - 87 MB | NPU
87
  | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.797 ms | 0 - 3 MB | NPU
88
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.782 ms | 23 - 23 MB | NPU
89
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.704 ms | 0 - 60 MB | NPU
90
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.953 ms | 0 - 54 MB | NPU
91
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.843 ms | 0 - 60 MB | NPU
92
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.843 ms | 0 - 60 MB | NPU
93
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.665 ms | 0 - 57 MB | NPU
94
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.953 ms | 0 - 54 MB | NPU
95
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.677 ms | 1 - 1 MB | NPU
96
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.288 ms | 1 - 1 MB | NPU
97
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.788 ms | 0 - 99 MB | NPU
98
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.895 ms | 0 - 101 MB | NPU
99
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 1.323 ms | 0 - 2 MB | NPU
100
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 3.572 ms | 0 - 58 MB | NPU
101
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.115 ms | 0 - 7 MB | NPU
102
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.521 ms | 0 - 60 MB | NPU
103
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.521 ms | 0 - 60 MB | NPU
104
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.521 ms | 0 - 60 MB | NPU
105
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.895 ms | 0 - 101 MB | NPU
106
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.39 ms | 2 - 4 MB | NPU
107
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.288 ms | 1 - 1 MB | NPU
108
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.565 ms | 0 - 59 MB | NPU
109
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.572 ms | 0 - 58 MB | NPU
110
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.286 ms | 0 - 57 MB | NPU
111
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.565 ms | 0 - 59 MB | NPU
112
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.464 ms | 0 - 61 MB | NPU
113
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.815 ms | 1 - 1 MB | NPU
114
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.909 ms | 1 - 1 MB | NPU
115
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.208 ms | 0 - 73 MB | NPU
116
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.954 ms | 0 - 72 MB | NPU
117
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.003 ms | 2 - 4 MB | NPU
118
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.647 ms | 0 - 2 MB | NPU
119
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 3.449 ms | 0 - 48 MB | NPU
120
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.717 ms | 0 - 2 MB | NPU
121
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.931 ms | 0 - 50 MB | NPU
122
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.931 ms | 0 - 50 MB | NPU
123
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.931 ms | 0 - 50 MB | NPU
124
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.954 ms | 0 - 72 MB | NPU
125
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.994 ms | 0 - 2 MB | NPU
126
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.909 ms | 1 - 1 MB | NPU
127
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.135 ms | 0 - 50 MB | NPU
128
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.699 ms | 0 - 47 MB | NPU
129
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.833 ms | 0 - 48 MB | NPU
130
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.449 ms | 0 - 48 MB | NPU
131
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.371 ms | 0 - 46 MB | NPU
132
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.833 ms | 0 - 48 MB | NPU
133
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.671 ms | 0 - 51 MB | NPU
134
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.699 ms | 0 - 47 MB | NPU
135
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.829 ms | 0 - 103 MB | NPU
136
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.96 ms | 0 - 104 MB | NPU
137
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 1.383 ms | 0 - 46 MB | NPU
138
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 3.674 ms | 0 - 63 MB | NPU
139
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.132 ms | 0 - 6 MB | NPU
140
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.556 ms | 0 - 65 MB | NPU
141
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.556 ms | 0 - 65 MB | NPU
142
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.556 ms | 0 - 65 MB | NPU
143
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.96 ms | 0 - 104 MB | NPU
144
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.402 ms | 0 - 45 MB | NPU
145
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.593 ms | 0 - 58 MB | NPU
146
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.674 ms | 0 - 63 MB | NPU
147
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.375 ms | 0 - 56 MB | NPU
148
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.593 ms | 0 - 58 MB | NPU
149
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.485 ms | 0 - 58 MB | NPU
150
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.666 ms | 0 - 82 MB | NPU
151
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.604 ms | 0 - 79 MB | NPU
152
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 15.688 ms | 0 - 31 MB | NPU
153
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.268 ms | 0 - 25 MB | NPU
154
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 4.64 ms | 0 - 55 MB | NPU
155
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.376 ms | 0 - 2 MB | NPU
156
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.681 ms | 0 - 59 MB | NPU
157
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.681 ms | 0 - 59 MB | NPU
158
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.681 ms | 0 - 59 MB | NPU
159
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.604 ms | 0 - 79 MB | NPU
160
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.502 ms | 0 - 24 MB | NPU
161
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.098 ms | 0 - 36 MB | NPU
162
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.046 ms | 0 - 35 MB | NPU
163
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.134 ms | 0 - 62 MB | NPU
164
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.64 ms | 0 - 55 MB | NPU
165
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.21 ms | 0 - 48 MB | NPU
166
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.134 ms | 0 - 62 MB | NPU
167
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.95 ms | 0 - 56 MB | NPU
168
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.046 ms | 0 - 35 MB | NPU
169
 
170
  ## License
171
  * The license for the original implementation of MiniLM-v2 can be found
 
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-onnx-float.zip)
33
+ | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-onnx-w8a8.zip)
34
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-qnn_dlc-float.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-qnn_dlc-w8a8.zip)
36
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-tflite-float.zip)
37
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
+ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
 
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
  | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.671 ms | 1 - 1 MB | NPU
68
+ | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.676 ms | 44 - 44 MB | NPU
69
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.123 ms | 0 - 106 MB | NPU
70
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.361 ms | 0 - 106 MB | NPU
71
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 1.781 ms | 0 - 3 MB | NPU
72
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.616 ms | 0 - 50 MB | NPU
73
+ | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.361 ms | 0 - 106 MB | NPU
74
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 1.864 ms | 0 - 3 MB | NPU
75
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.676 ms | 44 - 44 MB | NPU
76
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.793 ms | 0 - 58 MB | NPU
77
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.793 ms | 0 - 58 MB | NPU
78
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.64 ms | 0 - 62 MB | NPU
79
  | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.671 ms | 1 - 1 MB | NPU
80
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.779 ms | 23 - 23 MB | NPU
81
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.192 ms | 0 - 87 MB | NPU
82
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.985 ms | 0 - 88 MB | NPU
83
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 5.548 ms | 0 - 3 MB | NPU
84
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.674 ms | 0 - 3 MB | NPU
85
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.703 ms | 0 - 153 MB | NPU
86
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.985 ms | 0 - 88 MB | NPU
87
  | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.797 ms | 0 - 3 MB | NPU
88
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.779 ms | 23 - 23 MB | NPU
89
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.686 ms | 0 - 60 MB | NPU
90
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.957 ms | 0 - 54 MB | NPU
91
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.843 ms | 0 - 56 MB | NPU
92
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.843 ms | 0 - 56 MB | NPU
93
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.66 ms | 0 - 57 MB | NPU
94
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.957 ms | 0 - 54 MB | NPU
95
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.671 ms | 1 - 1 MB | NPU
96
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.296 ms | 1 - 1 MB | NPU
97
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.791 ms | 38 - 136 MB | NPU
98
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.892 ms | 0 - 101 MB | NPU
99
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 1.323 ms | 0 - 2 MB | NPU
100
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.118 ms | 0 - 2 MB | NPU
101
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.513 ms | 0 - 59 MB | NPU
102
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.513 ms | 0 - 59 MB | NPU
103
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.513 ms | 0 - 59 MB | NPU
104
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.892 ms | 0 - 101 MB | NPU
105
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.391 ms | 2 - 4 MB | NPU
106
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.296 ms | 1 - 1 MB | NPU
107
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.568 ms | 0 - 59 MB | NPU
108
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.596 ms | 0 - 59 MB | NPU
109
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.301 ms | 0 - 57 MB | NPU
110
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.568 ms | 0 - 59 MB | NPU
111
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.455 ms | 0 - 58 MB | NPU
112
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.812 ms | 0 - 0 MB | NPU
113
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.914 ms | 1 - 1 MB | NPU
114
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.219 ms | 0 - 73 MB | NPU
115
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.962 ms | 0 - 69 MB | NPU
116
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.011 ms | 0 - 2 MB | NPU
117
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.654 ms | 0 - 2 MB | NPU
118
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.718 ms | 0 - 2 MB | NPU
 
 
119
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.931 ms | 0 - 50 MB | NPU
120
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.931 ms | 0 - 50 MB | NPU
121
  | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.931 ms | 0 - 50 MB | NPU
122
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.962 ms | 0 - 69 MB | NPU
123
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.819 ms | 0 - 2 MB | NPU
124
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.914 ms | 1 - 1 MB | NPU
125
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.118 ms | 0 - 50 MB | NPU
126
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.698 ms | 0 - 47 MB | NPU
127
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.838 ms | 0 - 49 MB | NPU
128
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.423 ms | 0 - 48 MB | NPU
129
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.38 ms | 0 - 46 MB | NPU
130
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.838 ms | 0 - 49 MB | NPU
131
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.685 ms | 0 - 53 MB | NPU
132
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.698 ms | 0 - 47 MB | NPU
133
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.82 ms | 0 - 102 MB | NPU
134
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.956 ms | 0 - 101 MB | NPU
135
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 1.377 ms | 0 - 46 MB | NPU
136
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.146 ms | 0 - 2 MB | NPU
137
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.568 ms | 0 - 65 MB | NPU
138
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.568 ms | 0 - 65 MB | NPU
139
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.568 ms | 0 - 65 MB | NPU
140
+ | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.956 ms | 0 - 101 MB | NPU
141
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.414 ms | 0 - 45 MB | NPU
142
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.594 ms | 0 - 66 MB | NPU
143
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.721 ms | 0 - 62 MB | NPU
144
+ | MiniLM-v2 | TFLITE | float | Qualcomm�� SA8295P | 2.354 ms | 0 - 56 MB | NPU
145
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.594 ms | 0 - 66 MB | NPU
146
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.482 ms | 0 - 60 MB | NPU
147
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.671 ms | 0 - 80 MB | NPU
148
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.612 ms | 0 - 81 MB | NPU
149
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 17.056 ms | 0 - 30 MB | NPU
150
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.256 ms | 0 - 25 MB | NPU
151
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.364 ms | 0 - 3 MB | NPU
152
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.682 ms | 0 - 59 MB | NPU
153
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.682 ms | 0 - 59 MB | NPU
154
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.682 ms | 0 - 59 MB | NPU
155
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.612 ms | 0 - 81 MB | NPU
156
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.506 ms | 0 - 24 MB | NPU
157
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.129 ms | 0 - 37 MB | NPU
158
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.05 ms | 0 - 35 MB | NPU
159
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.135 ms | 0 - 58 MB | NPU
160
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.601 ms | 0 - 55 MB | NPU
161
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.197 ms | 0 - 48 MB | NPU
162
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.135 ms | 0 - 58 MB | NPU
163
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.945 ms | 0 - 55 MB | NPU
164
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.05 ms | 0 - 35 MB | NPU
 
 
165
 
166
  ## License
167
  * The license for the original implementation of MiniLM-v2 can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.61.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -8,19 +8,19 @@
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
@@ -31,19 +31,19 @@
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-qnn_dlc-w8a8.zip"
41
  },
42
  "tflite": {
43
  "tool_versions": {
44
  "qairt": "2.45.0.260326154327"
45
  },
46
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.61.0/minilm_v2-tflite-w8a8.zip"
47
  }
48
  }
49
  }
 
1
  {
2
+ "version": "0.62.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
 
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-qnn_dlc-w8a8.zip"
41
  },
42
  "tflite": {
43
  "tool_versions": {
44
  "qairt": "2.45.0.260326154327"
45
  },
46
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.62.0/minilm_v2-tflite-w8a8.zip"
47
  }
48
  }
49
  }