Hugging Face's logo

qualcomm
/
MiniLM-v2

Text Generation
PyTorch
foundation
real_time
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
567d812
·
verified ·
1 Parent(s): f4752d0

v0.60.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.60.0 for changelog.

Files changed (2) hide show
  1. README.md +112 -103
  2. release_assets.json +7 -7
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -29,134 +29,143 @@ Below are pre-exported model assets ready for deployment.
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
- | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-onnx-float.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-onnx-w8a8.zip)
34
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-qnn_dlc-float.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-qnn_dlc-w8a8.zip)
36
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-tflite-float.zip)
37
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
- See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
55
  **Model Type:** Model_use_case.text_generation
56
 
57
  **Model Stats:**
58
- - Model checkpoint: sentence-transformers/all-MiniLM-L6-v2
59
  - Input resolution: 128 tokens
60
- - Number of parameters: 22.7M
61
  - Model size (float): 86.7 MB
62
- - Embedding dimension: 384
63
 
64
  ## Performance Summary
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
- | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.858 ms | 1 - 1 MB | NPU
68
- | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.748 ms | 45 - 45 MB | NPU
69
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.23 ms | 0 - 103 MB | NPU
70
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.536 ms | 0 - 108 MB | NPU
71
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.706 ms | 0 - 50 MB | NPU
72
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.536 ms | 0 - 108 MB | NPU
73
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 2.068 ms | 0 - 3 MB | NPU
74
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.748 ms | 45 - 45 MB | NPU
75
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.862 ms | 0 - 61 MB | NPU
76
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.862 ms | 0 - 61 MB | NPU
77
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.705 ms | 0 - 63 MB | NPU
 
78
  | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.672 ms | 1 - 1 MB | NPU
79
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.775 ms | 23 - 23 MB | NPU
80
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.203 ms | 0 - 88 MB | NPU
81
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.973 ms | 0 - 90 MB | NPU
82
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 5.291 ms | 0 - 3 MB | NPU
83
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.701 ms | 0 - 26 MB | NPU
84
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.973 ms | 0 - 90 MB | NPU
85
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.8 ms | 0 - 3 MB | NPU
86
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.775 ms | 23 - 23 MB | NPU
87
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.843 ms | 0 - 59 MB | NPU
88
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.843 ms | 0 - 59 MB | NPU
89
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.669 ms | 0 - 61 MB | NPU
90
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.655 ms | 1 - 1 MB | NPU
91
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.305 ms | 1 - 1 MB | NPU
92
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.8 ms | 0 - 101 MB | NPU
93
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.89 ms | 0 - 100 MB | NPU
94
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 3.57 ms | 0 - 58 MB | NPU
95
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.12 ms | 0 - 2 MB | NPU
96
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.539 ms | 0 - 60 MB | NPU
97
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.539 ms | 0 - 60 MB | NPU
98
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.539 ms | 0 - 60 MB | NPU
99
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.89 ms | 0 - 100 MB | NPU
100
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.387 ms | 2 - 4 MB | NPU
101
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.305 ms | 1 - 1 MB | NPU
102
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.565 ms | 0 - 60 MB | NPU
103
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.57 ms | 0 - 58 MB | NPU
104
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.278 ms | 0 - 56 MB | NPU
105
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.565 ms | 0 - 60 MB | NPU
106
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.457 ms | 0 - 62 MB | NPU
107
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.81 ms | 0 - 0 MB | NPU
108
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.92 ms | 1 - 1 MB | NPU
109
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.216 ms | 0 - 73 MB | NPU
110
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.958 ms | 0 - 72 MB | NPU
111
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.019 ms | 0 - 2 MB | NPU
112
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 3.416 ms | 0 - 47 MB | NPU
113
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.712 ms | 0 - 2 MB | NPU
114
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.951 ms | 0 - 52 MB | NPU
115
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.951 ms | 0 - 52 MB | NPU
116
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.951 ms | 0 - 52 MB | NPU
117
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.958 ms | 0 - 72 MB | NPU
118
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.322 ms | 0 - 2 MB | NPU
119
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.92 ms | 1 - 1 MB | NPU
120
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.097 ms | 0 - 50 MB | NPU
121
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.699 ms | 0 - 47 MB | NPU
122
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.835 ms | 0 - 53 MB | NPU
123
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.416 ms | 0 - 47 MB | NPU
124
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.377 ms | 0 - 46 MB | NPU
125
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.835 ms | 0 - 53 MB | NPU
126
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.684 ms | 0 - 54 MB | NPU
127
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.699 ms | 0 - 47 MB | NPU
128
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.834 ms | 0 - 104 MB | NPU
129
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.952 ms | 0 - 102 MB | NPU
130
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 3.684 ms | 0 - 63 MB | NPU
131
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.118 ms | 0 - 50 MB | NPU
132
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.562 ms | 0 - 65 MB | NPU
133
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.562 ms | 0 - 65 MB | NPU
134
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.562 ms | 0 - 65 MB | NPU
135
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.952 ms | 0 - 102 MB | NPU
 
 
 
 
 
 
 
136
  | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.414 ms | 0 - 45 MB | NPU
137
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.593 ms | 0 - 58 MB | NPU
138
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.684 ms | 0 - 63 MB | NPU
139
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.353 ms | 0 - 56 MB | NPU
140
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.593 ms | 0 - 58 MB | NPU
141
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.482 ms | 0 - 58 MB | NPU
142
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.672 ms | 0 - 86 MB | NPU
143
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.615 ms | 0 - 80 MB | NPU
144
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 12.43 ms | 0 - 30 MB | NPU
145
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 4.628 ms | 0 - 55 MB | NPU
146
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.373 ms | 0 - 4 MB | NPU
147
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.686 ms | 0 - 59 MB | NPU
148
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.686 ms | 0 - 59 MB | NPU
149
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.686 ms | 0 - 59 MB | NPU
150
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.615 ms | 0 - 80 MB | NPU
151
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.504 ms | 0 - 24 MB | NPU
152
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.027 ms | 0 - 37 MB | NPU
153
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.019 ms | 0 - 35 MB | NPU
154
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.135 ms | 0 - 61 MB | NPU
155
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.628 ms | 0 - 55 MB | NPU
156
- | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.216 ms | 0 - 48 MB | NPU
157
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.135 ms | 0 - 61 MB | NPU
158
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.95 ms | 0 - 53 MB | NPU
159
- | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.019 ms | 0 - 35 MB | NPU
 
160
 
161
  ## License
162
  * The license for the original implementation of MiniLM-v2 can be found
 
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-onnx-float.zip)
33
+ | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-onnx-w8a8.zip)
34
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-qnn_dlc-float.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-qnn_dlc-w8a8.zip)
36
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-tflite-float.zip)
37
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
+ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
55
  **Model Type:** Model_use_case.text_generation
56
 
57
  **Model Stats:**
58
+ - Embedding dimension: 384
59
  - Input resolution: 128 tokens
60
+ - Model checkpoint: sentence-transformers/all-MiniLM-L6-v2
61
  - Model size (float): 86.7 MB
62
+ - Number of parameters: 22.7M
63
 
64
  ## Performance Summary
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
+ | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.672 ms | 1 - 1 MB | NPU
68
+ | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.676 ms | 44 - 44 MB | NPU
69
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.126 ms | 0 - 104 MB | NPU
70
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.357 ms | 0 - 107 MB | NPU
71
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 1.784 ms | 0 - 4 MB | NPU
72
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.615 ms | 0 - 50 MB | NPU
73
+ | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.357 ms | 0 - 107 MB | NPU
74
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 2.437 ms | 0 - 3 MB | NPU
75
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.676 ms | 44 - 44 MB | NPU
76
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.79 ms | 0 - 59 MB | NPU
77
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Mobile | 0.79 ms | 0 - 59 MB | NPU
78
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.643 ms | 0 - 61 MB | NPU
79
  | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.672 ms | 1 - 1 MB | NPU
80
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.783 ms | 23 - 23 MB | NPU
81
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.194 ms | 0 - 84 MB | NPU
82
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.98 ms | 0 - 87 MB | NPU
83
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 5.535 ms | 0 - 3 MB | NPU
84
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.67 ms | 0 - 4 MB | NPU
85
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.715 ms | 0 - 26 MB | NPU
86
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.98 ms | 0 - 87 MB | NPU
87
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.062 ms | 0 - 3 MB | NPU
88
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.783 ms | 23 - 23 MB | NPU
89
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.687 ms | 0 - 60 MB | NPU
90
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.95 ms | 0 - 54 MB | NPU
91
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.839 ms | 0 - 58 MB | NPU
92
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 0.839 ms | 0 - 58 MB | NPU
93
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.662 ms | 0 - 60 MB | NPU
94
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.95 ms | 0 - 54 MB | NPU
95
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.65 ms | 1 - 1 MB | NPU
96
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.303 ms | 1 - 1 MB | NPU
97
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.793 ms | 0 - 99 MB | NPU
98
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.89 ms | 0 - 102 MB | NPU
99
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 1.326 ms | 0 - 2 MB | NPU
100
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 3.563 ms | 0 - 57 MB | NPU
101
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.124 ms | 0 - 3 MB | NPU
102
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.51 ms | 0 - 59 MB | NPU
103
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.51 ms | 0 - 59 MB | NPU
104
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.51 ms | 0 - 59 MB | NPU
105
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.89 ms | 0 - 102 MB | NPU
106
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.47 ms | 2 - 4 MB | NPU
107
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.303 ms | 1 - 1 MB | NPU
108
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.568 ms | 0 - 60 MB | NPU
109
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.563 ms | 0 - 57 MB | NPU
110
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.281 ms | 0 - 57 MB | NPU
111
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 0.568 ms | 0 - 60 MB | NPU
112
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.466 ms | 0 - 61 MB | NPU
113
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.806 ms | 1 - 1 MB | NPU
114
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.909 ms | 0 - 0 MB | NPU
115
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.205 ms | 0 - 74 MB | NPU
116
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.943 ms | 0 - 72 MB | NPU
117
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.065 ms | 0 - 2 MB | NPU
118
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.657 ms | 0 - 2 MB | NPU
119
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 3.424 ms | 0 - 48 MB | NPU
120
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.726 ms | 0 - 33 MB | NPU
121
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.941 ms | 0 - 52 MB | NPU
122
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.941 ms | 0 - 52 MB | NPU
123
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.941 ms | 0 - 52 MB | NPU
124
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.943 ms | 0 - 72 MB | NPU
125
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.824 ms | 0 - 2 MB | NPU
126
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.909 ms | 0 - 0 MB | NPU
127
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.133 ms | 0 - 50 MB | NPU
128
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.69 ms | 0 - 47 MB | NPU
129
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.834 ms | 0 - 48 MB | NPU
130
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.424 ms | 0 - 48 MB | NPU
131
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.382 ms | 0 - 46 MB | NPU
132
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 0.834 ms | 0 - 48 MB | NPU
133
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.68 ms | 0 - 52 MB | NPU
134
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.69 ms | 0 - 47 MB | NPU
135
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.832 ms | 0 - 105 MB | NPU
136
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.952 ms | 0 - 101 MB | NPU
137
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 1.401 ms | 0 - 46 MB | NPU
138
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 3.732 ms | 0 - 63 MB | NPU
139
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.127 ms | 0 - 2 MB | NPU
140
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.568 ms | 0 - 65 MB | NPU
141
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.568 ms | 0 - 65 MB | NPU
142
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.568 ms | 0 - 65 MB | NPU
143
+ | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.952 ms | 0 - 101 MB | NPU
144
  | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.414 ms | 0 - 45 MB | NPU
145
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.596 ms | 0 - 66 MB | NPU
146
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA7255P | 3.732 ms | 0 - 63 MB | NPU
147
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.362 ms | 0 - 56 MB | NPU
148
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Mobile | 0.596 ms | 0 - 66 MB | NPU
149
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 0.488 ms | 0 - 60 MB | NPU
150
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.668 ms | 0 - 83 MB | NPU
151
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.608 ms | 0 - 82 MB | NPU
152
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 15.785 ms | 0 - 31 MB | NPU
153
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.26 ms | 0 - 25 MB | NPU
154
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 4.606 ms | 0 - 55 MB | NPU
155
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.361 ms | 0 - 5 MB | NPU
156
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.647 ms | 0 - 59 MB | NPU
157
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.647 ms | 0 - 59 MB | NPU
158
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.647 ms | 0 - 59 MB | NPU
159
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.608 ms | 0 - 82 MB | NPU
160
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.499 ms | 0 - 24 MB | NPU
161
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.153 ms | 0 - 38 MB | NPU
162
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.059 ms | 0 - 35 MB | NPU
163
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.137 ms | 0 - 61 MB | NPU
164
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.606 ms | 0 - 55 MB | NPU
165
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.197 ms | 0 - 48 MB | NPU
166
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.137 ms | 0 - 61 MB | NPU
167
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.951 ms | 0 - 56 MB | NPU
168
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.059 ms | 0 - 35 MB | NPU
169
 
170
  ## License
171
  * The license for the original implementation of MiniLM-v2 can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.59.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -8,19 +8,19 @@
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
@@ -31,19 +31,19 @@
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-qnn_dlc-w8a8.zip"
41
  },
42
  "tflite": {
43
  "tool_versions": {
44
  "qairt": "2.45.0.260326154327"
45
  },
46
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.59.0/minilm_v2-tflite-w8a8.zip"
47
  }
48
  }
49
  }
 
1
  {
2
+ "version": "0.60.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "onnx_runtime": "1.27.1"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.45.0.260326154327"
22
  },
23
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
 
31
  "qairt": "2.45.0.260326154327",
32
  "onnx_runtime": "1.27.1"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.45.0.260326154327"
39
  },
40
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-qnn_dlc-w8a8.zip"
41
  },
42
  "tflite": {
43
  "tool_versions": {
44
  "qairt": "2.45.0.260326154327"
45
  },
46
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.60.0/minilm_v2-tflite-w8a8.zip"
47
  }
48
  }
49
  }