Hugging Face's logo

qualcomm
/
MiniLM-v2

Text Generation
PyTorch
foundation
real_time
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
2338440
·
verified ·
1 Parent(s): aaaf7cb

v0.64.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.64.0 for changelog.

Files changed (2) hide show
  1. README.md +102 -83
  2. release_assets.json +14 -8
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -29,25 +29,26 @@ Below are pre-exported model assets ready for deployment.
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
- | ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-onnx-float.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.50, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-onnx-w8a8.zip)
34
- | QNN_DLC | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-qnn_dlc-float.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-qnn_dlc-w8a8.zip)
36
- | TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-tflite-float.zip)
 
37
 
38
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
39
 
40
 
41
  ### Option 2: Export with Custom Configurations
42
 
43
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
44
  - Custom weights (e.g., fine-tuned checkpoints)
45
  - Custom input shapes
46
  - Target device and runtime configurations
47
 
48
  This option is ideal if you need to customize the model beyond the default configuration provided here.
49
 
50
- See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.63.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
51
 
52
  ## Model Details
53
 
@@ -63,82 +64,100 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.588 ms | 0 - 65 MB | NPU
67
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.738 ms | 0 - 61 MB | NPU
68
- | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.591 ms | 1 - 1 MB | NPU
69
- | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.582 ms | 44 - 44 MB | NPU
70
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.074 ms | 0 - 107 MB | NPU
71
- | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 2.271 ms | 0 - 111 MB | NPU
72
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 1.714 ms | 0 - 4 MB | NPU
73
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.532 ms | 0 - 24 MB | NPU
74
- | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 2.271 ms | 0 - 111 MB | NPU
75
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 1.794 ms | 0 - 3 MB | NPU
76
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.582 ms | 44 - 44 MB | NPU
77
- | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.738 ms | 0 - 61 MB | NPU
78
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.668 ms | 0 - 64 MB | NPU
79
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.841 ms | 0 - 63 MB | NPU
80
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.681 ms | 1 - 1 MB | NPU
81
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.782 ms | 23 - 23 MB | NPU
82
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.215 ms | 0 - 91 MB | NPU
83
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.94 ms | 0 - 91 MB | NPU
84
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.723 ms | 0 - 3 MB | NPU
85
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.695 ms | 0 - 4 MB | NPU
86
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.721 ms | 0 - 26 MB | NPU
87
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.94 ms | 0 - 91 MB | NPU
88
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.841 ms | 0 - 3 MB | NPU
89
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.782 ms | 23 - 23 MB | NPU
90
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.436 ms | 0 - 65 MB | NPU
91
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.798 ms | 0 - 58 MB | NPU
92
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.841 ms | 0 - 63 MB | NPU
93
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.798 ms | 0 - 58 MB | NPU
94
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.405 ms | 0 - 62 MB | NPU
95
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.512 ms | 0 - 62 MB | NPU
96
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.609 ms | 0 - 0 MB | NPU
97
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.223 ms | 1 - 1 MB | NPU
98
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.729 ms | 0 - 98 MB | NPU
99
- | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.804 ms | 0 - 104 MB | NPU
100
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 1.262 ms | 0 - 3 MB | NPU
101
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.039 ms | 0 - 2 MB | NPU
102
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.415 ms | 0 - 63 MB | NPU
103
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.415 ms | 0 - 63 MB | NPU
104
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.415 ms | 0 - 63 MB | NPU
105
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.804 ms | 0 - 104 MB | NPU
106
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.309 ms | 0 - 2 MB | NPU
107
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.223 ms | 1 - 1 MB | NPU
108
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.512 ms | 0 - 62 MB | NPU
109
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA7255P | 3.457 ms | 0 - 62 MB | NPU
110
- | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.071 ms | 0 - 60 MB | NPU
111
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.682 ms | 0 - 55 MB | NPU
112
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.858 ms | 0 - 53 MB | NPU
113
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.808 ms | 0 - 0 MB | NPU
114
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.939 ms | 1 - 1 MB | NPU
115
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.224 ms | 0 - 75 MB | NPU
116
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.965 ms | 0 - 78 MB | NPU
117
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 3.955 ms | 0 - 2 MB | NPU
118
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.679 ms | 0 - 3 MB | NPU
119
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.752 ms | 0 - 1 MB | NPU
120
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.941 ms | 0 - 58 MB | NPU
121
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.941 ms | 0 - 58 MB | NPU
122
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.941 ms | 0 - 58 MB | NPU
123
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.965 ms | 0 - 78 MB | NPU
124
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.855 ms | 0 - 2 MB | NPU
125
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.939 ms | 1 - 1 MB | NPU
126
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.245 ms | 0 - 54 MB | NPU
127
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.732 ms | 0 - 52 MB | NPU
128
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.858 ms | 0 - 53 MB | NPU
129
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.444 ms | 0 - 54 MB | NPU
130
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.31 ms | 0 - 52 MB | NPU
131
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.732 ms | 0 - 52 MB | NPU
132
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.433 ms | 0 - 64 MB | NPU
133
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.538 ms | 0 - 70 MB | NPU
134
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.762 ms | 0 - 108 MB | NPU
135
- | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.899 ms | 0 - 104 MB | NPU
136
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 1.303 ms | 0 - 47 MB | NPU
137
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.061 ms | 0 - 2 MB | NPU
138
- | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.899 ms | 0 - 104 MB | NPU
139
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.326 ms | 0 - 46 MB | NPU
140
- | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.538 ms | 0 - 70 MB | NPU
141
- | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.157 ms | 0 - 59 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
142
 
143
  ## License
144
  * The license for the original implementation of MiniLM-v2 can be found
 
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-onnx-float.zip)
33
+ | ONNX | w8a8 | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-onnx-w8a8.zip)
34
+ | QNN_DLC | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-qnn_dlc-float.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-qnn_dlc-w8a8.zip)
36
+ | TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-tflite-float.zip)
37
+ | TFLITE | w8a8 | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-tflite-w8a8.zip)
38
 
39
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
40
 
41
 
42
  ### Option 2: Export with Custom Configurations
43
 
44
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
45
  - Custom weights (e.g., fine-tuned checkpoints)
46
  - Custom input shapes
47
  - Target device and runtime configurations
48
 
49
  This option is ideal if you need to customize the model beyond the default configuration provided here.
50
 
51
+ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.64.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
52
 
53
  ## Model Details
54
 
 
64
  ## Performance Summary
65
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
66
  |---|---|---|---|---|---|---
67
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.407 ms | 0 - 67 MB | NPU
68
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.508 ms | 0 - 64 MB | NPU
69
+ | MiniLM-v2 | ONNX | float | Snapdragon® X2 Elite | 0.42 ms | 1 - 1 MB | NPU
70
+ | MiniLM-v2 | ONNX | float | Snapdragon® X Elite | 1.056 ms | 44 - 44 MB | NPU
71
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 0.743 ms | 0 - 104 MB | NPU
72
+ | MiniLM-v2 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 1.812 ms | 0 - 107 MB | NPU
73
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 1.29 ms | 0 - 4 MB | NPU
74
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.039 ms | 0 - 2 MB | NPU
75
+ | MiniLM-v2 | ONNX | float | Qualcomm® QCS8450 | 1.812 ms | 0 - 107 MB | NPU
76
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 1.302 ms | 0 - 3 MB | NPU
77
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.056 ms | 44 - 44 MB | NPU
78
+ | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.508 ms | 0 - 64 MB | NPU
79
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.659 ms | 0 - 61 MB | NPU
80
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.829 ms | 0 - 57 MB | NPU
81
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.649 ms | 1 - 1 MB | NPU
82
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.774 ms | 23 - 23 MB | NPU
83
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.205 ms | 0 - 90 MB | NPU
84
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.91 ms | 0 - 88 MB | NPU
85
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.412 ms | 0 - 3 MB | NPU
86
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.661 ms | 0 - 4 MB | NPU
87
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.694 ms | 0 - 2 MB | NPU
88
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.91 ms | 0 - 88 MB | NPU
89
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.809 ms | 0 - 3 MB | NPU
90
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.774 ms | 23 - 23 MB | NPU
91
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.357 ms | 0 - 64 MB | NPU
92
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.77 ms | 0 - 57 MB | NPU
93
+ | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.829 ms | 0 - 57 MB | NPU
94
+ | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.77 ms | 0 - 57 MB | NPU
95
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.4 ms | 0 - 62 MB | NPU
96
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.507 ms | 0 - 64 MB | NPU
97
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.619 ms | 0 - 0 MB | NPU
98
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® X Elite | 1.205 ms | 1 - 1 MB | NPU
99
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 0.733 ms | 0 - 104 MB | NPU
100
+ | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 1.807 ms | 0 - 104 MB | NPU
101
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 1.255 ms | 0 - 3 MB | NPU
102
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.026 ms | 0 - 58 MB | NPU
103
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8775P | 1.41 ms | 0 - 63 MB | NPU
104
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8650P | 1.41 ms | 0 - 63 MB | NPU
105
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8255P | 1.41 ms | 0 - 63 MB | NPU
106
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® QCS8450 | 1.807 ms | 0 - 104 MB | NPU
107
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 1.309 ms | 0 - 2 MB | NPU
108
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 1.205 ms | 1 - 1 MB | NPU
109
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 0.507 ms | 0 - 64 MB | NPU
110
+ | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.062 ms | 0 - 60 MB | NPU
111
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.68 ms | 0 - 55 MB | NPU
112
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.849 ms | 0 - 57 MB | NPU
113
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.805 ms | 0 - 0 MB | NPU
114
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.916 ms | 1 - 1 MB | NPU
115
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.211 ms | 0 - 74 MB | NPU
116
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.934 ms | 0 - 75 MB | NPU
117
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 3.76 ms | 0 - 2 MB | NPU
118
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.648 ms | 0 - 3 MB | NPU
119
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.722 ms | 0 - 2 MB | NPU
120
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 1.926 ms | 0 - 57 MB | NPU
121
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 1.926 ms | 0 - 57 MB | NPU
122
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 1.926 ms | 0 - 57 MB | NPU
123
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.934 ms | 0 - 75 MB | NPU
124
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.82 ms | 0 - 2 MB | NPU
125
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.916 ms | 1 - 1 MB | NPU
126
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.14 ms | 0 - 54 MB | NPU
127
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.709 ms | 0 - 52 MB | NPU
128
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.849 ms | 0 - 57 MB | NPU
129
+ | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.251 ms | 0 - 52 MB | NPU
130
+ | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.709 ms | 0 - 52 MB | NPU
131
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.437 ms | 0 - 62 MB | NPU
132
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.539 ms | 0 - 71 MB | NPU
133
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.772 ms | 0 - 107 MB | NPU
134
+ | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 1.89 ms | 0 - 105 MB | NPU
135
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 1.305 ms | 0 - 47 MB | NPU
136
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.056 ms | 0 - 3 MB | NPU
137
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8775P | 1.457 ms | 0 - 66 MB | NPU
138
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8650P | 1.457 ms | 0 - 66 MB | NPU
139
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8255P | 1.457 ms | 0 - 66 MB | NPU
140
+ | MiniLM-v2 | TFLITE | float | Qualcomm® QCS8450 | 1.89 ms | 0 - 105 MB | NPU
141
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 1.323 ms | 0 - 46 MB | NPU
142
+ | MiniLM-v2 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 0.539 ms | 0 - 71 MB | NPU
143
+ | MiniLM-v2 | TFLITE | float | Qualcomm® SA8295P | 2.141 ms | 0 - 59 MB | NPU
144
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.849 ms | 0 - 56 MB | NPU
145
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.074 ms | 0 - 57 MB | NPU
146
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.524 ms | 0 - 77 MB | NPU
147
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.352 ms | 0 - 84 MB | NPU
148
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 16.469 ms | 0 - 32 MB | NPU
149
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.065 ms | 0 - 25 MB | NPU
150
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.151 ms | 0 - 2 MB | NPU
151
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.415 ms | 0 - 61 MB | NPU
152
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.415 ms | 0 - 61 MB | NPU
153
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.415 ms | 0 - 61 MB | NPU
154
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.352 ms | 0 - 84 MB | NPU
155
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.28 ms | 0 - 24 MB | NPU
156
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 12.133 ms | 0 - 50 MB | NPU
157
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 5.375 ms | 0 - 38 MB | NPU
158
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.074 ms | 0 - 57 MB | NPU
159
+ | MiniLM-v2 | TFLITE | w8a8 | Qualcomm® SA8295P | 2.848 ms | 0 - 52 MB | NPU
160
+ | MiniLM-v2 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 5.375 ms | 0 - 38 MB | NPU
161
 
162
  ## License
163
  * The license for the original implementation of MiniLM-v2 can be found
release_assets.json CHANGED
@@ -1,26 +1,26 @@
1
  {
2
- "version": "0.63.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
6
  "onnx": {
7
  "tool_versions": {
8
  "qairt": "2.50.0.260828221209",
9
- "onnx_runtime": "1.27.1"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.50.0.260828221209"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.50.0.260828221209"
22
  },
23
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
@@ -29,15 +29,21 @@
29
  "onnx": {
30
  "tool_versions": {
31
  "qairt": "2.50.0.260828221209",
32
- "onnx_runtime": "1.27.1"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.50.0.260828221209"
39
  },
40
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.63.0/minilm_v2-qnn_dlc-w8a8.zip"
 
 
 
 
 
 
41
  }
42
  }
43
  }
 
1
  {
2
+ "version": "0.64.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
6
  "onnx": {
7
  "tool_versions": {
8
  "qairt": "2.50.0.260828221209",
9
+ "onnx_runtime": "1.30.0"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.50.0.260828221209"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.50.0.260828221209"
22
  },
23
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-tflite-float.zip"
24
  }
25
  }
26
  },
 
29
  "onnx": {
30
  "tool_versions": {
31
  "qairt": "2.50.0.260828221209",
32
+ "onnx_runtime": "1.30.0"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-onnx-w8a8.zip"
35
  },
36
  "qnn_dlc": {
37
  "tool_versions": {
38
  "qairt": "2.50.0.260828221209"
39
  },
40
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-qnn_dlc-w8a8.zip"
41
+ },
42
+ "tflite": {
43
+ "tool_versions": {
44
+ "qairt": "2.50.0.260828221209"
45
+ },
46
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.64.0/minilm_v2-tflite-w8a8.zip"
47
  }
48
  }
49
  }