qaihm-bot commited on
Commit
8e185ed
·
verified ·
1 Parent(s): c1164a0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +27 -18
README.md CHANGED
@@ -15,7 +15,7 @@ tags:
15
 
16
  HuggingFaceWavLMBasePlus is a real time speech processing backbone based on Microsoft's WavLM model.
17
 
18
- This model is an implementation of HuggingFace-WavLM-Base-Plus found [here](https://huggingface.co/patrickvonplaten/wavlm-libri-clean-100h-base-plus/tree/main).
19
  This repository provides scripts to run HuggingFace-WavLM-Base-Plus on Qualcomm® devices.
20
  More details on model performance across various devices, can be found
21
  [here](https://aihub.qualcomm.com/models/huggingface_wavlm_base_plus).
@@ -30,14 +30,19 @@ More details on model performance across various devices, can be found
30
  - Number of parameters: 95.1M
31
  - Model size: 363 MB
32
 
 
 
 
 
 
 
 
 
 
 
33
 
34
 
35
 
36
- | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
- | ---|---|---|---|---|---|---|---|
38
- | Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 957.88 ms | 63 - 66 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite)
39
-
40
-
41
 
42
  ## Installation
43
 
@@ -93,16 +98,16 @@ device. This script does the following:
93
  ```bash
94
  python -m qai_hub_models.models.huggingface_wavlm_base_plus.export
95
  ```
96
-
97
  ```
98
- Profile Job summary of HuggingFace-WavLM-Base-Plus
99
- --------------------------------------------------
100
- Device: SA8255 (Proxy) (13)
101
- Estimated Inference Time: 897.01 ms
102
- Estimated Peak Memory Range: 62.55-99.95 MB
103
- Compute Units: CPU (871) | Total (871)
104
-
105
-
 
106
  ```
107
 
108
 
@@ -187,15 +192,19 @@ provides instructions on how to use the `.so` shared library in an Android appl
187
  Get more details on HuggingFace-WavLM-Base-Plus's performance across various devices [here](https://aihub.qualcomm.com/models/huggingface_wavlm_base_plus).
188
  Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
189
 
 
190
  ## License
191
- - The license for the original implementation of HuggingFace-WavLM-Base-Plus can be found
192
- [here](https://github.com/microsoft/unilm/blob/master/LICENSE).
193
- - The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
 
194
 
195
  ## References
196
  * [WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing](https://arxiv.org/abs/2110.13900)
197
  * [Source Model Implementation](https://huggingface.co/patrickvonplaten/wavlm-libri-clean-100h-base-plus/tree/main)
198
 
 
 
199
  ## Community
200
  * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
201
  * For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).
 
15
 
16
  HuggingFaceWavLMBasePlus is a real time speech processing backbone based on Microsoft's WavLM model.
17
 
18
+ This model is an implementation of HuggingFace-WavLM-Base-Plus found [here]({source_repo}).
19
  This repository provides scripts to run HuggingFace-WavLM-Base-Plus on Qualcomm® devices.
20
  More details on model performance across various devices, can be found
21
  [here](https://aihub.qualcomm.com/models/huggingface_wavlm_base_plus).
 
30
  - Number of parameters: 95.1M
31
  - Model size: 363 MB
32
 
33
+ | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
34
+ |---|---|---|---|---|---|---|---|---|
35
+ | HuggingFace-WavLM-Base-Plus | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 817.718 ms | 63 - 65 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
36
+ | HuggingFace-WavLM-Base-Plus | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 631.561 ms | 63 - 84 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
37
+ | HuggingFace-WavLM-Base-Plus | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 849.395 ms | 58 - 602 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
38
+ | HuggingFace-WavLM-Base-Plus | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 850.762 ms | 63 - 65 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
39
+ | HuggingFace-WavLM-Base-Plus | SA8775 (Proxy) | SA8775P Proxy | TFLITE | 846.763 ms | 63 - 65 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
40
+ | HuggingFace-WavLM-Base-Plus | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 889.799 ms | 63 - 66 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
41
+ | HuggingFace-WavLM-Base-Plus | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 1305.119 ms | 63 - 89 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
42
+ | HuggingFace-WavLM-Base-Plus | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 568.662 ms | 63 - 78 MB | FP32 | CPU | [HuggingFace-WavLM-Base-Plus.tflite](https://huggingface.co/qualcomm/HuggingFace-WavLM-Base-Plus/blob/main/HuggingFace-WavLM-Base-Plus.tflite) |
43
 
44
 
45
 
 
 
 
 
 
46
 
47
  ## Installation
48
 
 
98
  ```bash
99
  python -m qai_hub_models.models.huggingface_wavlm_base_plus.export
100
  ```
 
101
  ```
102
+ Profiling Results
103
+ ------------------------------------------------------------
104
+ HuggingFace-WavLM-Base-Plus
105
+ Device : Samsung Galaxy S23 (13)
106
+ Runtime : TFLITE
107
+ Estimated inference time (ms) : 817.7
108
+ Estimated peak memory usage (MB): [63, 65]
109
+ Total # Ops : 871
110
+ Compute Unit(s) : CPU (871 ops)
111
  ```
112
 
113
 
 
192
  Get more details on HuggingFace-WavLM-Base-Plus's performance across various devices [here](https://aihub.qualcomm.com/models/huggingface_wavlm_base_plus).
193
  Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
194
 
195
+
196
  ## License
197
+ * The license for the original implementation of HuggingFace-WavLM-Base-Plus can be found [here](https://github.com/microsoft/unilm/blob/master/LICENSE).
198
+ * The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
199
+
200
+
201
 
202
  ## References
203
  * [WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing](https://arxiv.org/abs/2110.13900)
204
  * [Source Model Implementation](https://huggingface.co/patrickvonplaten/wavlm-libri-clean-100h-base-plus/tree/main)
205
 
206
+
207
+
208
  ## Community
209
  * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
210
  * For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).