Hugging Face's logo

qualcomm
/
MeloTTS-EN

Text-to-Audio
PyTorch
real_time
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
f95254e
·
verified ·
1 Parent(s): 53d20fc

v0.48.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.48.0 for changelog.

Files changed (1) hide show
  1. README.md +133 -120
README.md CHANGED
@@ -15,7 +15,7 @@ pipeline_tag: text-to-audio
15
  MeloTTS is a high-quality multi-lingual text-to-speech library for English, Chinese and Spanish language.
16
 
17
  This is based on the implementation of MeloTTS-EN found [here](https://github.com/myshell-ai/MeloTTS).
18
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
@@ -28,37 +28,38 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_x_elite.zip)
32
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8gen3.zip)
33
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_qcs8550_proxy.zip)
34
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
35
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8_elite_gen5.zip)
36
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_x2_elite.zip)
37
- | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_qcs9075.zip)
38
- | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_x_elite.zip)
39
- | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8gen3.zip)
40
- | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs8275_proxy.zip)
41
- | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs8550_proxy.zip)
42
- | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_sa8775p.zip)
43
- | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
44
- | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8_elite_gen5.zip)
45
- | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_x2_elite.zip)
46
- | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_sa7255p.zip)
47
- | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.47.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs9075.zip)
 
48
 
49
  For more device-specific assets and performance metrics, visit **[MeloTTS-EN on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/melotts_en)**.
50
 
51
 
52
  ### Option 2: Export with Custom Configurations
53
 
54
- Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) Python library to compile and export the model with your own:
55
  - Custom weights (e.g., fine-tuned checkpoints)
56
  - Custom input shapes
57
  - Target device and runtime configurations
58
 
59
  This option is ideal if you need to customize the model beyond the default configuration provided here.
60
 
61
- See our repository for [MeloTTS-EN on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) for usage instructions.
62
 
63
  ## Model Details
64
 
@@ -83,108 +84,120 @@ See our repository for [MeloTTS-EN on GitHub](https://github.com/quic/ai-hub-mod
83
  ## Performance Summary
84
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
85
  |---|---|---|---|---|---|---
86
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 9.289 ms | 182 - 182 MB | NPU
87
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 7.12 ms | 1 - 13 MB | NPU
88
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 8.826 ms | 0 - 193 MB | NPU
89
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 9.159 ms | 1 - 4 MB | NPU
90
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 5.65 ms | 1 - 9 MB | NPU
91
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 4.764 ms | 1 - 11 MB | NPU
92
- | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 5.001 ms | 182 - 182 MB | NPU
93
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 9.376 ms | 0 - 0 MB | NPU
94
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 7.212 ms | 0 - 7 MB | NPU
95
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 19.752 ms | 0 - 7 MB | NPU
96
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 8.934 ms | 0 - 1 MB | NPU
97
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 9.674 ms | 0 - 9 MB | NPU
98
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 9.389 ms | 0 - 2 MB | NPU
99
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 19.752 ms | 0 - 7 MB | NPU
100
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 5.681 ms | 0 - 13 MB | NPU
101
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 4.8 ms | 0 - 10 MB | NPU
102
- | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 5.437 ms | 0 - 0 MB | NPU
103
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 76.548 ms | 18 - 18 MB | NPU
104
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 56.623 ms | 0 - 7 MB | NPU
105
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 78.789 ms | 0 - 21 MB | NPU
106
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 76.378 ms | 0 - 3 MB | NPU
107
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 47.136 ms | 1 - 12 MB | NPU
108
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 40.927 ms | 0 - 10 MB | NPU
109
- | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 38.65 ms | 20 - 20 MB | NPU
110
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 76.912 ms | 0 - 0 MB | NPU
111
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 57.204 ms | 0 - 7 MB | NPU
112
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 127.255 ms | 0 - 8 MB | NPU
113
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 78.325 ms | 6 - 8 MB | NPU
114
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 77.601 ms | 0 - 9 MB | NPU
115
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 77.083 ms | 0 - 2 MB | NPU
116
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 127.255 ms | 0 - 8 MB | NPU
117
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 47.511 ms | 0 - 13 MB | NPU
118
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 40.918 ms | 0 - 10 MB | NPU
119
- | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 38.27 ms | 0 - 0 MB | NPU
120
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 33.025 ms | 13 - 13 MB | NPU
121
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 24.538 ms | 4 - 11 MB | NPU
122
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 34.791 ms | 0 - 17 MB | NPU
123
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 39.331 ms | 4 - 6 MB | NPU
124
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 21.025 ms | 3 - 14 MB | NPU
125
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 17.649 ms | 4 - 14 MB | NPU
126
- | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 19.545 ms | 14 - 14 MB | NPU
127
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 32.963 ms | 4 - 4 MB | NPU
128
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 24.82 ms | 4 - 11 MB | NPU
129
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 77.683 ms | 2 - 10 MB | NPU
130
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 33.495 ms | 4 - 5 MB | NPU
131
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 39.323 ms | 2 - 11 MB | NPU
132
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 39.55 ms | 4 - 9 MB | NPU
133
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 77.683 ms | 2 - 10 MB | NPU
134
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 20.276 ms | 2 - 15 MB | NPU
135
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 17.698 ms | 4 - 13 MB | NPU
136
- | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 19.776 ms | 4 - 4 MB | NPU
137
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 147.711 ms | 30 - 30 MB | NPU
138
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 118.758 ms | 6 - 13 MB | NPU
139
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 153.543 ms | 0 - 37 MB | NPU
140
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 149.547 ms | 4 - 10 MB | NPU
141
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 101.733 ms | 3 - 15 MB | NPU
142
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 90.911 ms | 6 - 16 MB | NPU
143
- | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 84.778 ms | 31 - 31 MB | NPU
144
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 147.574 ms | 4 - 4 MB | NPU
145
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 120.762 ms | 4 - 12 MB | NPU
146
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 278.995 ms | 1 - 10 MB | NPU
147
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 159.12 ms | 4 - 6 MB | NPU
148
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 150.718 ms | 1 - 10 MB | NPU
149
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 149.802 ms | 4 - 10 MB | NPU
150
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 278.995 ms | 1 - 10 MB | NPU
151
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 103.043 ms | 3 - 16 MB | NPU
152
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 90.853 ms | 4 - 13 MB | NPU
153
- | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 84.891 ms | 4 - 4 MB | NPU
154
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 0.482 ms | 10 - 10 MB | NPU
155
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.329 ms | 0 - 7 MB | NPU
156
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.435 ms | 0 - 12 MB | NPU
157
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 0.563 ms | 1 - 4 MB | NPU
158
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.284 ms | 0 - 12 MB | NPU
159
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.27 ms | 0 - 10 MB | NPU
160
- | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 0.228 ms | 10 - 10 MB | NPU
161
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 0.451 ms | 1 - 1 MB | NPU
162
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.317 ms | 0 - 7 MB | NPU
163
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 0.984 ms | 0 - 9 MB | NPU
164
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.402 ms | 0 - 2 MB | NPU
165
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 0.666 ms | 0 - 5 MB | NPU
 
 
 
 
 
 
 
 
 
166
  | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 0.515 ms | 1 - 3 MB | NPU
167
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 0.984 ms | 0 - 9 MB | NPU
168
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.27 ms | 0 - 13 MB | NPU
169
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.271 ms | 0 - 10 MB | NPU
170
- | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 0.362 ms | 1 - 1 MB | NPU
171
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 1.011 ms | 29 - 29 MB | NPU
172
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.62 ms | 0 - 6 MB | NPU
173
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.855 ms | 0 - 34 MB | NPU
174
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 1.109 ms | 0 - 3 MB | NPU
175
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.508 ms | 0 - 7 MB | NPU
176
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.502 ms | 0 - 10 MB | NPU
177
- | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 0.502 ms | 29 - 29 MB | NPU
178
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 1.01 ms | 0 - 0 MB | NPU
179
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.603 ms | 0 - 7 MB | NPU
180
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 2.763 ms | 0 - 8 MB | NPU
181
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.821 ms | 0 - 1 MB | NPU
182
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 1.251 ms | 0 - 9 MB | NPU
183
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 1.079 ms | 0 - 2 MB | NPU
184
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 2.763 ms | 0 - 8 MB | NPU
185
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.536 ms | 0 - 13 MB | NPU
 
 
 
 
186
  | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.486 ms | 0 - 10 MB | NPU
187
- | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 0.657 ms | 0 - 0 MB | NPU
188
 
189
  ## License
190
  * The license for the original implementation of MeloTTS-EN can be found
 
15
  MeloTTS is a high-quality multi-lingual text-to-speech library for English, Chinese and Spanish language.
16
 
17
  This is based on the implementation of MeloTTS-EN found [here](https://github.com/myshell-ai/MeloTTS).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_x2_elite.zip)
32
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_x_elite.zip)
33
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8gen3.zip)
34
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_qcs8550_proxy.zip)
35
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
36
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_snapdragon_8_elite_gen5.zip)
37
+ | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-precompiled_qnn_onnx-mixed_with_float-qualcomm_qcs9075.zip)
38
+ | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_x2_elite.zip)
39
+ | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_x_elite.zip)
40
+ | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8gen3.zip)
41
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs8550_proxy.zip)
42
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_sa8775p.zip)
43
+ | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
44
+ | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_snapdragon_8_elite_gen5.zip)
45
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_sa7255p.zip)
46
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_sa8295p.zip)
47
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs9075.zip)
48
+ | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/melotts_en/releases/v0.48.0/melotts_en-qnn_context_binary-mixed_with_float-qualcomm_qcs8450_proxy.zip)
49
 
50
  For more device-specific assets and performance metrics, visit **[MeloTTS-EN on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/melotts_en)**.
51
 
52
 
53
  ### Option 2: Export with Custom Configurations
54
 
55
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) Python library to compile and export the model with your own:
56
  - Custom weights (e.g., fine-tuned checkpoints)
57
  - Custom input shapes
58
  - Target device and runtime configurations
59
 
60
  This option is ideal if you need to customize the model beyond the default configuration provided here.
61
 
62
+ See our repository for [MeloTTS-EN on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/melotts_en) for usage instructions.
63
 
64
  ## Model Details
65
 
 
84
  ## Performance Summary
85
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
86
  |---|---|---|---|---|---|---
87
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 3.062 ms | 183 - 183 MB | NPU
88
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 7.288 ms | 182 - 182 MB | NPU
89
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 4.734 ms | 1 - 8 MB | NPU
90
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 6.745 ms | 0 - 194 MB | NPU
91
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 8.899 ms | 1 - 4 MB | NPU
92
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 3.461 ms | 0 - 7 MB | NPU
93
+ | BertWrapper_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 2.714 ms | 0 - 10 MB | NPU
94
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 3.374 ms | 0 - 0 MB | NPU
95
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 7.327 ms | 0 - 0 MB | NPU
96
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 4.704 ms | 0 - 7 MB | NPU
97
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 30.053 ms | 0 - 7 MB | NPU
98
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 6.769 ms | 0 - 1 MB | NPU
99
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 9.114 ms | 0 - 8 MB | NPU
100
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 8.827 ms | 0 - 2 MB | NPU
101
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 10.237 ms | 0 - 9 MB | NPU
102
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 30.053 ms | 0 - 7 MB | NPU
103
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 11.27 ms | 0 - 5 MB | NPU
104
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 3.456 ms | 0 - 12 MB | NPU
105
+ | BertWrapper_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 2.725 ms | 0 - 9 MB | NPU
106
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 38.71 ms | 20 - 20 MB | NPU
107
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 76.522 ms | 18 - 18 MB | NPU
108
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 56.839 ms | 1 - 7 MB | NPU
109
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 78.798 ms | 0 - 21 MB | NPU
110
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 76.877 ms | 0 - 3 MB | NPU
111
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 47.04 ms | 0 - 12 MB | NPU
112
+ | Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 40.966 ms | 0 - 10 MB | NPU
113
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 39.134 ms | 0 - 0 MB | NPU
114
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 76.994 ms | 0 - 0 MB | NPU
115
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 57.409 ms | 0 - 7 MB | NPU
116
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 127.389 ms | 0 - 9 MB | NPU
117
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 78.423 ms | 0 - 2 MB | NPU
118
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 77.581 ms | 0 - 9 MB | NPU
119
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 77.169 ms | 0 - 2 MB | NPU
120
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 106.765 ms | 1 - 9 MB | NPU
121
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 127.389 ms | 0 - 9 MB | NPU
122
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 92.988 ms | 0 - 6 MB | NPU
123
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 47.042 ms | 0 - 13 MB | NPU
124
+ | Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 40.965 ms | 0 - 10 MB | NPU
125
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 19.323 ms | 14 - 14 MB | NPU
126
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 32.501 ms | 13 - 13 MB | NPU
127
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 25.112 ms | 4 - 11 MB | NPU
128
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 33.52 ms | 0 - 17 MB | NPU
129
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 39.569 ms | 4 - 6 MB | NPU
130
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 20.836 ms | 3 - 14 MB | NPU
131
+ | Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 17.624 ms | 4 - 14 MB | NPU
132
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 19.513 ms | 4 - 4 MB | NPU
133
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 32.986 ms | 4 - 4 MB | NPU
134
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 24.663 ms | 4 - 11 MB | NPU
135
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 77.479 ms | 2 - 9 MB | NPU
136
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 34.439 ms | 4 - 5 MB | NPU
137
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 39.495 ms | 2 - 11 MB | NPU
138
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 39.359 ms | 6 - 11 MB | NPU
139
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 47.655 ms | 4 - 13 MB | NPU
140
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 77.479 ms | 2 - 9 MB | NPU
141
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 44.123 ms | 1 - 7 MB | NPU
142
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 20.819 ms | 2 - 10 MB | NPU
143
+ | Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 17.985 ms | 4 - 13 MB | NPU
144
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 85.052 ms | 31 - 31 MB | NPU
145
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 148.138 ms | 30 - 30 MB | NPU
146
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 120.556 ms | 6 - 13 MB | NPU
147
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 159.598 ms | 0 - 37 MB | NPU
148
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 149.576 ms | 4 - 10 MB | NPU
149
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 102.565 ms | 4 - 10 MB | NPU
150
+ | Flow_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 90.727 ms | 6 - 16 MB | NPU
151
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 85.758 ms | 4 - 4 MB | NPU
152
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 147.469 ms | 4 - 4 MB | NPU
153
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 118.908 ms | 4 - 11 MB | NPU
154
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 279.008 ms | 1 - 10 MB | NPU
155
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 154.682 ms | 4 - 5 MB | NPU
156
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 150.719 ms | 1 - 10 MB | NPU
157
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 149.895 ms | 4 - 10 MB | NPU
158
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 173.652 ms | 4 - 13 MB | NPU
159
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 279.008 ms | 1 - 10 MB | NPU
160
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 188.643 ms | 0 - 5 MB | NPU
161
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 101.096 ms | 3 - 12 MB | NPU
162
+ | Flow_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 91.237 ms | 4 - 14 MB | NPU
163
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 0.218 ms | 10 - 10 MB | NPU
164
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 0.479 ms | 10 - 10 MB | NPU
165
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.323 ms | 0 - 7 MB | NPU
166
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.43 ms | 0 - 12 MB | NPU
167
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 0.579 ms | 1 - 4 MB | NPU
168
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.335 ms | 0 - 7 MB | NPU
169
+ | T5Decoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.268 ms | 0 - 10 MB | NPU
170
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 0.406 ms | 1 - 1 MB | NPU
171
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 0.433 ms | 1 - 1 MB | NPU
172
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.306 ms | 0 - 7 MB | NPU
173
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 0.992 ms | 0 - 8 MB | NPU
174
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.398 ms | 1 - 2 MB | NPU
175
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 0.67 ms | 0 - 5 MB | NPU
176
  | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 0.515 ms | 1 - 3 MB | NPU
177
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 0.584 ms | 1 - 9 MB | NPU
178
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 0.992 ms | 0 - 8 MB | NPU
179
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 0.818 ms | 0 - 5 MB | NPU
180
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.269 ms | 0 - 9 MB | NPU
181
+ | T5Decoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.257 ms | 0 - 10 MB | NPU
182
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X2 Elite | 0.481 ms | 29 - 29 MB | NPU
183
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® X Elite | 1.016 ms | 29 - 29 MB | NPU
184
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.621 ms | 0 - 7 MB | NPU
185
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.853 ms | 0 - 33 MB | NPU
186
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Qualcomm® QCS9075 | 1.096 ms | 0 - 3 MB | NPU
187
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.524 ms | 0 - 7 MB | NPU
188
+ | T5Encoder_EN | PRECOMPILED_QNN_ONNX | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.51 ms | 0 - 10 MB | NPU
189
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X2 Elite | 0.63 ms | 0 - 0 MB | NPU
190
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® X Elite | 0.983 ms | 0 - 0 MB | NPU
191
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Gen 3 Mobile | 0.606 ms | 0 - 7 MB | NPU
192
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8275 (Proxy) | 2.763 ms | 0 - 9 MB | NPU
193
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8550 (Proxy) | 0.823 ms | 0 - 2 MB | NPU
194
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8775P | 1.243 ms | 0 - 6 MB | NPU
195
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS9075 | 1.075 ms | 0 - 2 MB | NPU
196
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® QCS8450 (Proxy) | 1.348 ms | 0 - 9 MB | NPU
197
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA7255P | 2.763 ms | 0 - 9 MB | NPU
198
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Qualcomm® SA8295P | 1.711 ms | 0 - 5 MB | NPU
199
+ | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite For Galaxy Mobile | 0.509 ms | 0 - 13 MB | NPU
200
  | T5Encoder_EN | QNN_CONTEXT_BINARY | mixed_with_float | Snapdragon® 8 Elite Gen 5 Mobile | 0.486 ms | 0 - 10 MB | NPU
 
201
 
202
  ## License
203
  * The license for the original implementation of MeloTTS-EN can be found