Hugging Face's logo

qualcomm
/
MeloTTS-EN

Text-to-Audio
PyTorch
real_time
android
Model card Files
xet
Community

MeloTTS-EN: Optimized for Qualcomm Devices

MeloTTS is a high-quality multi-lingual text-to-speech library for English, Chinese and Spanish language.

This is based on the implementation of MeloTTS-EN found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.42, ONNX Runtime 1.24.1 Download
PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 QAIRT 2.42, ONNX Runtime 1.24.1 Download
QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 QAIRT 2.43 Download
QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) QAIRT 2.43 Download

For more device-specific assets and performance metrics, visit MeloTTS-EN on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for MeloTTS-EN on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.audio_generation

Model Stats:

  • Model checkpoint: myshell-ai/MeloTTS-English
  • Max decoded sequence length: 512 tokens
  • Number of parameters (Encoder_EN): 8.30M
  • Model size (Encoder_EN) (float): 31.8 MB
  • Number of parameters (Flow_EN): 20.1M
  • Model size (Flow_EN) (float): 76.9 MB
  • Number of parameters (Decoder_EN): 14.5M
  • Model size (Decoder_EN) (float): 55.5 MB
  • Number of parameters (BertWrapper_EN): 94.5M
  • Model size (BertWrapper_EN) (float): 360 MB
  • Number of parameters (T5Encoder_EN): 15.1M
  • Model size (T5Encoder_EN) (float): 57.5 MB
  • Number of parameters (T5Decoder_EN): 5.72M
  • Model size (T5Decoder_EN) (float): 21.8 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 3.062 ms 183 - 183 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 7.288 ms 182 - 182 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.734 ms 1 - 8 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 6.745 ms 0 - 194 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 8.899 ms 1 - 4 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.461 ms 0 - 7 MB NPU
BertWrapper_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 2.714 ms 0 - 10 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 3.374 ms 0 - 0 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 7.327 ms 0 - 0 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.704 ms 0 - 7 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 30.053 ms 0 - 7 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 6.769 ms 0 - 1 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 9.114 ms 0 - 8 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 8.827 ms 0 - 2 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 10.237 ms 0 - 9 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 30.053 ms 0 - 7 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 11.27 ms 0 - 5 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.456 ms 0 - 12 MB NPU
BertWrapper_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 2.725 ms 0 - 9 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 38.71 ms 20 - 20 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 76.522 ms 18 - 18 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 56.839 ms 1 - 7 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 78.798 ms 0 - 21 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 76.877 ms 0 - 3 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 47.04 ms 0 - 12 MB NPU
Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 40.966 ms 0 - 10 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 39.134 ms 0 - 0 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 76.994 ms 0 - 0 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 57.409 ms 0 - 7 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 127.389 ms 0 - 9 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 78.423 ms 0 - 2 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 77.581 ms 0 - 9 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 77.169 ms 0 - 2 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 106.765 ms 1 - 9 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 127.389 ms 0 - 9 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 92.988 ms 0 - 6 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 47.042 ms 0 - 13 MB NPU
Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 40.965 ms 0 - 10 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 19.323 ms 14 - 14 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 32.501 ms 13 - 13 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 25.112 ms 4 - 11 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 33.52 ms 0 - 17 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 39.569 ms 4 - 6 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 20.836 ms 3 - 14 MB NPU
Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 17.624 ms 4 - 14 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 19.513 ms 4 - 4 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 32.986 ms 4 - 4 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 24.663 ms 4 - 11 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 77.479 ms 2 - 9 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 34.439 ms 4 - 5 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 39.495 ms 2 - 11 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 39.359 ms 6 - 11 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 47.655 ms 4 - 13 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 77.479 ms 2 - 9 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 44.123 ms 1 - 7 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 20.819 ms 2 - 10 MB NPU
Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 17.985 ms 4 - 13 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 85.052 ms 31 - 31 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 148.138 ms 30 - 30 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 120.556 ms 6 - 13 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 159.598 ms 0 - 37 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 149.576 ms 4 - 10 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 102.565 ms 4 - 10 MB NPU
Flow_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 90.727 ms 6 - 16 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 85.758 ms 4 - 4 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 147.469 ms 4 - 4 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 118.908 ms 4 - 11 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 279.008 ms 1 - 10 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 154.682 ms 4 - 5 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 150.719 ms 1 - 10 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 149.895 ms 4 - 10 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 173.652 ms 4 - 13 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 279.008 ms 1 - 10 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 188.643 ms 0 - 5 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 101.096 ms 3 - 12 MB NPU
Flow_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 91.237 ms 4 - 14 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 0.218 ms 10 - 10 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 0.479 ms 10 - 10 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.323 ms 0 - 7 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 0.43 ms 0 - 12 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 0.579 ms 1 - 4 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.335 ms 0 - 7 MB NPU
T5Decoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.268 ms 0 - 10 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 0.406 ms 1 - 1 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 0.433 ms 1 - 1 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.306 ms 0 - 7 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 0.992 ms 0 - 8 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 0.398 ms 1 - 2 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 0.67 ms 0 - 5 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 0.515 ms 1 - 3 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 0.584 ms 1 - 9 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 0.992 ms 0 - 8 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 0.818 ms 0 - 5 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.269 ms 0 - 9 MB NPU
T5Decoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.257 ms 0 - 10 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X2 Elite 0.481 ms 29 - 29 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® X Elite 1.016 ms 29 - 29 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.621 ms 0 - 7 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS8550 (Proxy) 0.853 ms 0 - 33 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Qualcomm® QCS9075 1.096 ms 0 - 3 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.524 ms 0 - 7 MB NPU
T5Encoder_EN PRECOMPILED_QNN_ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.51 ms 0 - 10 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X2 Elite 0.63 ms 0 - 0 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® X Elite 0.983 ms 0 - 0 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.606 ms 0 - 7 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8275 (Proxy) 2.763 ms 0 - 9 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8550 (Proxy) 0.823 ms 0 - 2 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8775P 1.243 ms 0 - 6 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS9075 1.075 ms 0 - 2 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® QCS8450 (Proxy) 1.348 ms 0 - 9 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA7255P 2.763 ms 0 - 9 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Qualcomm® SA8295P 1.711 ms 0 - 5 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 0.509 ms 0 - 13 MB NPU
T5Encoder_EN QNN_CONTEXT_BINARY mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.486 ms 0 - 10 MB NPU

License

  • The license for the original implementation of MeloTTS-EN can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Text-to-Audio
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support