---
library_name: pytorch
license: other
tags:
- real_time
- qai-hub-models
- qualcomm
- android
pipeline_tag: text-to-audio
---

# NeuTTS-Nano: On-device text-to-speech language model with instant voice cloning

NeuTTS-Nano is a compact on-device text-to-speech language model from Neuphonic. It pairs a small Llama-family causal LM backbone with the NeuCodec 50Hz neural audio codec, and produces natural-sounding 24kHz speech with instant voice cloning from a short reference clip. The backbone exports as two graphs (a 128-token prefill and a single-token decode) linked into one weight-shared context binary; phonemization, prompt assembly, sampling and NeuCodec encode/decode run on CPU in the app.

This is based on the implementation of NeuTTS-Nano found [here](https://github.com/neuphonic/neutts).
This is a standalone recipe compatible with the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models) CLI — it can be installed, compiled, and evaluated on real Snapdragon devices via [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com).

Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.


## Setup
### 1. Install the package
Install the base package, fetch this recipe from Hugging Face, then use the
`qai-hub-models` CLI to install the recipe's dependencies:
```bash
# NOTE: 3.10 <= PYTHON_VERSION < 3.14 is supported.
pip install qai-hub-models
qai-hub-models register ashwmurt/neutts_nano
qai-hub-models install neutts_nano
```
`register` downloads the recipe and names it `neutts_nano`, which is how every
command below refers to it.


### 2. Configure Qualcomm® AI Hub Workbench
Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.

With this API token, you can configure your client to run models on the cloud
hosted devices.
```bash
qai-hub configure --api_token API_TOKEN
```
Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.

## Run CLI Demo
Run the following simple CLI demo to verify the model is working end to end:

```bash
qai-hub-models demo neutts_nano
```
More details on the CLI tool can be found with the `--help` option. See
[demo.py](demo.py) for sample usage of the model including pre/post processing
scripts.

## Export for on-device deployment
To run the model on Qualcomm® devices, you must export the model for use with an edge runtime such as
TensorFlow Lite, ONNX Runtime, or Qualcomm AI Engine Direct.
Use the following command to export the model:
```bash
qai-hub-models export neutts_nano --target-runtime qnn_context_binary --precision float --device "Samsung Galaxy S25 (Family)"
```
Additional options are documented with the `--help` option.

## License
* The license for the original implementation of NeuTTS-Nano can be found
  [here](https://github.com/neuphonic/neutts/blob/main/LICENSE).

## References
* [NeuCodec Neural Audio Codec for Speech Language Models](https://arxiv.org/abs/2509.09550)
* [Source Model Implementation](https://github.com/neuphonic/neutts)

## Community
* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).