Text-to-Speech
ONNX
GGUF
Chinese
English
onnxruntime
tts
on-device
jetson
telephony
vits
mb-istft-vits
multi-speaker
mandarin
taiwanese-mandarin
imatrix
conversational
Instructions to use Luigi/PrimeTTS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Luigi/PrimeTTS with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luigi/PrimeTTS:F32 # Run inference directly in the terminal: llama cli -hf Luigi/PrimeTTS:F32
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luigi/PrimeTTS:F32 # Run inference directly in the terminal: llama cli -hf Luigi/PrimeTTS:F32
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Luigi/PrimeTTS:F32 # Run inference directly in the terminal: ./llama-cli -hf Luigi/PrimeTTS:F32
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Luigi/PrimeTTS:F32 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Luigi/PrimeTTS:F32
Use Docker
docker model run hf.co/Luigi/PrimeTTS:F32
- LM Studio
- Jan
- Ollama
How to use Luigi/PrimeTTS with Ollama:
ollama run hf.co/Luigi/PrimeTTS:F32
- Unsloth Studio
How to use Luigi/PrimeTTS with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luigi/PrimeTTS to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luigi/PrimeTTS to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Luigi/PrimeTTS to start chatting
- Docker Model Runner
How to use Luigi/PrimeTTS with Docker Model Runner:
docker model run hf.co/Luigi/PrimeTTS:F32
- Lemonade
How to use Luigi/PrimeTTS with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Luigi/PrimeTTS:F32
Run and chat with the model
lemonade run user.PrimeTTS-F32
List all available models
lemonade list
- Atomic Chat
| # PrimeTTS v2-Stream-Clean — token-level streaming, v2-clean audio | |
| The definitive streaming variant: **token-level band-attention encoder** (input | |
| streams incrementally) **+ v2's non-causal clean vocoder** (no parasite noise). | |
| Reconciles token-level input streaming with clean audio — the causal v2-Stream | |
| sacrificed quality unnecessarily; this doesn't. | |
| - `v2streamclean_enc.onnx` — text (x,tone,lang,x_lengths,noise_scale,length_scale) → z[1,192,T]. Band encoder, token-level. Run **once** per phrase. | |
| - `v2streamclean_dec.onnx` — z[1,192,Tc] → wav[1,1,Tc·256]. Clean non-causal vocoder. Run **per chunk**, overlap-save. | |
| - `onnx_stream.py` — reference runner (uses the right params). | |
| **Streaming params: chunk = 24, left = 64, RIGHT = 16** (the clean non-causal | |
| vocoder needs 16 future frames for bit-exact chunking; the causal one used 4). | |
| 16 kHz, zh-TW + English. | |
| ```python | |
| from onnx_stream import StreamingTTS # RIGHT=16 baked in | |
| tts = StreamingTTS("v2streamclean_enc.onnx", "v2streamclean_dec.onnx") | |
| z = tts.encode(phone_ids, tone_ids, lang_ids) # once | |
| for pcm in tts.stream(z): play(pcm) # per 24-frame chunk, clean audio | |
| ``` | |
| Frontend (text→ids): g2pw bopomofo + g2p_en, 88 syms/6 tones/2 langs, add_blank. | |
| sherpa-onnx: `OfflineTtsMbistftStreamModel(enc, dec, num_threads=2, right_lookahead=16)`. | |
| License: Apache-2.0 · part of [Luigi/PrimeTTS](https://huggingface.co/Luigi/PrimeTTS). | |