README.md

metadata

title: PrimeTTS Streaming
emoji: 🔊
colorFrom: green
colorTo: indigo
sdk: docker
app_port: 7860
pinned: false
short_description: Real-time streaming zh-TW + English TTS (torch-free)
models:
  - Luigi/PrimeTTS
  - unsloth/gemma-3-270m-it-GGUF
  - 52AI/tinyllamas_zh

PrimeTTS · real-time streaming TTS

Type text, hear audio stream chunk-by-chunk (24 frames ≈ 384 ms each) — first sound in ~100 ms instead of waiting for the whole utterance.

• Model: token-level MB-iSTFT-VITS (band-attention encoder + causal vocoder), split into enc (text→z, once) + dec (z-chunk→audio, per chunk, overlap-save).
• Backend: sherpa-onnx fork OfflineTtsMbistftStreamModel (C++/ONNX Runtime), bit-exact to the reference.
• Frontend: g2pw (bopomofo, Taiwan readings) + g2p_en — torch-free (ONNX Runtime only).
• UI: FastAPI + WebSocket + Web Audio API (PCM chunks played as they arrive).

zh-TW + English, 16 kHz.