chatterbox-en_us-unicode

A Chatterbox model by Resemble AI, from ResembleAI/chatterbox, packaged for phoonnx, our ONNX text-to-speech library.

Model details

Architecture Chatterbox
Upstream ResembleAI/chatterbox
ONNX conversion onnx-community/chatterbox-ONNX
Author Resemble AI
Languages en-US
Text input Unicode codepoints of the text

How to use

pip install --pre phoonnx
import wave
from phoonnx.model_manager import TTSModelManager

manager = TTSModelManager()
manager.load()
manager.merge_default_voices()

voice = manager.voices["chatterbox/base/en"].load()

with wave.open("output.wav", "wb") as wav_file:
    text = "..."  # a sentence in en-US
    voice.synthesize_wav(text, wav_file)

The voice clones a speaker from reference audio; the phoonnx README shows how to pass it.

In OVOS, phoonnx installs the ovos-tts-plugin-phoonnx plugin. Select the voice in mycroft.conf:

{"tts": {"module": "ovos-tts-plugin-phoonnx", "ovos-tts-plugin-phoonnx": {"voice": "chatterbox/base/en"}}}

Text front end

phoonnx hands the text to scriptconv, our text conversion library, which normalises it and turns it into the model's input:

  • unicode: UnicodeCodepointPhonemizer from scriptconv.phonemizers.base, in scriptconv itself.

phoonnx voices

  • chatterbox/base/en

Licence

The upstream declares the licence mit in the model card of ResembleAI/chatterbox.

Related projects

  • phoonnx: runs this model, in Python and in OVOS.
  • scriptconv: text normalisation, script conversion and phonemizers for phoonnx.
  • The Chatterbox collection: every Chatterbox model packaged for phoonnx.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including Phoonnx/chatterbox-en_us-unicode