File size: 2,454 Bytes
7523ad7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 | ---
license: mit
language:
- ar
- bg
- cs
- da
- de
- el
- en
- es
- fi
- fr
- he
- hi
- hu
- it
- ja
- ko
- ms
- nl
- "no"
- pl
- pt
- ro
- ru
- sk
- sv
- sw
- ta
- tr
- vi
- zh
library_name: phoonnx
pipeline_tag: text-to-speech
tags:
- tts
- chatterbox
- onnx
- phoonnx
- offline
- voice-cloning
- codec-lm
- multilingual
---
# phoonnx-chatterbox-multilingual
Mirror of the multilingual variant of [Chatterbox](https://github.com/resemble-ai/chatterbox)
by Resemble AI, exported to ONNX for
[phoonnx](https://github.com/TigreGotico/phoonnx), OpenVoiceOS's offline TTS
library, covering 30 languages from Arabic to Vietnamese. Like the base
model, this is an autoregressive codec-LM (Llama backbone) with zero-shot
cloning from an untranscribed reference clip and an `exaggeration` control.
See
[docs/training/engines/chatterbox.md](https://github.com/TigreGotico/phoonnx/blob/dev/docs/training/engines/chatterbox.md)
and [docs/cloning.md](https://github.com/TigreGotico/phoonnx/blob/dev/docs/cloning.md).
The multilingual variant uses its own `ChatterboxMTLTokenizer`. Japanese and
Chinese script normalization need
`pip install phoonnx[chatterbox-multilingual]` (pulls in `pykakasi` and
`spacy-pkuseg`); Korean normalization is pure-Python and always available;
Hebrew and Russian degrade gracefully when their optional
stressors/diacritizers are absent.
Related repositories: [phoonnx-chatterbox](https://huggingface.co/OpenVoiceOS/phoonnx-chatterbox)
(base English), [phoonnx-chatterbox-turbo](https://huggingface.co/OpenVoiceOS/phoonnx-chatterbox-turbo)
(faster GPT-2-based variant), [phoonnx-chatterbox-lahgtna](https://huggingface.co/OpenVoiceOS/phoonnx-chatterbox-lahgtna)
(Arabic dialects, fine-tuned from this model).
## Usage
Cloning support requires `pip install phoonnx[cloning]`.
```python
import wave
from phoonnx.model_manager import TTSModelManager
manager = TTSModelManager()
manager.load()
manager.merge_default_voices()
voice = manager.voices["chatterbox/multilingual/pt"].load()
with wave.open("out.wav", "wb") as wav_file:
voice.synthesize_wav(
"Olá, isto é um teste.",
wav_file,
speaker_reference="reference.wav", # optional: clone this speaker
)
```
## License
Resemble AI released Chatterbox Multilingual under the MIT license (see
[`onnx-community/chatterbox-multilingual-ONNX`](https://huggingface.co/onnx-community/chatterbox-multilingual-ONNX)).
`phoonnx` itself is Apache-2.0.
|