--- license: apache-2.0 language: - ar - da - de - el - en - es - fi - fr - he - hi - it - ja - ko - ms - nl - no - pl - pt - ru - sv - sw - tr - zh base_model: - ResembleAI/chatterbox pipeline_tag: text-to-speech library_name: mlx-audio tags: - text-to-speech - speech - speech generation - voice cloning - mlx - tts --- # mlx-community/chatterbox-fp16 This model was converted to MLX format from [`ResembleAI/chatterbox`](https://huggingface.co/ResembleAI/chatterbox) using mlx-audio version **0.2.7**. Refer to the [original model card](https://huggingface.co/ResembleAI/chatterbox) for more details on the model. ## Use with mlx ```bash pip install -U mlx-audio ``` ### CLI Example: ```bash python -m mlx_audio.tts.generate --model mlx-community/chatterbox-fp16 --text "Hello, this is a test." ``` ### Python Example: ```python from mlx_audio.tts.utils import load_model from mlx_audio.tts.generate import generate_audio model = load_model("mlx-community/chatterbox-fp16") generate_audio( model=model, text="Hello, this is a test.", file_prefix="test_audio", ) ``` ### Voice Cloning: ```python from mlx_audio.tts.generate import generate_audio generate_audio( text="Hello, this is a test of Chatterbox TTS.", model="mlx-community/chatterbox-fp16", ref_audio="path_to_file.wav", ref_text="Text transcript", # Optional file_prefix="vc_output", ) ``` ## Multilingual Quickstart Generate speech in 23 languages by specifying the `lang_code` parameter. The model automatically handles pronunciation, intonation, and language-specific phonemes. ```python from mlx_audio.tts.generate import generate_audio generate_audio( text="Olá, tudo bem?", model="mlx-community/chatterbox-fp16", lang_code="pt", file_prefix="multilingual_output", ) ``` ### Supported Languages | Code | Language | Code | Language | Code | Language | |------|------------|------|------------|------|------------| | `ar` | Arabic | `he` | Hebrew | `no` | Norwegian | | `da` | Danish | `hi` | Hindi | `pl` | Polish | | `de` | German | `it` | Italian | `pt` | Portuguese | | `el` | Greek | `ja` | Japanese | `ru` | Russian | | `en` | English | `ko` | Korean | `sv` | Swedish | | `es` | Spanish | `ms` | Malay | `sw` | Swahili | | `fi` | Finnish | `nl` | Dutch | `tr` | Turkish | | `fr` | French | `zh` | Chinese | | |