Flex-TTS / README.md
FroxAI's picture
Update README.md
5c96cc1 verified
|
Raw History Blame Contribute Delete
3.08 kB

title: FroxAI Flex-Audio emoji: 🦊 colorFrom: purple colorTo: pink sdk: gradio sdk_version: 5.9.1 app_file: app.py pinned: false pipeline_tag: text-to-speech license: other license_name: proprietary

🦊 FroxAI β€” Flex-Audio

Fine-tuned "XTTS-v2" (https://huggingface.co/coqui/XTTS-v2) text-to-speech model with real voice cloning, built by FroxAI.

πŸŽ™οΈ Demo

The repository includes a Gradio application in "app.py" with:

  • Text input
  • Language selection
  • Voice selection
  • Generated WAV output
  • Clickable demo examples

Run the demo

python app.py

Β«Hugging Face: A model repository does not automatically execute "app.py" on its main page. The interactive model-page widget is available only when the model/task is supported by an Inference Provider. For this custom Gradio interface, deploy "app.py" as a Hugging Face Space to let visitors test it directly in a browser.Β»

What's included

  • "model.pth" β€” fine-tuned model weights
  • "config.json" β€” base XTTS-v2 configuration required to reload the model
  • "vocab.json" β€” base model vocabulary required to reload the model
  • "voice_refs/" β€” reference voice clips for voice cloning
  • "app.py" β€” Gradio demo application
  • "src/inference.py" β€” reusable inference code
  • "requirements.txt" β€” Python dependencies

πŸ“ Repository structure

. β”œβ”€β”€ app.py β”œβ”€β”€ config.json β”œβ”€β”€ model.pth β”œβ”€β”€ vocab.json β”œβ”€β”€ requirements.txt β”œβ”€β”€ src/ β”‚ └── inference.py └── voice_refs/ β”œβ”€β”€ slt.wav β”œβ”€β”€ bdl.wav └── ...

🐍 Usage outside this Space

The reusable inference interface can be used directly from Python:

from src.inference import generate

path = generate( text="Hello, this is Flex-Audio speaking.", language="en", voice="slt", # filename without .wav from voice_refs/ )

Load the model directly

from TTS.tts.configs.xtts_config import XttsConfig from TTS.tts.models.xtts import Xtts

config = XttsConfig() config.load_json("config.json")

model = Xtts.init_from_config(config) model.load_checkpoint( config, checkpoint_dir=".", eval=True, )

model.cuda()

outputs = model.synthesize( "Your text here", config, speaker_wav="voice_refs/slt.wav", language="en", )

🌍 Languages

Flex-Audio supports 17 languages with real voice cloning, inherited from XTTS-v2:

en, es, fr, de, it, pt, pl, tr, ru, nl, cs, ar, zh-cn, ja, hu, ko, hi

🎀 Voices

The "voice_refs/" directory contains the reference voice clips available for cloning.

To use a voice, provide its filename without the ".wav" extension:

voice="slt"

For the complete list of available voices, see the files inside "voice_refs/".

πŸ“œ License

Proprietary / All Rights Reserved.

No permission is granted to use, copy, modify, distribute, sublicense, sell, or deploy the model or its files except as expressly permitted by the copyright holder.

The model also inherits the applicable terms of its base model. Check the "XTTS-v2 license" (https://huggingface.co/coqui/XTTS-v2) before using or redistributing this model.