Hugging Face's logo

drbaph
/
FireRedTTS3-bf16

Text-to-Speech
Safetensors
comfyui
tts
voice-cloning
voice-design
speech-editing
fireredtts
qwen3
comfyui-custom-node
bf16
Model card Files
xet
 Community
FireRedTTS3-bf16
File size: 2,973 Bytes
6740d0a
 
 
c796f79
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6740d0a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
747769d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
c796f79
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
---
license: apache-2.0
base_model: FireRedTeam/FireRedTTS3
pipeline_tag: text-to-speech
library_name: comfyui
tags:
- tts
- text-to-speech
- voice-cloning
- voice-design
- speech-editing
- fireredtts
- qwen3
- comfyui-custom-node
- bf16
language:
- zh
- en
- yue
- ja
- ko
- es
- fr
- ru
- ar
- tr
- id
- pt
- it
- nl
- vi
- de
- uk
- th
- pl
- ro
- el
- cs
- fi
- hi
---

# FireRedTTS3-bf16 (community mixed-precision mirror)

Half-size copy of [FireRedTeam/FireRedTTS3](https://huggingface.co/FireRedTeam/FireRedTTS3) for
[FireRedTTS3-ComfyUI](https://github.com/Saganaki22/FireRedTTS3-ComfyUI).

Conversion policy - only the tensors the official inference code already computes under bf16 autocast
are stored in bf16; everything that officially runs in fp32 stays fp32:

| Component | bf16 | fp32 |
| --- | --- | --- |
| `fireredtts3_base` | Qwen3 backbone LLM | PatchEncoder, DiT flow head, stop head, speaker projections |
| `fireredtts3_instruct` | Qwen3 backbone LLM | PatchEncoder, DiT flow head, stop head |
| `redae` | audio encoder | decoder + ISTFT head |
| `campp` | - | everything |

Same-seed generation against the official fp32 weights produces identical waveforms
(cosine 1.0000, SNR > 80 dB) because the stored bf16 values round exactly like the
runtime autocast cast does. `campp/`, `text_tokenizer/`, and `fasttext/lid.176.ftz` are
copied through unchanged; only the `dtype` field in each `config.json` changed.

## Usage Disclaimer

- The project incorporates zero-shot voice cloning functionality; Please note that this capability is intended **solely for academic research purposes**.
- **DO NOT** use this model for **ANY illegal activities**❗️❗️
- The developers assume no liability for any misuse of this model.
- If you identify any instances of **abuse**, **misuse**, or **fraudulent** activities related to this project, **please report them to our team immediately.**


## Citation

```bib
@article{fireredtts3,
  title   = {FireRedTTS3: Unified Speech Generation and Editing with Semantically Enriched Speech Representations},
  author  = {FireRed Team},
  journal = {arXiv preprint},
  year    = {2026},
}
```


## Acknowledgements

- [Qwen3](https://github.com/QwenLM/Qwen3) and [Qwen2-Audio](https://github.com/QwenLM/Qwen2-Audio) for the language model and audio understanding foundations
- [DiTAR](https://arxiv.org/abs/2502.03930) for the patch-level diffusion autoregressive formulation
- [X-Codec](https://github.com/zhenye234/xcodec) for the discriminator design used in RedAE training
- [CAM++](https://modelscope.cn/models/iic/speech_campplus_sv_en_voxceleb_16k) for speaker embedding extraction
- [fastText](https://fasttext.cc/docs/en/language-identification.html) for automatic language identification
- [WeTextProcessing](https://github.com/wenet-e2e/WeTextProcessing) (wetext) for the Chinese / English text normalization front-end


All credit to the FireRed Team - see the upstream repo and model card. Apache-2.0.