MisoTTS-BF16 / README.md
drbaph's picture
Update README.md
b0c9fd5 verified
|
Raw
History Blame Contribute Delete
3.79 kB
---
license: other
license_name: modified-mit
license_link: https://huggingface.co/MisoLabs/MisoTTS/blob/main/LICENSE
library_name: pytorch
pipeline_tag: text-to-speech
tags:
- text-to-speech
- speech-synthesis
- voice
- audio
- sesame
- mimi
- llama
---
# Miso TTS 8B BF16 for ComfyUI
![image](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/bCl4i3BvB91wWrIL1F5OR.png)
BF16 conversion of **Miso TTS 8B** prepared specifically for use with the **MisoTTS-ComfyUI** custom node:
https://github.com/Saganaki22/MisoTTS-ComfyUI
This repository contains converted BF16 weights only. No architectural changes, finetuning, retraining, or modifications to the original model behavior have been made.
![Screenshot 2026-06-04 002405](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/6jmAKyxg0kQSES1ppKiMo.png)
## Model Introduction
Miso TTS 8B is a text-to-speech model based on the Sesame CSM architecture. It generates Mimi audio codes from text and optional audio context using a large Llama-style backbone and an autoregressive audio decoder.
This BF16 release is intended for ComfyUI users who want reduced memory usage while maintaining output quality comparable to the original release.
## Quickstart
1. Install ComfyUI.
2. Install the MisoTTS-ComfyUI custom node:
https://github.com/Saganaki22/MisoTTS-ComfyUI
3. Place this BF16 checkpoint in your MisoTTS model directory.
4. Load the model using the MisoTTS-ComfyUI loader node.
5. Generate speech from text or reference-audio workflows.
## Model Summary
| Item | Value |
|--------|--------|
| Model | Miso TTS 8B |
| Variant | BF16 Conversion |
| Intended Platform | ComfyUI |
| Custom Node | MisoTTS-ComfyUI |
| Task | Text-to-Speech |
| Architecture | Sesame-style CSM |
| Backbone | llama-8B |
| Audio Decoder | llama-300M |
| Audio Tokenizer | Mimi |
| Text Vocabulary | 128,256 |
| Audio Vocabulary | 2,051 |
| Audio Codebooks | 32 |
| Max Sequence Length | 2,048 |
| Precision | BF16 |
| Format | Safetensors |
## Architecture
Miso TTS 8B uses two transformer components:
- A large backbone transformer that consumes text and audio-frame embeddings.
- A smaller autoregressive decoder transformer that predicts higher-order audio codebooks.
Codebook 0 is predicted directly from the backbone hidden state, while codebooks 1 through 31 are generated autoregressively by the decoder.
This release preserves the original architecture and only changes weight precision.
## BF16 Conversion Notes
- Converted from the original Miso TTS weights.
- No retraining performed.
- No finetuning performed.
- No quantization applied.
- Intended for lower memory usage compared to FP32 checkpoints.
- Output quality should remain effectively identical to the original model aside from minor numerical differences inherent to BF16 inference.
## Intended Use
This model is intended for:
- Text-to-speech generation
- Conversational speech synthesis
- Voice continuation workflows
- Reference-audio conditioned speech generation
- ComfyUI audio generation pipelines
## Limitations
- Voice similarity from reference audio is not guaranteed.
- Long generations may require workflow chunking.
- Output quality remains dependent on prompting and generation settings.
- BF16 support is recommended at the hardware level for optimal performance.
## Attribution
Original model:
- MisoLabs / Miso TTS 8B
ComfyUI integration:
- https://github.com/Saganaki22/MisoTTS-ComfyUI
All credit for the original architecture, training, datasets, and research belongs to the original Miso Labs team.
## License
This BF16 conversion inherits the licensing and usage restrictions of the original Miso TTS release. Please review the upstream license before use.