drbaph commited on
Commit
b0c9fd5
·
verified ·
1 Parent(s): 2845489

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +103 -0
README.md CHANGED
@@ -13,3 +13,106 @@ tags:
13
  - mimi
14
  - llama
15
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  - mimi
14
  - llama
15
  ---
16
+
17
+ # Miso TTS 8B BF16 for ComfyUI
18
+
19
+
20
+ ![image](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/bCl4i3BvB91wWrIL1F5OR.png)
21
+
22
+ BF16 conversion of **Miso TTS 8B** prepared specifically for use with the **MisoTTS-ComfyUI** custom node:
23
+
24
+ https://github.com/Saganaki22/MisoTTS-ComfyUI
25
+
26
+ This repository contains converted BF16 weights only. No architectural changes, finetuning, retraining, or modifications to the original model behavior have been made.
27
+
28
+
29
+
30
+ ![Screenshot 2026-06-04 002405](https://cdn-uploads.huggingface.co/production/uploads/63473b59e5c0717e6737b872/6jmAKyxg0kQSES1ppKiMo.png)
31
+
32
+ ## Model Introduction
33
+
34
+ Miso TTS 8B is a text-to-speech model based on the Sesame CSM architecture. It generates Mimi audio codes from text and optional audio context using a large Llama-style backbone and an autoregressive audio decoder.
35
+
36
+ This BF16 release is intended for ComfyUI users who want reduced memory usage while maintaining output quality comparable to the original release.
37
+
38
+ ## Quickstart
39
+
40
+ 1. Install ComfyUI.
41
+ 2. Install the MisoTTS-ComfyUI custom node:
42
+ https://github.com/Saganaki22/MisoTTS-ComfyUI
43
+ 3. Place this BF16 checkpoint in your MisoTTS model directory.
44
+ 4. Load the model using the MisoTTS-ComfyUI loader node.
45
+ 5. Generate speech from text or reference-audio workflows.
46
+
47
+ ## Model Summary
48
+
49
+ | Item | Value |
50
+ |--------|--------|
51
+ | Model | Miso TTS 8B |
52
+ | Variant | BF16 Conversion |
53
+ | Intended Platform | ComfyUI |
54
+ | Custom Node | MisoTTS-ComfyUI |
55
+ | Task | Text-to-Speech |
56
+ | Architecture | Sesame-style CSM |
57
+ | Backbone | llama-8B |
58
+ | Audio Decoder | llama-300M |
59
+ | Audio Tokenizer | Mimi |
60
+ | Text Vocabulary | 128,256 |
61
+ | Audio Vocabulary | 2,051 |
62
+ | Audio Codebooks | 32 |
63
+ | Max Sequence Length | 2,048 |
64
+ | Precision | BF16 |
65
+ | Format | Safetensors |
66
+
67
+ ## Architecture
68
+
69
+ Miso TTS 8B uses two transformer components:
70
+
71
+ - A large backbone transformer that consumes text and audio-frame embeddings.
72
+ - A smaller autoregressive decoder transformer that predicts higher-order audio codebooks.
73
+
74
+ Codebook 0 is predicted directly from the backbone hidden state, while codebooks 1 through 31 are generated autoregressively by the decoder.
75
+
76
+ This release preserves the original architecture and only changes weight precision.
77
+
78
+ ## BF16 Conversion Notes
79
+
80
+ - Converted from the original Miso TTS weights.
81
+ - No retraining performed.
82
+ - No finetuning performed.
83
+ - No quantization applied.
84
+ - Intended for lower memory usage compared to FP32 checkpoints.
85
+ - Output quality should remain effectively identical to the original model aside from minor numerical differences inherent to BF16 inference.
86
+
87
+ ## Intended Use
88
+
89
+ This model is intended for:
90
+
91
+ - Text-to-speech generation
92
+ - Conversational speech synthesis
93
+ - Voice continuation workflows
94
+ - Reference-audio conditioned speech generation
95
+ - ComfyUI audio generation pipelines
96
+
97
+ ## Limitations
98
+
99
+ - Voice similarity from reference audio is not guaranteed.
100
+ - Long generations may require workflow chunking.
101
+ - Output quality remains dependent on prompting and generation settings.
102
+ - BF16 support is recommended at the hardware level for optimal performance.
103
+
104
+ ## Attribution
105
+
106
+ Original model:
107
+
108
+ - MisoLabs / Miso TTS 8B
109
+
110
+ ComfyUI integration:
111
+
112
+ - https://github.com/Saganaki22/MisoTTS-ComfyUI
113
+
114
+ All credit for the original architecture, training, datasets, and research belongs to the original Miso Labs team.
115
+
116
+ ## License
117
+
118
+ This BF16 conversion inherits the licensing and usage restrictions of the original Miso TTS release. Please review the upstream license before use.