audio-cpp
/

audio.cpp-gguf

@@ -81,84 +81,82 @@ base_model:
 This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with [audio.cpp](https://github.com/0xShug0/audio.cpp).
 For conversion details, supported layouts, direct-file loading, sidecar embedding, and the latest compatibility notes, see the audio.cpp GGUF guide:
 - https://github.com/0xShug0/audio.cpp/blob/main/docs/gguf.md
-!!! Automated audio checks are intentionally strict and may flag length, log-mel, or transcript drift that can still sound acceptable to human listeners. Validate the exact file, backend, and route you plan to use. These converted weights are provided as-is; use them at your own risk.
 ## Files
-`Tested` summarizes the current audio.cpp path-test status. See the GGUF guide above
-for the full matrix and drift notes.
-| Directory | Files | audio.cpp family | Tested | Original model license |
-|---|---|---|---|---|
-| `ACE-Step1.5-GGUF` | `base/ace-step-1.5-base-bf16.gguf`, `base/ace-step-1.5-base-q8_0.gguf`, `turbo/ace-step-1.5-turbo-bf16.gguf`, `turbo/ace-step-1.5-turbo-q8_0.gguf` | `ace_step` | 16-bit + Q8 drift | MIT |
-| `BS-RoFormer-ep368-GGUF` | `bs-roformer-ep368-q8_0.gguf` | `bs_roformer` | Q8 pass | Apache-2.0 |
-| `Chatterbox-GGUF` | `chatterbox-f16.gguf`, `chatterbox-q8_0.gguf` | `chatterbox` | 16-bit + Q8 ASR-match drift | MIT |
-| `Citrinet-ASR-GGUF` | `citrinet-asr-q8_0.gguf` | `citrinet_asr` | Q8 pass | CC-BY-4.0 |
-| `Confucius4-TTS-GGUF` | `confucius4-tts-orig.gguf` | `confucius4_tts` | orig pass | Apache-2.0 |
-| `DotTTS-MF-GGUF` | `dots-tts-mf-bf16.gguf` | `dots_tts` | experimental | Apache-2.0 |
-| `DotTTS-SOAR-GGUF` | `dots-tts-soar-orig.gguf`, `dots-tts-soar-bf16.gguf` | `dots_tts` | experimental | Apache-2.0 |
-| `DramaBox-GGUF` | `dramabox-q8_0.gguf` | `dramabox` | Q8 pass | LTX-2 Community License |
-| `Fish-Audio-S2-Pro-GGUF` | `fish-audio-s2-pro-bf16.gguf`, `fish-audio-s2-pro-q8_0.gguf` | `fish_audio` | 16-bit + Q8 pass | Fish Audio Research License |
-| `Fun-ASR-Nano-2512-GGUF` | `fun-asr-nano-2512-f16.gguf`, `fun-asr-nano-2512-q8_0.gguf` | `fun_asr_nano` | 16-bit + Q8 pass | FunASR Model Open Source License Agreement v1.1 |
-| `HeartMuLa-GGUF` | `heartmula-f16.gguf`, `heartmula-q8_0.gguf` | `heartmula` | 16-bit + Q8 drift | Apache-2.0 |
-| `HTDemucs-GGUF` | `htdemucs-f16.gguf`, `htdemucs-q8_0.gguf` | `htdemucs` | 16-bit pass, Q8 drift | MIT |
-| `Higgs-Audio-v3-STT-GGUF` | `higgs-audio-v3-stt-f16.gguf`, `higgs-audio-v3-stt-q8_0.gguf` | `higgs_audio_stt` | 16-bit + Q8 pass | Apache-2.0 |
-| `Higgs-Audio-v3-TTS-4B-GGUF` | `higgs-audio-v3-tts-4b-bf16.gguf`, `higgs-audio-v3-tts-4b-q8_0.gguf` | `higgs_audio_tts` | 16-bit + Q8 pass | Boson Higgs TTS 3 Research and Non-Commercial License |
-| `Hviske-v5.3-GGUF` | `hviske-v5.3-q8_0.gguf` | `hviske_asr` | Q8 pass | CC-BY-NC-4.0 |
-| `IndexTTS2-GGUF` | `index-tts2-orig.gguf`, `index-tts2-f16.gguf`, `index-tts2-q8_0.gguf` | `index_tts2` | orig + 16-bit pass/drift, Q8 ASR-match drift | bilibili Model Use License Agreement |
-| `IndexTTS2.5-GGUF` | `index-tts2_5-orig.gguf`, `index-tts2_5-f16.gguf`, `index-tts2_5-q8_0.gguf` | `index_tts2` | self-contained smoke pass; Q8/F16/orig CUDA load + synthesize | bilibili Model Use License Agreement |
-| `Inflect-Micro-v2-GGUF` | `inflect-micro-v2-orig.gguf` | `inflect_v2` | orig pass | Apache-2.0 |
-| `Irodori-TTS-500M-v3-GGUF` | `irodori-tts-500m-v3-f16.gguf`, `irodori-tts-500m-v3-q8_0.gguf` | `irodori_tts` | 16-bit pass, Q8 drift | MIT |
-| `Irodori-TTS-600M-v3-VoiceDesign-GGUF` | `irodori-tts-600m-v3-voicedesign-f16.gguf`, `irodori-tts-600m-v3-voicedesign-q8_0.gguf` | `irodori_tts` | 16-bit pass, Q8 drift | MIT |
-| `Irodori-TTS-v4-Small-GGUF` | `irodori-tts-v4-small-f16.gguf`, `irodori-tts-v4-small-q8_0.gguf` | `irodori_tts` | v4.1 checkpoint, 16-bit + Q8 pass | MIT |
-| `Kroko-ASR-GGUF` | `kroko-en-community-64-l-q8_0.gguf` | `kroko_asr` | Q8 pass | CC-BY-SA community model license |
-| `MOSS-TTS-Local-v1.5-GGUF` | `moss-tts-local-v1.5-bf16.gguf`, `moss-tts-local-v1.5-q8_0.gguf` | `moss_tts_local` | 16-bit pass, Q8 ASR-match drift | Apache-2.0 |
-| `MOSS-TTS-Nano-100M-GGUF` | `moss-tts-nano-100m-bf16.gguf`, `moss-tts-nano-100m-q8_0.gguf` | `moss_tts_nano` | 16-bit pass, Q8 ASR-match drift | Apache-2.0 |
-| `MagpieTTS-Multilingual-357M-GGUF` | `magpie-tts-multilingual-357m-orig.gguf` | `magpie_tts` | experimental | NVIDIA Open Model License |
-| `Mel-Band-RoFormer-GGUF` | `mel-band-roformer-f16.gguf`, `mel-band-roformer-q8_0.gguf` | `mel_band_roformer` | 16-bit + Q8 drift | MIT |
-| `MioCodec-25Hz-44.1kHz-v2-GGUF` | `miocodec-25hz-44khz-v2-orig.gguf`, `miocodec-25hz-44khz-v2-f16.gguf`, `miocodec-25hz-44khz-v2-q8_0.gguf` | `miocodec` | orig pass, 16-bit + Q8 drift | MIT |
-| `MioTTS-1.7B-GGUF` | `miotts-1.7b-orig.gguf`, `miotts-1.7b-bf16.gguf`, `miotts-1.7b-q8_0.gguf` | `miotts` | orig pass, 16-bit drift, Q8 ASR-match drift | Apache-2.0 |
-| `MuScriptor-Small-GGUF` | `muscriptor-small-f32.gguf` | `muscriptor` | F32 pass | CC-BY-NC-4.0 |
-| `Nemotron-3.5-ASR-Streaming-0.6B-GGUF` | `nemotron-3.5-asr-streaming-0.6b-f16.gguf`, `nemotron-3.5-asr-streaming-0.6b-q8_0.gguf` | `nemotron_asr` | 16-bit pass, Q8 minor filler drift | OpenMDW-1.1 |
-| `OmniVoice-GGUF` | `omnivoice-bf16.gguf`, `omnivoice-f16.gguf`, `omnivoice-q8_0.gguf` | `omnivoice` | 16-bit + Q8 drift | Apache-2.0 |
-| `Parakeet-TDT-0.6B-v3-GGUF` | `parakeet-tdt-0.6b-v3-f16.gguf`, `parakeet-tdt-0.6b-v3-q8_0.gguf` | `parakeet_tdt` | 16-bit + Q8 pass | CC-BY-4.0 |
-| `PocketTTS-GGUF` | `english/`, `german/`, `italian/`, `portuguese/`, `spanish/` each contain `bf16` and `q8_0` GGUFs | `pocket_tts` | 16-bit pass, Q8 drift | CC-BY-4.0 |
-| `Qwen3-ASR-0.6B-GGUF` | `qwen3-asr-0.6b-f16.gguf`, `qwen3-asr-0.6b-q8_0.gguf` | `qwen3_asr` | 16-bit + Q8 pass | Apache-2.0 |
-| `Qwen3-ASR-1.7B-GGUF` | `qwen3-asr-1.7b-f16.gguf`, `qwen3-asr-1.7b-q8_0.gguf` | `qwen3_asr` | 16-bit + Q8 pass | Apache-2.0 |
-| `Qwen3-ForcedAligner-0.6B-GGUF` | `qwen3-forced-aligner-0.6b-f16.gguf`, `qwen3-forced-aligner-0.6b-q8_0.gguf` | `qwen3_forced_aligner` | 16-bit + Q8 pass | Apache-2.0 |
-| `Qwen3-TTS-12Hz-0.6B-Base-GGUF` | `qwen3-tts-12hz-0.6b-base-bf16.gguf`, `qwen3-tts-12hz-0.6b-base-q8_0.gguf` | `qwen3_tts` | BF16 exact vs safetensors, Q8 ASR-match drift | Apache-2.0 |
-| `Qwen3-TTS-12Hz-1.7B-Base-GGUF` | `qwen3-tts-12hz-1.7b-base-orig.gguf`, `qwen3-tts-12hz-1.7b-base-bf16.gguf`, `qwen3-tts-12hz-1.7b-base-q8_0_v2.gguf` | `qwen3_tts` | orig pass, 16-bit + Q8 ASR-match drift | Apache-2.0 |
-| `Qwen3-TTS-12Hz-1.7B-CustomVoice-GGUF` | `qwen3-tts-12hz-1.7b-customvoice-bf16.gguf`, `qwen3-tts-12hz-1.7b-customvoice-q8_0.gguf` | `qwen3_tts` | 16-bit + Q8 ASR-match drift | Apache-2.0 |
-| `Qwen3-TTS-12Hz-1.7B-VoiceDesign-GGUF` | `qwen3-tts-12hz-1.7b-voicedesign-bf16.gguf`, `qwen3-tts-12hz-1.7b-voicedesign-q8_0.gguf` | `qwen3_tts` | 16-bit + Q8 ASR-match drift | Apache-2.0 |
-| `RVC-GGUF` | `rvc-f16.gguf` | `rvc` | F16 pass | MIT |
-| `SeedVC-MLX-GGUF` | `seed-vc-mlx-orig.gguf`, `seed-vc-mlx-f16.gguf`, `seed-vc-mlx-q8_0.gguf` | `seed_vc` | 16-bit + Q8 drift | GPL-3.0 |
-| `Sortformer-Diar-4spk-v1-GGUF` | `sortformer-diar-4spk-v1-f16.gguf`, `sortformer-diar-4spk-v1-q8_0.gguf` | `sortformer_diar` | 16-bit + Q8 pass | CC-BY-NC-4.0 |
-| `Stable-Audio-3-Medium-GGUF` | `stable-audio-3-medium-f16.gguf`, `stable-audio-3-medium-q8_0.gguf` | `stable_audio` | 16-bit + Q8 drift | Stability AI Community License |
-| `Stable-Audio-3-Small-Music-GGUF` | `stable-audio-3-small-music-f16.gguf`, `stable-audio-3-small-music-q8_0.gguf` | `stable_audio` | 16-bit + Q8 drift | Stability AI Community License |
-| `Stable-Audio-3-Small-SFX-GGUF` | `stable-audio-3-small-sfx-f16.gguf`, `stable-audio-3-small-sfx-q8_0.gguf` | `stable_audio` | 16-bit + Q8 drift | Stability AI Community License |
-| `Supertonic-3-GGUF` | `supertonic-3-orig.gguf`, `supertonic-3-f16.gguf`, `supertonic-3-q8_0.gguf` | `supertonic` | F32/orig pass; f16 not tested; Q8 unsupported dtype | BigScience Open RAIL-M |
-| `Vevo2-GGUF` | `vevo2-orig.gguf`, `vevo2-f16.gguf`, `vevo2-q8_0.gguf` | `vevo2` | orig + 16-bit pass/drift; Q8 mixed route drift | CC-BY-NC-ND-4.0 |
-| `VibeVoice-1.5B-GGUF` | `vibevoice-1.5b-bf16.gguf`, `vibevoice-1.5b-q8_0.gguf`, `vibevoice-1.5b-q4-ios.gguf` | `vibevoice` | 16-bit pass, Q8 drift | MIT |
-| `VibeVoice-ASR-GGUF` | `vibevoice-asr-f16.gguf`, `vibevoice-asr-q8_0.gguf` | `vibevoice_asr` | 16-bit + Q8 pass | MIT |
-| `VoxCPM2-GGUF` | `voxcpm2-orig.gguf`, `voxcpm2-bf16.gguf`, `voxcpm2-q8_0.gguf` | `voxcpm2` | orig pass, 16-bit + Q8 ASR-match drift | Apache-2.0 |
-| `Voxtral-Mini-4B-Realtime-2602-GGUF` | `voxtral-mini-4b-realtime-2602-bf16.gguf`, `voxtral-mini-4b-realtime-2602-q8_0.gguf`, `voxtral-mini-4b-realtime-2602-q4_k.gguf` | `voxtral_realtime` | 16-bit + Q8 pass; Q4_K quick check passed | Apache-2.0 |
-## Q8 Notes
-- Chatterbox Q8 is intentionally mixed type. Graph-sensitive scalar, norm, bias,
-  and side tensors stay in non-Q8 types while matmul-compatible weights are
-  quantized.
-- PocketTTS Q8 keeps the four `flow_lm.flow_net.time_embed.*.mlp.{0,2}.weight`
-  tensors in Q8 in addition to the default converter selection. `conditioner.embed`,
-  `cond_embed`, and Mimi conv tensors are not forced to Q8 because tested outputs
-  drifted or the current conv path casts quantized conv weights back to F32.
-- Voxtral Q4_K is smaller than Q8_0 and was faster in a quick CUDA path check,
-  with transcripts matching Q8_0 except for one capitalization-only difference.
 ## Usage

 This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with [audio.cpp](https://github.com/0xShug0/audio.cpp).
+If you enjoy the project, please star [audio.cpp on GitHub](https://github.com/0xShug0/audio.cpp) and this Hugging Face repository.
 For conversion details, supported layouts, direct-file loading, sidecar embedding, and the latest compatibility notes, see the audio.cpp GGUF guide:
 - https://github.com/0xShug0/audio.cpp/blob/main/docs/gguf.md
+!!! Converted and quantized packages are checked with automated metrics, but perceived quality can still differ for human listeners. Please validate the exact package, backend, and route to confirm the output is acceptable for your use case.
 ## Files
+The table lists the GGUF packages currently provided by this repository.
+| Directory | audio.cpp family | GGUF provided | Original model license |
+|---|---|---|---|
+| `ACE-Step1.5-GGUF` | `ace_step` | BF16 + Q8 | MIT |
+| `AudioSR-GGUF` | `audiosr` | F32 | MIT |
+| `BS-RoFormer-ep368-GGUF` | `bs_roformer` | Q8 | Apache-2.0 |
+| `Chatterbox-GGUF` | `chatterbox` | F16 + Q8 | MIT |
+| `Citrinet-ASR-GGUF` | `citrinet_asr` | Q8 | CC-BY-4.0 |
+| `Confucius4-TTS-GGUF` | `confucius4_tts` | original | Apache-2.0 |
+| `ControlFoley-GGUF` | `controlfoley` | F32 | Apache-2.0 |
+| `DotTTS-Edit-GGUF` | `dots_tts` | BF16 + Q8 | Apache-2.0 |
+| `DotTTS-MF-GGUF` | `dots_tts` | BF16 | Apache-2.0 |
+| `DotTTS-SOAR-GGUF` | `dots_tts` | original + BF16 | Apache-2.0 |
+| `DramaBox-GGUF` | `dramabox` | Q8 | LTX-2 Community License |
+| `Fish-Audio-S2-Pro-GGUF` | `fish_audio` | BF16 + Q8 | Fish Audio Research License |
+| `Fun-ASR-Nano-2512-GGUF` | `fun_asr_nano` | F16 + Q8 | FunASR Model Open Source License Agreement v1.1 |
+| `HeartMuLa-GGUF` | `heartmula` | F16 + Q8 | Apache-2.0 |
+| `HTDemucs-GGUF` | `htdemucs` | F16 + Q8 | MIT |
+| `Higgs-Audio-v3-STT-GGUF` | `higgs_audio_stt` | F16 + Q8 | Apache-2.0 |
+| `Higgs-Audio-v3-TTS-4B-GGUF` | `higgs_audio_tts` | BF16 + Q8 | Boson Higgs TTS 3 Research and Non-Commercial License |
+| `Hviske-v5.3-GGUF` | `hviske_asr` | Q8 | CC-BY-NC-4.0 |
+| `IndexTTS2-GGUF` | `index_tts2` | original + F16 + Q8 | bilibili Model Use License Agreement |
+| `IndexTTS2.5-GGUF` | `index_tts2` | original + F16 + Q8 | bilibili Model Use License Agreement |
+| `Inflect-Micro-v2-GGUF` | `inflect_v2` | original | Apache-2.0 |
+| `Irodori-TTS-500M-v3-GGUF` | `irodori_tts` | F16 + Q8 | MIT |
+| `Irodori-TTS-600M-v3-VoiceDesign-GGUF` | `irodori_tts` | F16 + Q8 | MIT |
+| `Irodori-TTS-v4-Small-GGUF` | `irodori_tts` | F16 + Q8 | MIT |
+| `Kroko-ASR-GGUF` | `kroko_asr` | Q8 | CC-BY-SA community model license |
+| `MMS-Forced-Aligner-GGUF` | `mms_forced_aligner` | F16 | CC-BY-NC-4.0 |
+| `MOSS-TTS-Local-v1.5-GGUF` | `moss_tts_local` | BF16 + Q8 | Apache-2.0 |
+| `MOSS-TTS-Nano-100M-GGUF` | `moss_tts_nano` | BF16 + Q8 | Apache-2.0 |
+| `MOSS-VoiceGenerator-GGUF` | `moss_voicegen` | BF16 + F16 codec decode | Apache-2.0 |
+| `MagpieTTS-Multilingual-357M-GGUF` | `magpie_tts` | original | NVIDIA Open Model License |
+| `MeanVC2-GGUF` | `meanvc2` | F32 + Q4_K | Apache-2.0 |
+| `Mel-Band-RoFormer-GGUF` | `mel_band_roformer` | F16 + Q8 | MIT |
+| `MiniMax-H3-Q4-GGUF` | `minimax_h3` | Q4_K + INT8 DiT option | MiniMax-H3 Community License |
+| `MioCodec-25Hz-44.1kHz-v2-GGUF` | `miocodec` | original + F16 + Q8 | MIT |
+| `MioTTS-1.7B-GGUF` | `miotts` | original + BF16 + Q8 | Apache-2.0 |
+| `MuScriptor-Small-GGUF` | `muscriptor` | F32 | CC-BY-NC-4.0 |
+| `Nemotron-3.5-ASR-Streaming-0.6B-GGUF` | `nemotron_asr` | F16 + Q8 | OpenMDW-1.1 |
+| `NeuTTS-2E-GGUF` | `neutts` | original | Apache-2.0 |
+| `OmniVoice-GGUF` | `omnivoice` | BF16 + F16 + Q8 | Apache-2.0 |
+| `Parakeet-TDT-0.6B-v3-GGUF` | `parakeet_tdt` | F16 + Q8 | CC-BY-4.0 |
+| `PersonaPlex-GGUF` | `personaplex` | Q4_K + Q8 | Apache-2.0 |
+| `PocketTTS-GGUF` | `pocket_tts` | BF16 + Q8 | CC-BY-4.0 |
+| `Qwen3-ASR-0.6B-GGUF` | `qwen3_asr` | F16 + Q8 | Apache-2.0 |
+| `Qwen3-ASR-1.7B-GGUF` | `qwen3_asr` | F16 + Q8 | Apache-2.0 |
+| `Qwen3-ForcedAligner-0.6B-GGUF` | `qwen3_forced_aligner` | F16 + Q8 | Apache-2.0 |
+| `Qwen3-TTS-12Hz-0.6B-Base-GGUF` | `qwen3_tts` | BF16 + Q8 | Apache-2.0 |
+| `Qwen3-TTS-12Hz-1.7B-Base-GGUF` | `qwen3_tts` | original + BF16 + Q8 | Apache-2.0 |
+| `Qwen3-TTS-12Hz-1.7B-CustomVoice-GGUF` | `qwen3_tts` | BF16 + Q8 | Apache-2.0 |
+| `Qwen3-TTS-12Hz-1.7B-VoiceDesign-GGUF` | `qwen3_tts` | BF16 + Q8 | Apache-2.0 |
+| `RVC-GGUF` | `rvc` | F16 | MIT |
+| `SeedVC-MLX-GGUF` | `seed_vc` | original + F16 + Q8 | GPL-3.0 |
+| `Sortformer-Diar-4spk-v1-GGUF` | `sortformer_diar` | F16 + Q8 | CC-BY-NC-4.0 |
+| `Stable-Audio-3-Medium-GGUF` | `stable_audio` | F16 + Q8 | Stability AI Community License |
+| `Stable-Audio-3-Small-Music-GGUF` | `stable_audio` | F16 + Q8 | Stability AI Community License |
+| `Stable-Audio-3-Small-SFX-GGUF` | `stable_audio` | F16 + Q8 | Stability AI Community License |
+| `Supertonic-3-GGUF` | `supertonic` | original + F16 + Q8 | BigScience Open RAIL-M |
+| `Vevo2-GGUF` | `vevo2` | original + F16 + Q8 | CC-BY-NC-ND-4.0 |
+| `VibeVoice-1.5B-GGUF` | `vibevoice` | BF16 + Q8 + Q4 | MIT |
+| `VibeVoice-ASR-GGUF` | `vibevoice_asr` | F16 + Q8 | MIT |
+| `VoxCPM2-GGUF` | `voxcpm2` | original + BF16 + Q8 | Apache-2.0 |
+| `Voxtral-Mini-4B-Realtime-2602-GGUF` | `voxtral_realtime` | BF16 + Q8 + Q4_K | Apache-2.0 |
 ## Usage