audio.cpp GGUF Model Packages

This directory contains audio.cpp-native GGUF conversions of multiple speech models. These files are intended for use with audio.cpp.

For conversion details, supported layouts, direct-file loading, sidecar embedding, and the latest compatibility notes, see the audio.cpp GGUF guide:

!!! Automated audio checks are intentionally strict and may flag length, log-mel, or transcript drift that can still sound acceptable to human listeners. Validate the exact file, backend, and route you plan to use. These converted weights are provided as-is; use them at your own risk.

Files

Directory Files audio.cpp family Original model license
Higgs-Audio-v3-STT-GGUF higgs-audio-v3-stt-f16.gguf, higgs-audio-v3-stt-q8_0.gguf higgs_audio_stt Apache-2.0
IndexTTS2-GGUF index-tts2-orig.gguf, index-tts2-f16.gguf, index-tts2-q8_0.gguf index_tts2 bilibili Model Use License Agreement
Irodori-TTS-500M-v3-GGUF irodori-tts-500m-v3-f16.gguf, irodori-tts-500m-v3-q8_0.gguf irodori_tts MIT
Irodori-TTS-600M-v3-VoiceDesign-GGUF irodori-tts-600m-v3-voicedesign-f16.gguf, irodori-tts-600m-v3-voicedesign-q8_0.gguf irodori_tts MIT
MOSS-TTS-Local-v1.5-GGUF moss-tts-local-v1.5-bf16.gguf, moss-tts-local-v1.5-q8_0.gguf moss_tts_local Apache-2.0
MOSS-TTS-Nano-100M-GGUF moss-tts-nano-100m-bf16.gguf, moss-tts-nano-100m-q8_0.gguf moss_tts_nano Apache-2.0
Nemotron-3.5-ASR-Streaming-0.6B-GGUF nemotron-3.5-asr-streaming-0.6b-f16.gguf, nemotron-3.5-asr-streaming-0.6b-q8_0.gguf nemotron_asr OpenMDW-1.1
OmniVoice-GGUF omnivoice-f16.gguf, omnivoice-q8_0.gguf omnivoice Apache-2.0
Qwen3-ASR-0.6B-GGUF qwen3-asr-0.6b-f16.gguf, qwen3-asr-0.6b-q8_0.gguf qwen3_asr Apache-2.0
Qwen3-ASR-1.7B-GGUF qwen3-asr-1.7b-f16.gguf, qwen3-asr-1.7b-q8_0.gguf qwen3_asr Apache-2.0
Qwen3-ForcedAligner-0.6B-GGUF qwen3-forced-aligner-0.6b-f16.gguf, qwen3-forced-aligner-0.6b-q8_0.gguf qwen3_forced_aligner Apache-2.0
Qwen3-TTS-12Hz-1.7B-Base-GGUF qwen3-tts-12hz-1.7b-base-bf16.gguf, qwen3-tts-12hz-1.7b-base-q8_0.gguf qwen3_tts Apache-2.0
Qwen3-TTS-12Hz-1.7B-CustomVoice-GGUF qwen3-tts-12hz-1.7b-customvoice-bf16.gguf, qwen3-tts-12hz-1.7b-customvoice-q8_0.gguf qwen3_tts Apache-2.0
Qwen3-TTS-12Hz-1.7B-VoiceDesign-GGUF qwen3-tts-12hz-1.7b-voicedesign-bf16.gguf, qwen3-tts-12hz-1.7b-voicedesign-q8_0.gguf qwen3_tts Apache-2.0
Supertonic-3-GGUF supertonic-3-orig.gguf, supertonic-3-f16.gguf, supertonic-3-q8_0.gguf supertonic BigScience Open RAIL-M
VibeVoice-ASR-GGUF vibevoice-asr-f16.gguf, vibevoice-asr-q8_0.gguf vibevoice_asr MIT

Usage

Pass a GGUF file directly as --model:

audiocpp_cli --task tts --family supertonic --model Supertonic-3-GGUF/supertonic-3-orig.gguf --backend cuda --language en --text "Hello." --voice-id M1 --out out.wav

For ASR:

audiocpp_cli --task asr --family qwen3_asr --model Qwen3-ASR-0.6B-GGUF/qwen3-asr-0.6b-f16.gguf --backend cuda --audio speech.wav --text "" --text-out transcript.txt

License

Each GGUF file is a converted form of its original model. Use and redistribution are governed by the corresponding original model license listed above. Please review the original model card and license terms before using or redistributing any converted weights.

Downloads last month
-
GGUF
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support