Automatic Speech Recognition
GGUF
ggml
thox
asr
quantization
cpu-inference
bitnet
multilingual
conversational
How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal:
llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KUse pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal:
./llama-cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KBuild from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal:
./build/bin/llama-cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KUse Docker
docker model run hf.co/Thox-ai/ThoxSpeech-ASR-BitNet:Q6_KQuick Links
ThoxSpeech-ASR-BitNet
Your AI. Your Data. Your Rules.
Verbatim redistribution of microsoft/VibeVoice-ASR-BitNet — CPU-only multilingual ASR (NOT retrained or re-quantized by THOX).
What this is
- This is a byte-for-byte mirror of microsoft/VibeVoice-ASR-BitNet (MIT, © Microsoft) with a SHA-256 provenance table. The decoder derives from Qwen2.5-1.5B (Apache-2.0, © Alibaba).
- Total 1.58 GB (I8_S acoustic tokenizer 0.65 GB + I2_S/Q6_K LM 0.92 GB). CPU-only.
- Cite Microsoft, not THOX. Accuracy degrades on far-field / overlapping speech (internal note: WER ~2.41 on LibriSpeech-clean).
Architecture (from config)
| Field | Value |
|---|---|
| Architecture | 2-stage: I8_S VAE tokenizer + I2_S/Q6_K Qwen2.5-1.5B LM decoder |
Intended use
Multilingual automatic speech recognition on CPU. Research / on-device transcription.
Usage
huggingface-cli download Thox-ai/ThoxSpeech-ASR-BitNet --local-dir ./ThoxSpeech-ASR-BitNet
# run with the VibeVoice / BitNet ggml ASR runtime (CPU)
Links
- Base model:
microsoft/VibeVoice-ASR-BitNet - Ollama:
ollama.com/thox-ai/<slug>— verify with the Ollama lane (task 80017303) - Docs: https://docs.thox.ai
THOX.ai LLC — Your AI. Your Data. Your Rules. · On-device and private by design.
- Downloads last month
- 76
Hardware compatibility
Log In to add your hardware
6-bit
Model tree for Thox-ai/ThoxSpeech-ASR-BitNet
Base model
microsoft/VibeVoice-ASR-BitNet
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K# Run inference directly in the terminal: llama cli -hf Thox-ai/ThoxSpeech-ASR-BitNet:Q6_K