---
license: apache-2.0
language:
- zh
- en
- yue
- ja
- ko
library_name: gguf
tags:
- automatic-speech-recognition
- asr
- sensevoice
- funasr
- audio.cpp
- gguf
- ggml
- cpu
pipeline_tag: automatic-speech-recognition
---

# SenseVoiceSmall GGUF for audio.cpp

This repository contains a self-contained Q8_0 export of
[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) for the
[audio.cpp](https://github.com/0xShug0/audio.cpp) spec-backed runtime. The GGUF
embeds the `sense_asr` schema-v1 model specification, SenseVoice metadata,
SentencePiece vocabulary, CMVN tensors, and 919 model tensors. It loads
directly without `--model-spec-override`.

## File

| File | Size | SHA256 |
|---|---:|---|
| `sensevoice-small-q8-audiocpp-v1.gguf` | 254,211,200 bytes | `4dedf169f625437fb336f2959674f399819729a765e184128c0e25a6e16ff0ec` |

## Usage

```bash
audiocpp_cli --task asr --family sense_asr \
  --model sensevoice-small-q8-audiocpp-v1.gguf \
  --backend cpu --audio zh.wav \
  --request-option audio_chunk_mode=none
```

The integration is tracked in
[audio.cpp pull request #218](https://github.com/0xShug0/audio.cpp/pull/218).

## Reproducibility

The model was exported from `FunAudioLLM/SenseVoiceSmall` revision
`3847d57b6bdf2dd8875cb1508d2af43d80a16bf7` with the official
`runtime/llama.cpp/export_sensevoice_gguf.py` exporter using `--wtype q8_0`
and `--model-spec`.

On the official 5.616-second Mandarin sample, direct CPU inference produced:

```text
开饭时间早上9点至下午5点。
```

The text exactly matched the original Q8 model loaded with an external model
specification.

## Links

- [SenseVoice source and exporter](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)
- [FunASR](https://github.com/modelscope/FunASR)
- [FunASR industrial deployment guides](https://www.funasr.com/)