File size: 1,847 Bytes
2ae8482 5c3fcfe 2ae8482 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 | ---
license: apache-2.0
language:
- zh
- en
- yue
- ja
- ko
library_name: gguf
tags:
- automatic-speech-recognition
- asr
- sensevoice
- funasr
- audio.cpp
- gguf
- ggml
- cpu
pipeline_tag: automatic-speech-recognition
---
# SenseVoiceSmall GGUF for audio.cpp
This repository contains a self-contained Q8_0 export of
[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) for the
[audio.cpp](https://github.com/0xShug0/audio.cpp) spec-backed runtime. The GGUF
embeds the `sense_asr` schema-v1 model specification, SenseVoice metadata,
SentencePiece vocabulary, CMVN tensors, and 919 model tensors. It loads
directly without `--model-spec-override`.
## File
| File | Size | SHA256 |
|---|---:|---|
| `sensevoice-small-q8-audiocpp-v1.gguf` | 254,211,200 bytes | `4dedf169f625437fb336f2959674f399819729a765e184128c0e25a6e16ff0ec` |
## Usage
```bash
audiocpp_cli --task asr --family sense_asr \
--model sensevoice-small-q8-audiocpp-v1.gguf \
--backend cpu --audio zh.wav \
--request-option audio_chunk_mode=none
```
The integration is tracked in
[audio.cpp pull request #218](https://github.com/0xShug0/audio.cpp/pull/218).
## Reproducibility
The model was exported from `FunAudioLLM/SenseVoiceSmall` revision
`3847d57b6bdf2dd8875cb1508d2af43d80a16bf7` with the official
`runtime/llama.cpp/export_sensevoice_gguf.py` exporter using `--wtype q8_0`
and `--model-spec`.
On the official 5.616-second Mandarin sample, direct CPU inference produced:
```text
开饭时间早上9点至下午5点。
```
The text exactly matched the original Q8 model loaded with an external model
specification.
## Links
- [SenseVoice source and exporter](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)
- [FunASR](https://github.com/modelscope/FunASR)
- [FunASR industrial deployment guides](https://www.funasr.com/)
|