langgz commited on
Commit
2ae8482
·
verified ·
1 Parent(s): 535a7d4

Add audio.cpp SenseVoice model card

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - zh
5
+ - en
6
+ - yue
7
+ - ja
8
+ - ko
9
+ library_name: gguf
10
+ tags:
11
+ - automatic-speech-recognition
12
+ - asr
13
+ - sensevoice
14
+ - funasr
15
+ - audio.cpp
16
+ - gguf
17
+ - ggml
18
+ - cpu
19
+ pipeline_tag: automatic-speech-recognition
20
+ ---
21
+
22
+ # SenseVoiceSmall GGUF for audio.cpp
23
+
24
+ This repository contains a self-contained Q8_0 export of
25
+ [SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) for the
26
+ [audio.cpp](https://github.com/0xShug0/audio.cpp) spec-backed runtime. The GGUF
27
+ embeds the `sense_asr` schema-v1 model specification, SenseVoice metadata,
28
+ SentencePiece vocabulary, CMVN tensors, and 919 model tensors. It loads
29
+ directly without `--model-spec-override`.
30
+
31
+ ## File
32
+
33
+ | File | Size | SHA256 |
34
+ |---|---:|---|
35
+ | `sensevoice-small-q8-audiocpp-v1.gguf` | 254,211,168 bytes | `0c25c4bf88b023edeca45218be9181df172d1fd60e8f0d0044ae466db3749a26` |
36
+
37
+ ## Usage
38
+
39
+ ```bash
40
+ audiocpp_cli --task asr --family sense_asr \
41
+ --model sensevoice-small-q8-audiocpp-v1.gguf \
42
+ --backend cpu --audio zh.wav \
43
+ --request-option audio_chunk_mode=none
44
+ ```
45
+
46
+ The integration is tracked in
47
+ [audio.cpp pull request #218](https://github.com/0xShug0/audio.cpp/pull/218).
48
+
49
+ ## Reproducibility
50
+
51
+ The model was exported from `FunAudioLLM/SenseVoiceSmall` revision
52
+ `3847d57b6bdf2dd8875cb1508d2af43d80a16bf7` with the official
53
+ `runtime/llama.cpp/export_sensevoice_gguf.py` exporter using `--wtype q8_0`
54
+ and `--model-spec`.
55
+
56
+ On the official 5.616-second Mandarin sample, direct CPU inference produced:
57
+
58
+ ```text
59
+ 开饭时间早上9点至下午5点。
60
+ ```
61
+
62
+ The text exactly matched the original Q8 model loaded with an external model
63
+ specification.
64
+
65
+ ## Links
66
+
67
+ - [SenseVoice source and exporter](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)
68
+ - [FunASR](https://github.com/modelscope/FunASR)
69
+ - [FunASR industrial deployment guides](https://www.funasr.com/)