langgz commited on
Commit
90c1c61
·
verified ·
1 Parent(s): cebc2cd

docs: add install/run instructions (Releases + download script + landing) and q8

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -20,10 +20,24 @@ pipeline_tag: automatic-speech-recognition
20
 
21
  GGUF build of **[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)** (SAN-M encoder + CTC) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)** — multilingual ASR with language / emotion / event tags, **~20× real-time on CPU**.
22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ## Files
24
  | file | size | notes |
25
  |---|---|---|
26
  | `sensevoice-small-f16.gguf` | 470 MB | **recommended** (f16 matmul weights) |
 
27
  | `sensevoice-small.gguf` | 936 MB | f32 reference |
28
 
29
  ## Usage
 
20
 
21
  GGUF build of **[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)** (SAN-M encoder + CTC) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)** — multilingual ASR with language / emotion / event tags, **~20× real-time on CPU**.
22
 
23
+ ## Get it running (no Python, no build)
24
+
25
+ These are GGUF weights for the **[FunASR llama.cpp runtime](https://github.com/modelscope/FunASR/tree/main/runtime/llama.cpp)** — a whisper.cpp-style, single self-contained binary for CPU / edge. Grab a prebuilt binary, then fetch this model and run:
26
+
27
+ - **Prebuilt binaries (Linux / macOS / Windows) → [GitHub Releases](https://github.com/modelscope/FunASR/releases)** (tag `runtime-llamacpp-v*`)
28
+ - **One-page quickstart & benchmarks → [funasr.com/llama-cpp](https://www.funasr.com/llama-cpp.html)**
29
+
30
+ ```bash
31
+ bash download-funasr-model.sh sensevoice ./gguf
32
+ llama-funasr-sensevoice -m ./gguf/sensevoice-small-q8.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
33
+ # → 欢迎大家来体验达摩院推出的语音识别模型
34
+ ```
35
+
36
  ## Files
37
  | file | size | notes |
38
  |---|---|---|
39
  | `sensevoice-small-f16.gguf` | 470 MB | **recommended** (f16 matmul weights) |
40
+ | `sensevoice-small-q8.gguf` | ~235 MB | **recommended** — half of f16, same accuracy |
41
  | `sensevoice-small.gguf` | 936 MB | f32 reference |
42
 
43
  ## Usage