docs: add install/run instructions (Releases + download script + landing) and q8
Browse files
README.md
CHANGED
|
@@ -20,10 +20,24 @@ pipeline_tag: automatic-speech-recognition
|
|
| 20 |
|
| 21 |
GGUF build of **[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)** (SAN-M encoder + CTC) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)** — multilingual ASR with language / emotion / event tags, **~20× real-time on CPU**.
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
## Files
|
| 24 |
| file | size | notes |
|
| 25 |
|---|---|---|
|
| 26 |
| `sensevoice-small-f16.gguf` | 470 MB | **recommended** (f16 matmul weights) |
|
|
|
|
| 27 |
| `sensevoice-small.gguf` | 936 MB | f32 reference |
|
| 28 |
|
| 29 |
## Usage
|
|
|
|
| 20 |
|
| 21 |
GGUF build of **[SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)** (SAN-M encoder + CTC) for the zero-Python, CPU/edge **[FunASR llama.cpp runtime](https://github.com/FunAudioLLM/SenseVoice/tree/main/runtime/llama.cpp)** — multilingual ASR with language / emotion / event tags, **~20× real-time on CPU**.
|
| 22 |
|
| 23 |
+
## Get it running (no Python, no build)
|
| 24 |
+
|
| 25 |
+
These are GGUF weights for the **[FunASR llama.cpp runtime](https://github.com/modelscope/FunASR/tree/main/runtime/llama.cpp)** — a whisper.cpp-style, single self-contained binary for CPU / edge. Grab a prebuilt binary, then fetch this model and run:
|
| 26 |
+
|
| 27 |
+
- **Prebuilt binaries (Linux / macOS / Windows) → [GitHub Releases](https://github.com/modelscope/FunASR/releases)** (tag `runtime-llamacpp-v*`)
|
| 28 |
+
- **One-page quickstart & benchmarks → [funasr.com/llama-cpp](https://www.funasr.com/llama-cpp.html)**
|
| 29 |
+
|
| 30 |
+
```bash
|
| 31 |
+
bash download-funasr-model.sh sensevoice ./gguf
|
| 32 |
+
llama-funasr-sensevoice -m ./gguf/sensevoice-small-q8.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
|
| 33 |
+
# → 欢迎大家来体验达摩院推出的语音识别模型
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
## Files
|
| 37 |
| file | size | notes |
|
| 38 |
|---|---|---|
|
| 39 |
| `sensevoice-small-f16.gguf` | 470 MB | **recommended** (f16 matmul weights) |
|
| 40 |
+
| `sensevoice-small-q8.gguf` | ~235 MB | **recommended** — half of f16, same accuracy |
|
| 41 |
| `sensevoice-small.gguf` | 936 MB | f32 reference |
|
| 42 |
|
| 43 |
## Usage
|