OpenASR commited on
Commit
52fa745
Β·
verified Β·
0 Parent(s):

publish sensevoice-small OpenASR packs

Browse files
.gitattributes ADDED
@@ -0,0 +1 @@
 
 
1
+ *.oasr filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: funasr-model-license-v1.1
4
+ license_link: https://github.com/modelscope/FunASR/blob/main/MODEL_LICENSE
5
+ base_model: FunAudioLLM/SenseVoiceSmall
6
+ pipeline_tag: automatic-speech-recognition
7
+ library_name: openasr
8
+ tags:
9
+ - automatic-speech-recognition
10
+ - speech-to-text
11
+ - openasr
12
+ - oasr
13
+ - sensevoice
14
+ ---
15
+
16
+ <div align="center">
17
+
18
+ # SenseVoice Small Β· OpenASR
19
+
20
+ **Fast multilingual speech recognition from FunAudioLLM β€” non-autoregressive SenseVoice, tuned for Chinese, Cantonese, English, Japanese and Korean**
21
+
22
+ [![License](https://img.shields.io/badge/license-FunASR_Model_License_v1.1-2563eb.svg)](https://github.com/modelscope/FunASR/blob/main/MODEL_LICENSE)
23
+ [![Format](https://img.shields.io/badge/format-.oasr-7c3aed.svg)](https://github.com/QuintinShaw/openasr)
24
+ [![Runtime](https://img.shields.io/badge/runtime-OpenASR-111827.svg)](https://openasr.org)
25
+ [![Base model](https://img.shields.io/badge/base-SenseVoiceSmall-f59e0b.svg)](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)
26
+
27
+ Native speech-to-text in the **[OpenASR](https://github.com/QuintinShaw/openasr)** runtime β€”
28
+ engineered for peak performance on CPU & GPU, **no Python at inference time**.
29
+
30
+ </div>
31
+
32
+ ---
33
+
34
+ ## ✨ Highlights
35
+
36
+ - 🌏 **Multilingual, zh-first** β€” high-precision Mandarin, Cantonese, English, Japanese and Korean with automatic language detection
37
+ - ⚑ **Non-autoregressive speed** β€” an end-to-end architecture the upstream clocks at about 70 ms for 10 seconds of audio, 15 times faster than Whisper-Large
38
+ - πŸ€„ **Chinese benchmark strength** β€” trained on over 400,000 hours of speech; the upstream reports better Chinese and Cantonese accuracy than Whisper on AISHELL and WenetSpeech
39
+ - πŸͺΆ **Compact and local** β€” a small checkpoint that transcribes fully offline, from a 130 MB q4_k build up to full-fidelity fp16
40
+ - πŸ¦€ **Native in OpenASR** β€” `.oasr` packs run with no Python at inference, engineered for peak performance on CPU & GPU
41
+
42
+ ## πŸš€ Quickstart
43
+
44
+ ```bash
45
+ # 1. Install the OpenASR CLI Β· https://openasr.org
46
+ # 2. Pull a build (pick a quant β€” see the table below)
47
+ openasr pull sensevoice-small:fp16
48
+
49
+ # 3. Transcribe
50
+ openasr transcribe audio.wav --model sensevoice-small
51
+ ```
52
+
53
+ All builds for this model:
54
+
55
+ ```bash
56
+ openasr pull sensevoice-small:fp16
57
+ openasr pull sensevoice-small:q8
58
+ openasr pull sensevoice-small:q4
59
+ ```
60
+
61
+ ## πŸ“¦ Available builds
62
+
63
+ | Quant | File (`.oasr`) | Size | RAM peak | RTF Β· M1 CPU | RTF Β· M1 GPU | JFK Ξ”WER vs fp16 |
64
+ |:------|:---------------|-----:|---------:|-------------:|-------------:|-----------------:|
65
+ | fp16 | `sensevoice-small-fp16.oasr` | 470 MB | 745 MB | 0.18Γ— | 0.04Γ— | 0.0% |
66
+ | q8_0 | `sensevoice-small-q8_0.oasr` | 252 MB | 514 MB | 0.18Γ— | 0.04Γ— | 0.0% |
67
+ | q4_k | `sensevoice-small-q4_k.oasr` | 136 MB | 395 MB | 0.23Γ— | 0.05Γ— | 0.0% |
68
+
69
+ <sub>RTF = real-time factor on the fixed 11s JFK clip (**lower is faster**); RAM peak measured per pack
70
+ in an isolated subprocess. JFK Ξ”WER compares each quantized build's JFK transcript to this model's
71
+ fp16 JFK transcript, so it measures quantization drift rather than absolute recognition accuracy.
72
+ **fp16** is the recommended default β€” near-reference quality at a fraction of the
73
+ footprint.</sub>
74
+
75
+ ## 🧠 About SenseVoice Small
76
+
77
+ SenseVoice Small is the compact member of **SenseVoice**, the speech understanding model family
78
+ open-sourced by **FunAudioLLM** (Alibaba). Trained on more than **400,000 hours** of speech, it
79
+ delivers high-precision transcription with automatic language detection for **Mandarin Chinese,
80
+ Cantonese, English, Japanese and Korean**, and the upstream card reports Chinese and Cantonese
81
+ accuracy ahead of Whisper on open benchmarks such as AISHELL and WenetSpeech. Its
82
+ **non-autoregressive end-to-end** architecture makes inference exceptionally fast β€” the upstream
83
+ team clocks about 70 ms for 10 seconds of audio, 15x faster than Whisper-Large. The upstream model
84
+ also carries speech emotion recognition and audio event detection; the OpenASR packs currently
85
+ surface plain transcription only (emotion/event tags are not yet exposed). This OpenASR repo
86
+ repackages the original weights as `.oasr` packs that run natively in the OpenASR runtime β€” no
87
+ Python at inference time. The **fp16** build is the recommended default for maximum fidelity;
88
+ **q8_0** halves the footprint at near-reference quality and **q4_k** suits tight-memory devices.
89
+
90
+ ## βš™οΈ How these packs were made
91
+
92
+ Converted from [FunAudioLLM/SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) with the OpenASR importer:
93
+
94
+ ```bash
95
+ openasr model-pack import sensevoice <src> <out>.oasr \
96
+ --package-id sensevoice-small --quantization {fp16,q8-0,q4-k}
97
+ ```
98
+
99
+ The `.oasr` container is GGUF-backed; packs use zero-copy mmap weight binding and graph
100
+ buffer reuse to keep peak memory low.
101
+
102
+ ## βš–οΈ License
103
+
104
+ These packs **inherit the upstream model's license: FunASR Model License v1.1**
105
+ ([source](https://github.com/modelscope/FunASR/blob/main/MODEL_LICENSE)). OpenASR packaging retains the upstream copyright and
106
+ NOTICE; the only modifications are format conversion and quantization.
107
+
108
+ ## πŸ™ Acknowledgements
109
+
110
+ This pack is a redistribution of **SenseVoice Small**, created and open-sourced by the
111
+ **FunAudioLLM team at Alibaba**
112
+ ([FunAudioLLM/SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)), built on the
113
+ **FunASR** open-source speech toolkit from Alibaba's ModelScope community. All credit for the
114
+ original architecture, training, and weights belongs to the FunAudioLLM and FunASR teams; the
115
+ license is inherited from and identical to the upstream model β€” the
116
+ **[FunASR Model License v1.1](https://github.com/modelscope/FunASR/blob/main/MODEL_LICENSE)**,
117
+ which permits commercial use and requires this attribution. Thank you to FunAudioLLM, the FunASR
118
+ team, and Alibaba for releasing their work openly. OpenASR only performs format conversion,
119
+ quantization, runtime verification, and local-inference adaptation.
120
+
121
+ ## πŸ”— Links
122
+
123
+ - πŸ¦€ **OpenASR** β€” <https://github.com/QuintinShaw/openasr>
124
+ - 🌐 **Website** β€” <https://openasr.org>
125
+ - πŸ€— **Upstream model** β€” [FunAudioLLM/SenseVoiceSmall](https://huggingface.co/FunAudioLLM/SenseVoiceSmall)
sensevoice-small-fp16.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97a59d7cd080731a1972fc87fd089b3cccfd20ca77ce5bc3e90d54a8d0802ea7
3
+ size 470203584
sensevoice-small-q4_k.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76a1f7fa28aff8f415dc375e635d9e403c7477941eae9d2ad16173c0c32e8aac
3
+ size 136354720
sensevoice-small-q8_0.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:785a1d45ac22289a5c67927f16f2fc40fd5dae11a630c6c4484092f321517f82
3
+ size 252476064