OpenASR commited on
Commit
e3ce558
Β·
verified Β·
0 Parent(s):

publish dolphin-cn-dialect-base OpenASR packs

Browse files
.gitattributes ADDED
@@ -0,0 +1 @@
 
 
1
+ *.oasr filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: DataoceanAI/dolphin-cn-dialect-base
4
+ pipeline_tag: automatic-speech-recognition
5
+ library_name: openasr
6
+ tags:
7
+ - automatic-speech-recognition
8
+ - speech-to-text
9
+ - openasr
10
+ - oasr
11
+ - dolphin-cn-dialect-base
12
+ ---
13
+
14
+ <div align="center">
15
+
16
+ # Dolphin CN-Dialect Base Β· OpenASR
17
+
18
+ **Chinese multi-dialect speech recognition, base tier -- a compact 140M WeNet E-Branchformer (CTC + attention) for Sichuan and 22 regional dialects**
19
+
20
+ [![License](https://img.shields.io/badge/license-Apache--2.0-2563eb.svg)](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base/blob/main/README.md)
21
+ [![Format](https://img.shields.io/badge/format-.oasr-7c3aed.svg)](https://github.com/QuintinShaw/openasr)
22
+ [![Runtime](https://img.shields.io/badge/runtime-OpenASR-111827.svg)](https://openasr.org)
23
+ [![Base model](https://img.shields.io/badge/base-dolphin--cn--dialect--base-f59e0b.svg)](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base)
24
+
25
+ Native speech-to-text in the **[OpenASR](https://github.com/QuintinShaw/openasr)** runtime β€”
26
+ engineered for peak performance on CPU & GPU, **no Python at inference time**.
27
+
28
+ </div>
29
+
30
+ ---
31
+
32
+ ## ✨ Highlights
33
+
34
+ - πŸ€„ **22 Chinese dialects, base tier** β€” the same WeNet E-Branchformer dialect coverage as Dolphin CN-Dialect Small (Sichuan/川话, Wu, Cantonese, Minnan, Shanghainese and more), at a fraction of the size
35
+ - πŸͺΆ **140M parameters** β€” roughly a third the width of the `small.cn` checkpoint (512 vs 768 d_model, 6 vs 12 layers), for tighter RAM and faster CPU decode when the small tier is overkill
36
+ - 🧩 **Joint CTC + attention** β€” the same E-Branchformer encoder + Transformer decoder recipe with CTC/attention rescoring, verified against a shape-derived runtime contract shared with the rest of the Dolphin family
37
+ - 🐬 **Chinese-focused, mixed char/BPE vocab** β€” a character vocabulary for Chinese with SentencePiece word-piece tokens for code-switched English, purpose-built for zh audio including heavy accents
38
+ - πŸ¦€ **Native in OpenASR** β€” `.oasr` packs run with no Python at inference, engineered for peak performance on CPU & GPU
39
+
40
+ ## πŸš€ Quickstart
41
+
42
+ ```bash
43
+ # 1. Install the OpenASR CLI Β· https://openasr.org
44
+ # 2. Pull a build (pick a quant β€” see the table below)
45
+ openasr pull dolphin-cn-dialect-base:fp16
46
+
47
+ # 3. Transcribe
48
+ openasr transcribe audio.wav --model dolphin-cn-dialect-base
49
+ ```
50
+
51
+ All builds for this model:
52
+
53
+ ```bash
54
+ openasr pull dolphin-cn-dialect-base:fp16
55
+ openasr pull dolphin-cn-dialect-base:q8
56
+ openasr pull dolphin-cn-dialect-base:q4
57
+ ```
58
+
59
+ ## πŸ“¦ Available builds
60
+
61
+ | Quant | File (`.oasr`) | Size | RAM peak | RTF Β· M1 CPU | RTF Β· M1 GPU | Ξ”WER vs fp16 |
62
+ |:------|:---------------|-----:|---------:|-------------:|-------------:|-----------------:|
63
+ | fp16 | `dolphin-cn-dialect-base-fp16.oasr` | 224 MB | 1.04 GB | 0.13Γ— | 0.05Γ— | 0.0% |
64
+ | q8_0 | `dolphin-cn-dialect-base-q8_0.oasr` | 127 MB | 1.06 GB | 0.09Γ— | 0.05Γ— | 4.5% |
65
+ | q4_k | `dolphin-cn-dialect-base-q4_k.oasr` | 101 MB | 1.03 GB | n/a | n/a | n/a |
66
+
67
+ <sub>RTF = real-time factor on the shared 11s JFK clip (out-of-distribution English, drift signal only) plus an in-language Mandarin sanity clip (**lower is faster**); RAM peak measured per pack
68
+ in an isolated subprocess. Ξ”WER compares each quantized build's JFK + zh sanity clip transcript to this model's
69
+ fp16 JFK + zh sanity clip transcript, so it measures quantization drift rather than absolute recognition accuracy.
70
+ **fp16** is the recommended default β€” near-reference quality at a fraction of the
71
+ footprint.</sub>
72
+
73
+ ## 🧠 About Dolphin CN-Dialect Base
74
+
75
+ Dolphin CN-Dialect Base is the **140M "base" tier** of DataoceanAI's **Chinese multi-dialect**
76
+ speech-recognition line, built on the same **Dolphin / WeNet** recipe as the larger
77
+ **Dolphin CN-Dialect Small**: an **E-Branchformer encoder + Transformer decoder** trained with a
78
+ **joint CTC + attention** objective over a mixed character/BPE vocabulary. It covers the same
79
+ **Sichuan (川话)**-forward set of 22 Chinese dialects (Wu, Cantonese, Minnan, Shanghainese and
80
+ more) as its `small.cn` sibling, but at roughly a third of the encoder/decoder width (512 vs 768
81
+ d_model, 6 vs 12 layers) -- a smaller RAM/CPU footprint for deployments where the small tier's
82
+ accuracy headroom is not needed. Unlike `small.cn`, this `base.cn` checkpoint does not ship a
83
+ trained hotword deep-biasing module. This OpenASR repo repackages the weights as `.oasr` packs
84
+ that run natively in the OpenASR runtime -- no Python at inference, all decoding local. It ships
85
+ in **fp16** (maximum fidelity, recommended), **q8_0**, and **q4_k** builds.
86
+
87
+ **Note:** this model does not emit punctuation. Its upstream training corpus is transcribed
88
+ without punctuation marks, so the decoder never predicts a punctuation token -- there is no
89
+ setting to enable it. Transcripts are plain, unpunctuated text by design.
90
+
91
+ ## βš™οΈ How these packs were made
92
+
93
+ Converted from [DataoceanAI/dolphin-cn-dialect-base](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base) with the OpenASR importer:
94
+
95
+ ```bash
96
+ openasr model-pack import dolphin <src> <out>.oasr \
97
+ --package-id dolphin-cn-dialect-base --quantization {fp16,q8-0,q4-k}
98
+ ```
99
+
100
+ The `.oasr` container is GGUF-backed; packs use zero-copy mmap weight binding and graph
101
+ buffer reuse to keep peak memory low.
102
+
103
+ ## βš–οΈ License
104
+
105
+ These packs **inherit the upstream model's license: Apache-2.0**
106
+ ([source](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base/blob/main/README.md)). OpenASR packaging retains the upstream copyright and
107
+ NOTICE; the only modifications are format conversion and quantization.
108
+
109
+ ## πŸ™ Acknowledgements
110
+
111
+ This pack is a redistribution of **Dolphin CN-Dialect Base** (`base.cn`), created and
112
+ open-sourced by **DataoceanAI**
113
+ ([DataoceanAI/dolphin-cn-dialect-base](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base)).
114
+ All credit for the original architecture, training, and weights belongs to the authors; the
115
+ license is inherited from and identical to the upstream model (Apache-2.0). The model builds on
116
+ the **Dolphin** multilingual ASR project and the **WeNet** E-Branchformer / joint CTC-attention
117
+ recipe -- thank you to the Dolphin and WeNet teams and to DataoceanAI for releasing their work
118
+ openly. OpenASR only performs format conversion, quantization, runtime verification, and
119
+ local-inference adaptation.
120
+
121
+ ## πŸ”— Links
122
+
123
+ - πŸ¦€ **OpenASR** β€” <https://github.com/QuintinShaw/openasr>
124
+ - 🌐 **Website** β€” <https://openasr.org>
125
+ - πŸ€— **Upstream model** β€” [DataoceanAI/dolphin-cn-dialect-base](https://huggingface.co/DataoceanAI/dolphin-cn-dialect-base)
dolphin-cn-dialect-base-fp16.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fa84334cdb81ec3d0ae09882e613424a79eef871a682d4028487ea72318e520
3
+ size 224297952
dolphin-cn-dialect-base-q4_k.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ec60acf9ec1974cea96cfa77b829375ed789bed71639f95a96e1bcc36dc6980
3
+ size 100564480
dolphin-cn-dialect-base-q8_0.oasr ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cda4dbbb147c55af488c0d292acd6bd1bf406f44b3c97a23a2f0c79cbf17870
3
+ size 127104192