voidash commited on
Commit
775eb32
·
verified ·
1 Parent(s): 3ea27f9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +56 -10
README.md CHANGED
@@ -1,21 +1,67 @@
1
  ---
2
  language: [ne]
3
  license: cc-by-nc-4.0
4
- tags: [automatic-speech-recognition, nemo, conformer, telephony, nepali]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
 
 
7
  # nepali-conformer-streaming
8
 
9
- Cache-aware streaming Nepali ASR (520 ms lookahead, chunked attention, causal convs). Carries a large measured streaming-lineage penalty — see RESULTS.md before using.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
 
11
- Part of the [nepali-telephony-asr](https://github.com/voidash/nepali-telephony-asr) research
12
- prototype release. **Read the honest results first**: real-call WER 59.9 on the NepTel
13
- benchmark (human-reviewed real Nepali call audio), with measured limitations (English, sung
14
- speech, slow speech, end-of-turn) documented in the repo's RESULTS.md.
 
15
 
16
- 121.3M-parameter 17-layer Conformer (d=512, striding x4, 40 ms frames), hybrid TDT/CTC,
17
- 1024-piece SentencePiece (Devanagari). Trained from scratch on ~1,655 h of mostly conversational
18
- Nepali with Chirp 2 pseudo-labels; telephony codec + noise + tempo augmentation.
19
 
20
  ```python
21
  from nemo.collections.asr.models import EncDecHybridRNNTCTCBPEModel
@@ -23,4 +69,4 @@ m = EncDecHybridRNNTCTCBPEModel.restore_from("nepali_conformer_streaming.nemo")
23
  print(m.transcribe(["audio.wav"])[0].text)
24
  ```
25
 
26
- License: CC-BY-NC-4.0 (weights; training data includes crawled YouTube speech).
 
1
  ---
2
  language: [ne]
3
  license: cc-by-nc-4.0
4
+ library_name: nemo
5
+ pipeline_tag: automatic-speech-recognition
6
+ tags: [automatic-speech-recognition, speech, nemo, conformer, streaming, telephony, nepali, nepal]
7
+ model-index:
8
+ - name: nepali-conformer-streaming
9
+ results:
10
+ - task:
11
+ type: automatic-speech-recognition
12
+ dataset:
13
+ name: NepTel v0.1 (real Nepali call-center audio, human-reviewed)
14
+ type: neptel
15
+ metrics:
16
+ - type: wer
17
+ value: 59.87
18
+ name: Real-call WER
19
+ - type: cer
20
+ value: 41.08
21
+ name: Real-call CER
22
+ - task:
23
+ type: automatic-speech-recognition
24
+ dataset:
25
+ name: Held-out gold read Nepali (W1 read slice, OpenSLR-54 utterances absent from training)
26
+ type: w1-read
27
+ metrics:
28
+ - type: wer
29
+ value: 31.5
30
+ name: Read-speech WER
31
  ---
32
 
33
+ <p align="center"><img src="https://raw.githubusercontent.com/Ampixa/nepaliconformer/master/assets/logo.svg" width="140"></p>
34
+
35
  # nepali-conformer-streaming
36
 
37
+ Cache-aware **streaming** Nepali ASR (520 ms lookahead). Carries a large, honestly-reported streaming-lineage penalty on real calls read RESULTS.md before choosing this over the offline model; it exists because a phone agent needs incremental output.
38
+
39
+ **Try it:** [demo Space](https://huggingface.co/spaces/voidash/nepaliconformer) ·
40
+ **Everything else:** [github.com/Ampixa/nepaliconformer](https://github.com/Ampixa/nepaliconformer)
41
+ (NepTel benchmark, per-system outputs, full honest results)
42
+
43
+ ## Numbers (measured, not marketed)
44
+
45
+ | benchmark | WER |
46
+ |---|---|
47
+ | NepTel — real Nepali call audio, human-reviewed refs | **59.87** |
48
+ | Held-out gold read Nepali (W1 slice) | 31.5 |
49
+ | Whisper-large-v3 zero-shot on the same NepTel audio | 99.4 |
50
+
51
+ ## Architecture
52
+
53
+ 121.3M-parameter 17-layer Conformer (d=512, striding ×4, 40 ms frames), hybrid TDT/CTC decoder,
54
+ 1,024-piece Devanagari SentencePiece. Chunked-limited attention [[70,13],[70,6],[70,1],[70,0]], fully causal convolutions, cache-aware incremental decoding.
55
+
56
+ ## Training data
57
 
58
+ ~1,655 h of mostly conversational Nepali (YouTube podcasts/interviews) with Google Chirp 2
59
+ pseudo-labels + 105 h human-labeled read speech; telephony codec, noise, reverb and tempo
60
+ augmentation. Label-noise ceiling and every measured limitation (English, sung speech, slow
61
+ speech, end-of-turn) are documented in the
62
+ [repo's RESULTS.md](https://github.com/Ampixa/nepaliconformer/blob/master/RESULTS.md).
63
 
64
+ ## Usage
 
 
65
 
66
  ```python
67
  from nemo.collections.asr.models import EncDecHybridRNNTCTCBPEModel
 
69
  print(m.transcribe(["audio.wav"])[0].text)
70
  ```
71
 
72
+ License: CC-BY-NC-4.0 (weights). Code in the repo: MIT.