mudler commited on
Commit
1d0934c
·
verified ·
1 Parent(s): f452880

Card: Silero VAD section and MIT attribution

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -28,6 +28,7 @@ base_model:
28
  - nvidia/Nemotron-3-Diarization
29
  - moondream/parakeet-ultra
30
  - moondream/parakeet-redux
 
31
  ---
32
 
33
  # Parakeet GGUF — models for parakeet.cpp
@@ -220,6 +221,20 @@ build/examples/cli/parakeet-cli transcribe --model models/redux-packed.gguf --in
220
  build/examples/cli/parakeet-cli transcribe --model models/ultra-q8_0.gguf --input long.wav --vad
221
  ```
222
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
223
  ## Quantization notes
224
 
225
  Quantization is applied **only** to the large linear weights fed directly into `ggml_mul_mat` (encoder FFN + attention projections, subsampling output projection, joint enc/pred projections). All other tensors (mel filterbank, LSTM prediction net, conv kernels, batch_norm stats, norms, biases, embeddings) stay F32.
@@ -250,4 +265,4 @@ Licences differ by model, so the front matter says `license: other`. Each file f
250
  - `nemotron-3.5-asr-streaming-0.6b-*` and `nemotron-3-diarization-*`: derived from NVIDIA Nemotron models, governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/).
251
  - `ultra-*` and `redux-*`: see below.
252
 
253
- The notes below add detail. `ultra-*.gguf` and `redux-*.gguf` are converted from [moondream/parakeet-ultra](https://huggingface.co/moondream/parakeet-ultra) and [moondream/parakeet-redux](https://huggingface.co/moondream/parakeet-redux) by Moondream, which are derived from NVIDIA's [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3). Both are also CC-BY-4.0: credit Moondream and NVIDIA when you use these files. They were converted here, not trained, and the Redux F16 and Q8_0 files are dequantized from the ternary weights. `nemotron-3-diarization-*.gguf` is derived from nvidia/Nemotron-3-Diarization and `nemotron-3.5-asr-streaming-0.6b-*.gguf` from nvidia/nemotron-3.5-asr-streaming-0.6b. Both are governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/). The parakeet.cpp runtime is MIT-licensed.
 
28
  - nvidia/Nemotron-3-Diarization
29
  - moondream/parakeet-ultra
30
  - moondream/parakeet-redux
31
+ - snakers4/silero-vad
32
  ---
33
 
34
  # Parakeet GGUF — models for parakeet.cpp
 
221
  build/examples/cli/parakeet-cli transcribe --model models/ultra-q8_0.gguf --input long.wav --vad
222
  ```
223
 
224
+ ### silero-vad (Silero Team)
225
+
226
+ Source: [snakers4/silero-vad](https://github.com/snakers4/silero-vad) v6.2.3 by the [Silero Team](https://github.com/snakers4) · a small voice-activity detector, not a speech recognizer · 8 kHz and 16 kHz in one file · license: [MIT](https://github.com/snakers4/silero-vad/blob/master/LICENSE)
227
+
228
+ | File | Variant | Size |
229
+ |---|---|---:|
230
+ | `silero-vad-f32.gguf` | F32 | 2.2 MB |
231
+ | `silero-vad-f16.gguf` | F16 weights, widened to F32 at load | 1.3 MB |
232
+
233
+ - The files are converted from the official ONNX model with `scripts/convert_silero_vad_to_gguf.py` in parakeet.cpp. The GGUF records the source version and the ONNX sha256. They were converted here, not trained.
234
+ - They need a parakeet.cpp build that has the standalone VAD API. That code is not in a release yet, so check the parakeet.cpp repository before relying on it.
235
+ - Use it as a stand-alone detector (`parakeet-cli vad --model silero-vad-f16.gguf --input audio.wav`) or to cut long audio before transcribing with any model, including those that have no VAD head (`parakeet-cli transcribe --model tdt-0.6b-v3-q8_0.gguf --input long.wav --vad --vad-model silero-vad-f16.gguf`).
236
+ - Probabilities match onnxruntime to about 1e-6 (F32) and 1e-3 (F16) on the test clips.
237
+
238
  ## Quantization notes
239
 
240
  Quantization is applied **only** to the large linear weights fed directly into `ggml_mul_mat` (encoder FFN + attention projections, subsampling output projection, joint enc/pred projections). All other tensors (mel filterbank, LSTM prediction net, conv kernels, batch_norm stats, norms, biases, embeddings) stay F32.
 
265
  - `nemotron-3.5-asr-streaming-0.6b-*` and `nemotron-3-diarization-*`: derived from NVIDIA Nemotron models, governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/).
266
  - `ultra-*` and `redux-*`: see below.
267
 
268
+ The notes below add detail. `ultra-*.gguf` and `redux-*.gguf` are converted from [moondream/parakeet-ultra](https://huggingface.co/moondream/parakeet-ultra) and [moondream/parakeet-redux](https://huggingface.co/moondream/parakeet-redux) by Moondream, which are derived from NVIDIA's [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3). Both are also CC-BY-4.0: credit Moondream and NVIDIA when you use these files. They were converted here, not trained, and the Redux F16 and Q8_0 files are dequantized from the ternary weights. `silero-vad-*.gguf` is converted from [Silero VAD](https://github.com/snakers4/silero-vad) v6.2.3 and is released under the MIT license, Copyright (c) 2020-present Silero Team; it was converted here, not trained. `nemotron-3-diarization-*.gguf` is derived from nvidia/Nemotron-3-Diarization and `nemotron-3.5-asr-streaming-0.6b-*.gguf` from nvidia/nemotron-3.5-asr-streaming-0.6b. Both are governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/). The parakeet.cpp runtime is MIT-licensed.