Automatic Speech Recognition
GGUF
NeMo
parakeet.cpp
asr
parakeet
ggml
cpp-inference
speaker-diarization
Instructions to use mudler/parakeet-cpp-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use mudler/parakeet-cpp-gguf with NeMo:
import nemo.collections.asr as nemo_asr asr_model = nemo_asr.models.ASRModel.from_pretrained("mudler/parakeet-cpp-gguf") transcriptions = asr_model.transcribe(["file.wav"]) - Notebooks
- Google Colab
- Kaggle
Card: Silero VAD section and MIT attribution
Browse files
README.md
CHANGED
|
@@ -28,6 +28,7 @@ base_model:
|
|
| 28 |
- nvidia/Nemotron-3-Diarization
|
| 29 |
- moondream/parakeet-ultra
|
| 30 |
- moondream/parakeet-redux
|
|
|
|
| 31 |
---
|
| 32 |
|
| 33 |
# Parakeet GGUF — models for parakeet.cpp
|
|
@@ -220,6 +221,20 @@ build/examples/cli/parakeet-cli transcribe --model models/redux-packed.gguf --in
|
|
| 220 |
build/examples/cli/parakeet-cli transcribe --model models/ultra-q8_0.gguf --input long.wav --vad
|
| 221 |
```
|
| 222 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 223 |
## Quantization notes
|
| 224 |
|
| 225 |
Quantization is applied **only** to the large linear weights fed directly into `ggml_mul_mat` (encoder FFN + attention projections, subsampling output projection, joint enc/pred projections). All other tensors (mel filterbank, LSTM prediction net, conv kernels, batch_norm stats, norms, biases, embeddings) stay F32.
|
|
@@ -250,4 +265,4 @@ Licences differ by model, so the front matter says `license: other`. Each file f
|
|
| 250 |
- `nemotron-3.5-asr-streaming-0.6b-*` and `nemotron-3-diarization-*`: derived from NVIDIA Nemotron models, governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/).
|
| 251 |
- `ultra-*` and `redux-*`: see below.
|
| 252 |
|
| 253 |
-
The notes below add detail. `ultra-*.gguf` and `redux-*.gguf` are converted from [moondream/parakeet-ultra](https://huggingface.co/moondream/parakeet-ultra) and [moondream/parakeet-redux](https://huggingface.co/moondream/parakeet-redux) by Moondream, which are derived from NVIDIA's [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3). Both are also CC-BY-4.0: credit Moondream and NVIDIA when you use these files. They were converted here, not trained, and the Redux F16 and Q8_0 files are dequantized from the ternary weights. `nemotron-3-diarization-*.gguf` is derived from nvidia/Nemotron-3-Diarization and `nemotron-3.5-asr-streaming-0.6b-*.gguf` from nvidia/nemotron-3.5-asr-streaming-0.6b. Both are governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/). The parakeet.cpp runtime is MIT-licensed.
|
|
|
|
| 28 |
- nvidia/Nemotron-3-Diarization
|
| 29 |
- moondream/parakeet-ultra
|
| 30 |
- moondream/parakeet-redux
|
| 31 |
+
- snakers4/silero-vad
|
| 32 |
---
|
| 33 |
|
| 34 |
# Parakeet GGUF — models for parakeet.cpp
|
|
|
|
| 221 |
build/examples/cli/parakeet-cli transcribe --model models/ultra-q8_0.gguf --input long.wav --vad
|
| 222 |
```
|
| 223 |
|
| 224 |
+
### silero-vad (Silero Team)
|
| 225 |
+
|
| 226 |
+
Source: [snakers4/silero-vad](https://github.com/snakers4/silero-vad) v6.2.3 by the [Silero Team](https://github.com/snakers4) · a small voice-activity detector, not a speech recognizer · 8 kHz and 16 kHz in one file · license: [MIT](https://github.com/snakers4/silero-vad/blob/master/LICENSE)
|
| 227 |
+
|
| 228 |
+
| File | Variant | Size |
|
| 229 |
+
|---|---|---:|
|
| 230 |
+
| `silero-vad-f32.gguf` | F32 | 2.2 MB |
|
| 231 |
+
| `silero-vad-f16.gguf` | F16 weights, widened to F32 at load | 1.3 MB |
|
| 232 |
+
|
| 233 |
+
- The files are converted from the official ONNX model with `scripts/convert_silero_vad_to_gguf.py` in parakeet.cpp. The GGUF records the source version and the ONNX sha256. They were converted here, not trained.
|
| 234 |
+
- They need a parakeet.cpp build that has the standalone VAD API. That code is not in a release yet, so check the parakeet.cpp repository before relying on it.
|
| 235 |
+
- Use it as a stand-alone detector (`parakeet-cli vad --model silero-vad-f16.gguf --input audio.wav`) or to cut long audio before transcribing with any model, including those that have no VAD head (`parakeet-cli transcribe --model tdt-0.6b-v3-q8_0.gguf --input long.wav --vad --vad-model silero-vad-f16.gguf`).
|
| 236 |
+
- Probabilities match onnxruntime to about 1e-6 (F32) and 1e-3 (F16) on the test clips.
|
| 237 |
+
|
| 238 |
## Quantization notes
|
| 239 |
|
| 240 |
Quantization is applied **only** to the large linear weights fed directly into `ggml_mul_mat` (encoder FFN + attention projections, subsampling output projection, joint enc/pred projections). All other tensors (mel filterbank, LSTM prediction net, conv kernels, batch_norm stats, norms, biases, embeddings) stay F32.
|
|
|
|
| 265 |
- `nemotron-3.5-asr-streaming-0.6b-*` and `nemotron-3-diarization-*`: derived from NVIDIA Nemotron models, governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/).
|
| 266 |
- `ultra-*` and `redux-*`: see below.
|
| 267 |
|
| 268 |
+
The notes below add detail. `ultra-*.gguf` and `redux-*.gguf` are converted from [moondream/parakeet-ultra](https://huggingface.co/moondream/parakeet-ultra) and [moondream/parakeet-redux](https://huggingface.co/moondream/parakeet-redux) by Moondream, which are derived from NVIDIA's [parakeet-tdt-0.6b-v3](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3). Both are also CC-BY-4.0: credit Moondream and NVIDIA when you use these files. They were converted here, not trained, and the Redux F16 and Q8_0 files are dequantized from the ternary weights. `silero-vad-*.gguf` is converted from [Silero VAD](https://github.com/snakers4/silero-vad) v6.2.3 and is released under the MIT license, Copyright (c) 2020-present Silero Team; it was converted here, not trained. `nemotron-3-diarization-*.gguf` is derived from nvidia/Nemotron-3-Diarization and `nemotron-3.5-asr-streaming-0.6b-*.gguf` from nvidia/nemotron-3.5-asr-streaming-0.6b. Both are governed by the [OpenMDW License Agreement, version 1.1](https://openmdw.ai/license/1-1/). The parakeet.cpp runtime is MIT-licensed.
|