parakeet-rnnt-1.1b-coreml-int8

CoreML conversion of nvidia/parakeet-rnnt-1.1b β€” INT8 PER CHANNEL SYMMETRIC quantized.

Architecture RNNT
Language English
Sample rate 16000 Hz
Max audio 15.0s
Vocab size 1024
Framework NVIDIA NeMo β†’ CoreML (coremltools)

Components

File Component Best compute
parakeet_mel_encoder.mlpackage mel_encoder ANE / GPU
parakeet_decoder.mlpackage decoder CPU only
parakeet_joint_decision_single_step.mlpackage joint_decision_single_step ANE / GPU

Usage

pip install ovos-stt-plugin-coreml
from ovos_stt_plugin_coreml import CoremlSTT
from ovos_plugin_manager.utils.audio import AudioFile

stt = CoremlSTT(config={"metadata": "metadata.json"})

with AudioFile("speech.wav") as f:
    audio = f.read()
print(stt.execute(audio))

Source model

nvidia/parakeet-rnnt-1.1b

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for OpenVoiceOS/parakeet-rnnt-1.1b-coreml-int8

Quantized
(13)
this model

Collection including OpenVoiceOS/parakeet-rnnt-1.1b-coreml-int8