thucdangvan020999/polyglot-lion-0.6b-3bit

This model was converted to MLX format from knoveleng/polyglot-lion-0.6b using mlx-audio version 0.4.3.

Refer to the original model card for more details on the model.

Use with mlx-audio

pip install -U mlx-audio

CLI Example:

python -m mlx_audio.stt.generate --model thucdangvan020999/polyglot-lion-0.6b-3bit --audio "audio.wav"

Python Example:

from mlx_audio.stt.utils import load_model
from mlx_audio.stt.generate import generate_transcription

model = load_model("thucdangvan020999/polyglot-lion-0.6b-3bit")
transcription = generate_transcription(
    model=model,
    audio_path="path_to_audio.wav",
    output_path="path_to_output.txt",
    format="txt",
    verbose=True,
)
print(transcription.text)
Downloads last month
11
Safetensors
Model size
0.3B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

3-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for thucdangvan020999/polyglot-lion-0.6b-3bit

Quantized
(19)
this model

Datasets used to train thucdangvan020999/polyglot-lion-0.6b-3bit