Hugging Face's logo

Teaspoon-AI
/
Voxtral-Mini-4B-INT4-Jetson

speech-to-text
voxtral
mistral
int4
quantized
marlin
jetson
edge
realtime
streaming
Model card Files
xet
 Community
Voxtral-Mini-4B-INT4-Jetson / scripts /quantize_marlin.py

Commit History

Single-file Marlin INT4: direct RTN quantization, no GPTQ intermediate
22a85ee
verified

tsp-stefano commited on