Initial 4bit quantized release (mlx-whisper compatible)

d995029

verified

youngouk commited on 9 days ago