ValueError: [quantize] The requested number of bits 3 is not supported. The supported bits are 2, 4 and 8.

by sauterne - opened Nov 30, 2024

It seems that no support for 3bit? How to use this model?

MLX Community org Nov 30, 2024

update your mlx version to v0.21

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment