mlx-community

/

Step-3.5-Flash-8bit

like 2

Follow

MLX Community 8.88k

Any diffs between this version and the 6bit one besides quant precision? The 6bit one outputs fine, but the 8bit one's doing this:

USER: Hi

Step: 
<Thought for a brief moment>
aulas  ’ plaatsを: zeer coraz the

runtime: LM Studio MLX 1.3.0