plawanrath/phi-3.5-mini-instruct-q3-mlx-cba
Text Generation • 0.5B • Updated • 325
Quantization Undoes Alignment — IEEE Cloud Summit 2026
MLX artifacts for the IEEE Cloud Summit 2026 paper. 3 LLMs × 5 precisions (BF16/Q8/Q6/Q4/Q3, gs=64).
-
-
plawanrath/phi-3.5-mini-instruct-q4-mlx-cba
Text Generation • 0.6B • Updated • 200 -
plawanrath/phi-3.5-mini-instruct-q6-mlx-cba
Text Generation • 0.8B • Updated • 90 -
plawanrath/mistral-7b-instruct-v0.3-q3-mlx-cba
Text Generation • 0.9B • Updated • 314 -
plawanrath/qwen2.5-7b-instruct-q3-mlx-cba
Text Generation • 1.0B • Updated • 123 -
plawanrath/mistral-7b-instruct-v0.3-q4-mlx-cba
Text Generation • 1B • Updated • 229 -
plawanrath/phi-3.5-mini-instruct-q8-mlx-cba
Text Generation • 1B • Updated • 115 -
plawanrath/qwen2.5-7b-instruct-q4-mlx-cba
Text Generation • 1B • Updated • 94 -
plawanrath/mistral-7b-instruct-v0.3-q6-mlx-cba
Text Generation • 7B • Updated • 216 -
plawanrath/qwen2.5-7b-instruct-q6-mlx-cba
Text Generation • 8B • Updated • 48 -
plawanrath/phi-3.5-mini-instruct-bf16-mlx-cba
Text Generation • 4B • Updated • 174 -
plawanrath/mistral-7b-instruct-v0.3-q8-mlx-cba
Text Generation • 7B • Updated • 325 -
plawanrath/qwen2.5-7b-instruct-q8-mlx-cba
Text Generation • 8B • Updated • 87 -
plawanrath/mistral-7b-instruct-v0.3-bf16-mlx-cba
Text Generation • 7B • Updated • 370 • -
plawanrath/qwen2.5-7b-instruct-bf16-mlx-cba
Text Generation • 8B • Updated • 36