divinetribe/Llama-3.3-70B-Instruct-abliterated-8bit-mlx
Text Generation • 20B • Updated • 1.32k • 3
Uncensored text MLX models for Apple Silicon, from 5 GB up to a 70B.
Note llama 3.3 70b, 8-bit. ~75 gb, the heaviest.
Note qwen3.6 27b, 4-bit. ~15 gb.
Note coding, reasoning-distilled, 4-bit. ~45 gb.
Note hermes 4 14b, 4-bit. ~8 gb.
Note the lightest, 4-bit. ~5 gb, easiest place to start.
Note gemma 4 31b, 4-bit. text only. the one i run daily. ~17 gb.
Note gemma 4 31b, huihui abliteration, 4-bit. text only. ~17 gb.
Note text-only build of the 12b for mlx-lm setups. ~11 gb.