majentik/Qwen3.5-27B-RotorQuant-GGUF-IQ4_XS
Text Generation • 27B • Updated • 23
Qwen 3.5 — quantized
Quantized GGUF and MLX packs of the Qwen 3.5 model family, including the 397B-A17B MoE.
-
-
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q2_K
Text Generation • 27B • Updated • 19 • 2 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q3_K_M
Text Generation • 27B • Updated • 35 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q4_K_M
Text Generation • 27B • Updated • 9 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q5_K_M
Text Generation • 27B • Updated • 35 -
majentik/Qwen3.5-27B-RotorQuant-GGUF-Q8_0
Text Generation • 27B • Updated • 19 -
majentik/Qwen3.5-27B-RotorQuant-MLX-2bit
Text Generation • 27B • Updated • 107 -
majentik/Qwen3.5-27B-RotorQuant-MLX-4bit
Text Generation • 27B • Updated • 110 -
majentik/Qwen3.5-27B-RotorQuant-MLX-8bit
Text Generation • 27B • Updated • 63 -
majentik/Qwen3.5-27B-TurboQuant-MLX-2bit
Text Generation • 27B • Updated • 96 -
majentik/Qwen3.5-27B-TurboQuant-MLX-4bit
Text Generation • 27B • Updated • 128 • 2 -
majentik/Qwen3.5-27B-TurboQuant-MLX-8bit
Text Generation • 27B • Updated • 62 -
majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-2bit
Image-Text-to-Text • 38B • Updated • 100 -
majentik/Qwen3.5-397B-A17B-RotorQuant-MLX-8bit
Image-Text-to-Text • 112B • Updated • 48 -
majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-2bit
Image-Text-to-Text • 38B • Updated • 82 -
majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-4bit
Image-Text-to-Text • 62B • Updated • 65 -
majentik/Qwen3.5-397B-A17B-TurboQuant-MLX-8bit
Image-Text-to-Text • 112B • Updated • 71 • 1 -
majentik/Qwen3.5-27B-RotorQuant
Text Generation • Updated • 1 -
majentik/Qwen3.5-27B-RotorQuant-2bit
Text Generation • Updated • 1 -
majentik/Qwen3.5-27B-TurboQuant
Text Generation • Updated -
majentik/Qwen3.5-27B-TurboQuant-2bit
Text Generation • Updated -
majentik/Qwen3.5-397B-A17B-RotorQuant
Image-Text-to-Text • Updated -
majentik/Qwen3.5-397B-A17B-TurboQuant
Image-Text-to-Text • Updated • 1