Qwen3.8-27B Quantizations - a Chungulus Collection

Chungulus 's Collections

Qwen3.8-27B Quantizations

Agents-A1 imatrix GGUF Fable5 calibrated

Qwen3.8-27B Quantizations

updated Aug 18

Deployment quantizations of the vanilla Qwen/Qwen3.8-27B model.

Chungulus/Qwen3.8-27B-GPTQ-INT4-G128

Image-Text-to-Text • 28B • Updated Aug 16 • 692 • 3
Chungulus/Qwen3.8-27B-GPTQ-INT4-G32

Image-Text-to-Text • 28B • Updated Aug 16 • 341 • 3
Chungulus/Qwen3.8-27B-Q2_K-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 632 • 2

Note Standalone Q2_K GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q3_K_S-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 861 • 4

Note Standalone Q3_K_S GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q3_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 5.8k • 3

Note Standalone Q3_K_M GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q3_K_L-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 1.08k • 3

Note Standalone Q3_K_L GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-IQ4_XS-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 517 • 2

Note Standalone IQ4_XS GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-IQ4_NL-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 478 • 3

Note Standalone IQ4_NL GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q4_K_S-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 148 • 2

Note Standalone Q4_K_S GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 641 • 2

Note Standalone Q4_K_M GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q5_K_S-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 113 • 2

Note Standalone Q5_K_S GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q5_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 1.89k • 3

Note Standalone Q5_K_M GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q6_K-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 1.59k • 3

Note Standalone Q6_K GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-Q8_0-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 963 • 2

Note Standalone Q8_0 GGUF; vision projector included; MTP retained without acceleration claim; source 1d4bf0f2ff60
Chungulus/Qwen3.8-27B-EXL3

Image-Text-to-Text • 10B • Updated Aug 16 • 60 • 4
Chungulus/Qwen3.8-27B-GPTQ-INT8

Image-Text-to-Text • 28B • Updated Aug 16 • 332 • 2
Chungulus/Qwen3.8-27B-FP8

Image-Text-to-Text • 28B • Updated Aug 18 • 65 • 2
Chungulus/Qwen3.8-27B-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 512 • 2
Chungulus/Qwen3.8-27B-IMATRIX-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 182 • 2
Chungulus/Qwen3.8-27B-JANG_4S

Image-Text-to-Text • 5B • Updated Aug 15 • 32 • 2
Chungulus/Qwen3.8-27B-JANG_6M

Image-Text-to-Text • 7B • Updated Aug 15 • 18 • 2
Chungulus/Qwen3.8-27B-MLX-3bit-Group32

Image-Text-to-Text • 5B • Updated Aug 16 • 80 • 2
Chungulus/Qwen3.8-27B-MLX-4bit

Image-Text-to-Text • 5B • Updated Aug 15 • 66 • 2
Chungulus/Qwen3.8-27B-MLX-4bit-Group32

Image-Text-to-Text • 6B • Updated Aug 16 • 46 • 2
Chungulus/Qwen3.8-27B-MLX-5bit

Image-Text-to-Text • 6B • Updated Aug 15 • 51 • 3
Chungulus/Qwen3.8-27B-MLX-5bit-Group128

Image-Text-to-Text • 5B • Updated Aug 16 • 41 • 2
Chungulus/Qwen3.8-27B-MLX-5bit-Group32

Image-Text-to-Text • 6B • Updated Aug 16 • 40 • 2
Chungulus/Qwen3.8-27B-MLX-6bit

Image-Text-to-Text • 6B • Updated Aug 15 • 73 • 2
Chungulus/Qwen3.8-27B-MLX-6bit-Group32

Image-Text-to-Text • 7B • Updated Aug 16 • 55 • 2
Chungulus/Qwen3.8-27B-MLX-8bit

Image-Text-to-Text • 8B • Updated Aug 15 • 45 • 2
Chungulus/Qwen3.8-27B-MLX-8bit-Group32

Image-Text-to-Text • 9B • Updated Aug 16 • 47 • 2
Chungulus/Qwen3.8-27B-MLX-MXFP4

Image-Text-to-Text • 6B • Updated Aug 15 • 52 • 2
Chungulus/Qwen3.8-27B-MLX-MXFP8

Image-Text-to-Text • 8B • Updated Aug 15 • 56 • 2
Chungulus/Qwen3.8-27B-MLX-oQ4e-MTP

Image-Text-to-Text • 5B • Updated Aug 16 • 77 • 2
Chungulus/Qwen3.8-27B-MLX-oQ5

Image-Text-to-Text • 6B • Updated Aug 16 • 47 • 2
Chungulus/Qwen3.8-27B-MLX-oQ8

Image-Text-to-Text • 8B • Updated Aug 16 • 45 • 2
Chungulus/Qwen3.8-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated Aug 15 • 185 • 3