GEHIRNS/magi-1.0
Text Generation • 4B • Updated • 1.25k • 4
Training-free mixed-precision Qwen3.5-4B for 12 GB GPUs. With an 8-bit KV cache: 96% of BF16's score in 30% of the memory, 2.7x faster.
Note Recommended. 1.80 GiB GGUF, ID 0.893 with an 8-bit KV cache (3.0x BF16), 181 tok/s on an RTX 5070.