| license: apache-2.0 | |
| base_model: | |
| - inflatebot/MN-12B-Mag-Mell-R1 | |
| base_model_relation: quantized | |
| pipeline_tag: text-generation | |
| library_name: safetensors | |
| tags: | |
| - exl3 | |
| - 4-bit | |
| - 6-bit | |
| - 8-bit | |
| ## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/MN-12B-Mag-Mell-R1_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/MN-12B-Mag-Mell-R1_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/MN-12B-Mag-Mell-R1_EXL3/tree/H8-8.0BPW) ] | |
| # Original model: [MN-12B-Mag-Mell-R1](https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1) by [inflatebot](https://huggingface.co/inflatebot) | |