Inference Providers
Active filters: imatrix
mradermacher/Interim-MN-fp16-i1-GGUF
12B • Updated • 68
mradermacher/NemoRemix-Magnum_V2_Base-12B-i1-GGUF
12B • Updated • 126
• 2
mradermacher/Gemma-2-Ataraxy-9B-i1-GGUF
9B • Updated • 279
• 10
lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF
Text Generation
• 3B • Updated • 20
mradermacher/Llama3-Med42-70B-i1-GGUF
71B • Updated • 569
• 1
Felladrin/gguf-q5_k_l-imat-arcee-lite
2B • Updated • 17
Nekuromento/Gemma2-Nephilim-v3-9B-Q5_K_M-GGUF
Text Generation
• 9B • Updated • 11
team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-GGUF
47B • Updated • 140
• 1
anthracite-org/magnum-v2.5-12b-kto-gguf
Text Generation
• 12B • Updated • 854
• 42
mradermacher/EpistemeAI-codegemma-2-9b-ultra-i1-GGUF
9B • Updated • 253
• 1
Reiterate3680/Rocinante-12B-v1b-GGUF
Text Generation
• 12B • Updated • 20
mradermacher/IridiumLlama-72B-v0.1-i1-GGUF
73B • Updated • 261
mradermacher/Alpaca-CodeLlama-3.1-8B-i1-GGUF
8B • Updated • 106
mradermacher/NemoReRemix-12B-i1-GGUF
12B • Updated • 272
• 3
Reiterate3680/magnum-12b-v2.5-kto-GGUF
Text Generation
• 12B • Updated • 12
• 2
mradermacher/New-Dawn-Llama-3.1-70B-v1.1-i1-GGUF
71B • Updated • 38
• 6
mradermacher/LongWriter-llama3.1-8b-i1-GGUF
8B • Updated • 361
• 3
mradermacher/CeleMo-Instruct-128k-i1-GGUF
12B • Updated • 424
• 1
Reiterate3680/Aura-NeMo-12B-GGUF
Text Generation
• 12B • Updated • 24
• 2
mradermacher/Aura32k-i1-GGUF
7B • Updated • 231
• 1
duyntnet/Meta-Llama-3.1-8B-imatrix-GGUF
Text Generation
• 8B • Updated • 409
mradermacher/Iridium-72B-v0.1-i1-GGUF
73B • Updated • 454
mradermacher/TypeII-12B-i1-GGUF
12B • Updated • 9
• 1
mradermacher/Tess-3-Mistral-Nemo-12B-i1-GGUF
12B • Updated • 379
• 1
mradermacher/guanaco-33b-lxctx-PI-16384-LoRA-fp16-i1-GGUF
33B • Updated • 63
mradermacher/Wizard-Vicuna-30B-Uncensored-lxctx-PI-16384-LoRA-fp16-i1-GGUF
33B • Updated • 125
mradermacher/TypeII-A-12B-i1-GGUF
12B • Updated • 377
• 1
bartowski/Hermes-3-Llama-3.1-70B-GGUF
Text Generation
• 71B • Updated • 10.1k
• 10
mradermacher/Dracarys-72B-Instruct-i1-GGUF
73B • Updated • 123
mradermacher/OpenCrystal-Instruct-128k-i1-GGUF
12B • Updated • 358