Inference Providers
Active filters: imatrix
mradermacher/dolphin-ultrafeedback-dpo-i1-GGUF
7B • Updated • 16
duyntnet/Nous-Hermes-2-SOLAR-10.7B-imatrix-GGUF
Text Generation
• 11B • Updated • 606
mradermacher/Rhea-125-v0.5-i1-GGUF
125B • Updated • 112
Felladrin/gguf-sharded-Phi-3-mini-4k-instruct-iMat
4B • Updated • 14
mradermacher/Exodius-70B-i1-GGUF
72B • Updated • 172
mmnga/Meta-Llama-3-8B-Instruct-gguf
8B • Updated • 644
bartowski/airoboros-dpo-70b-3.3-GGUF
Text Generation
• 71B • Updated • 394
• 2
mradermacher/Tess-2.0-Mixtral-8x22B-i1-GGUF
141B • Updated • 52
• 1
mradermacher/Qwen1.5-32B-i1-GGUF
33B • Updated • 280
mradermacher/Rummage-8B-i1-GGUF
8B • Updated • 58
mradermacher/Aura-Uncensored-OAS-8B-L3-i1-GGUF
8B • Updated • 639
• 2
mradermacher/Llama4Some-SOVL-4x8B-L3-V1-i1-GGUF
25B • Updated • 235
• 2
mradermacher/SOVL-Mega-Mash-L3-8B-i1-GGUF
8B • Updated • 16
bartowski/Yi-1.5-34B-Chat-GGUF
Text Generation
• 34B • Updated • 3.61k
• 26
mradermacher/Llama-3-8B-Instruct-abliterated-v2-i1-GGUF
8B • Updated • 727
• 2
mradermacher/Llama-3-8B-Instruct-abliterated-i1-GGUF
8B • Updated • 189
qwp4w3hyb/Yi-1.5-9B-Chat-iMat-GGUF
Text Generation
• 9B • Updated • 84
mradermacher/llama-3-70B-Instruct-abliterated-i1-GGUF
71B • Updated • 553
• 3
lmstudio-community/Yi-1.5-34B-Chat-GGUF
Text Generation
• 34B • Updated • 1.11k
• 9
duyntnet/Loyal-Macaroni-Maid-7B-imatrix-GGUF
Text Generation
• 7B • Updated • 1.62k
• 1
qwp4w3hyb/Yi-1.5-6B-Chat-iMat-GGUF
Text Generation
• 6B • Updated • 143
mradermacher/Ortho-SOVL-8B-L3-i1-GGUF
8B • Updated • 396
mradermacher/Meta-Llama-3-120b-LumiLumimaid-i1-GGUF
122B • Updated • 79
Lewdiculous/Puppy_Purpose_0.69-GGUF-IQ-Imatrix
8B • Updated • 333
• 4
Lewdiculous/llama-3-cat-8b-instruct-v1-GGUF-IQ-Imatrix
8B • Updated • 1.3k
• 17
bartowski/Cat-Llama-3-70B-instruct-GGUF
Text Generation
• 71B • Updated • 268
• 10
qwp4w3hyb/Yi-1.5-34B-Chat-iMat-GGUF
Text Generation
• 34B • Updated • 367
• 1
mradermacher/Yi-1.5-6B-Chat-i1-GGUF
6B • Updated • 253
duyntnet/Vistral-7B-Chat-imatrix-GGUF
Text Generation
• 7B • Updated • 483
• 1
mradermacher/Aura-Llama-Abliterated-i1-GGUF
11B • Updated • 158