Inference Providers
Active filters: imatrix
mradermacher/Meltemi-7B-Instruct-v1-i1-GGUF
7B • Updated • 1.22k
Vdr1/nemo-sunfall-v0.6.1-GGUF-IQ
12B • Updated • 91
• 3
mradermacher/shieldgemma-27b-i1-GGUF
27B • Updated • 243
3B • Updated • 489
• 1
mmnga/HODACHI-EZO-Common-T2-2B-gemma-2-it-gguf
3B • Updated • 698
• 5
mradermacher/Hansoldeco-Gemma-2-9b-it-v0.2-i1-GGUF
9B • Updated • 1.16k
mradermacher/Nemo-12B-Marlin-v1-i1-GGUF
12B • Updated • 97
• 1
mradermacher/Mixnu-i1-GGUF
20B • Updated • 190
kaetemi/Meta-Llama-3-8B-Q4_K_M-GGUF-c3o12
Text Generation
• 8B • Updated • 5
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o12
Text Generation
• 8B • Updated • 10
MugenYume/elm-turbo-0.25-instruct-Q4_K_M-GGUF
2B • Updated • 4
mradermacher/Llama-Phi-3_DoRA-i1-GGUF
4B • Updated • 442
MugenYume/elm-turbo-0.50-instruct-Q4_K_M-GGUF
2B • Updated • 6
ngxson/wllama-split-models
3B • Updated • 105
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-c3o14
Text Generation
• 8B • Updated • 17
mradermacher/MN-12B-Starcannon-v2-i1-GGUF
12B • Updated • 312
• 8
Reiterate3680/MN-12B-Starcannon-v2-GGUF
Text Generation
• 12B • Updated • 20
• 2
mradermacher/SaulLM-54B-Instruct-i1-GGUF
47B • Updated • 765
• 5
MaziyarPanahi/calme-2.2-qwen2-72b-GGUF
Text Generation
• 73B • Updated • 135
• 2
Mihaiii/shieldgemma-2b-Q5_K_M-GGUF
Text Generation
• 3B • Updated • 44
mradermacher/Bioinspired-Llama-3-1-8B-128k-alpha-i1-GGUF
8B • Updated • 168
Felladrin/gguf-sharded-gemma-2-2b-it-abliterated
3B • Updated • 168
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
• 71B • Updated • 1.27k
• 10
bartowski/Palmyra-Med-70B-32K-GGUF
Text Generation
• 71B • Updated • 1.12k
• 4
matrixportalx/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation
• 8B • Updated • 15
Felladrin/gguf-sharded-Qwen2-1.5B-Instruct-imat
Text Generation
• 2B • Updated • 37
Reiterate3680/Sekhmet_Gimmel-L3.1-8B-v0.3-GGUF
Text Generation
• 8B • Updated • 31
bartowski/Palmyra-Fin-70B-32K-GGUF
Text Generation
• 71B • Updated • 1.04k
• 5
mradermacher/Nous-Hermes-2-Mistral-7B-DPO-prune-i1-GGUF
7B • Updated • 32
mradermacher/Evolved-Llama3-8B-i1-GGUF
7B • Updated • 285
• 1