Inference Providers
Active filters: imatrix
mradermacher/Mahou-Gutenberg-Nemo-12B-i1-GGUF
12B • Updated • 56
• 2
mradermacher/Carasique-v0.3b-i1-GGUF
12B • Updated • 137
• 1
MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF
Text Generation
• 2B • Updated • 798
• 7
mradermacher/Magnum-Instruct-DPO-12B-i1-GGUF
12B • Updated • 156
• 1
mradermacher/Swallow-MX-8x7b-NVE-v0.1-i1-GGUF
47B • Updated • 1.32k
Trisert/Meta-Llama-3.1-8B-Instruct-abliterated-IQ4_NL-GGUF
8B • Updated • 10
Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation
• 8B • Updated • 4
• 1
anthracite-org/magnum-v2-123b-gguf
Text Generation
• 123B • Updated • 159
• 14
mradermacher/L3.1-70b-Inori-i1-GGUF
71B • Updated • 284
• 1
mradermacher/Fireball-Llama-3.1-8B-Instruct-v1-16bit-i1-GGUF
8B • Updated • 335
mradermacher/MN-12B-Starcannon-v5-unofficial-i1-GGUF
12B • Updated • 59
• 1
mradermacher/Samantha-hermes3-8b-model-fixed-i1-GGUF
8B • Updated • 61
• 1
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_S-GGUF
Text Generation
• 8B • Updated • 24
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 15
Reiterate3680/AuraFinal12B-GGUF
Text Generation
• 12B • Updated • 2
• 1
OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 53
mradermacher/SaulLM-141-Base-i1-GGUF
141B • Updated • 109
Reiterate3680/Hollow-Tail-V1-12B-GGUF
Text Generation
• 12B • Updated • 5
• 1
Cran-May/ghost-8b-beta-1608-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 13
4B • Updated • 10
mradermacher/L3.1-70b-Ginny-i1-GGUF
71B • Updated • 159
anthracite-org/magnum-v2-72b-gguf
Text Generation
• 73B • Updated • 798
• 3
DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF
8B • Updated • 89
duyntnet/storytime-13b-imatrix-GGUF
Text Generation
• 13B • Updated • 325
mradermacher/Llama-3.1-8B-Stheno-v3.4-i1-GGUF
8B • Updated • 669
• 2
mradermacher/Fireball-Mistral-Nemo-Base-2407-sft-v1-i1-GGUF
12B • Updated • 426
• 1
mradermacher/IceTea21EnergyDrinkRPV10-i1-GGUF
7B • Updated • 11
• 1
mradermacher/KamalaHarris-Llama-3.1-8B-Chat-i1-GGUF
8B • Updated • 147
mradermacher/Llama-3.1-Storm-8B-i1-GGUF
8B • Updated • 573
• 3
mradermacher/DonaldTrump-Llama3.1-8B-Chat-i1-GGUF
8B • Updated • 73
• 1