Inference Providers
Active filters: imatrix
mradermacher/Llama3.1-elm-turbo-6B-instruct-i1-GGUF
6B • Updated • 287
mradermacher/Lumimaid-Magnum-12B-i1-GGUF
12B • Updated • 407
• 5
mradermacher/L3.1-8B-sunfall-v0.6.1-dpo-i1-GGUF
8B • Updated • 314
• 3
YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja
8B • Updated • 101
mradermacher/Llama3.1-elm-turbo-4B-instruct-i1-GGUF
4B • Updated • 26
mradermacher/Llama3.1-elm-turbo-3B-instruct-i1-GGUF
3B • Updated • 72
Reiterate3680/LumiHathor-GGUF
Text Generation
• 8B • Updated mradermacher/llama3-8b-cpt-sea-lionv2-base-i1-GGUF
8B • Updated • 498
mradermacher/OLMo-1B-0724-hf-i1-GGUF
1B • Updated • 404
mradermacher/Bioinspired-Llama-3-1-70B-128k-alpha-i1-GGUF
71B • Updated • 248
mradermacher/Rude-Assistant-Mistral-Nemo-2407-SFT-i1-GGUF
12B • Updated • 43
• 2
mradermacher/MN-12B-Celeste-V1.9-i1-GGUF
12B • Updated • 775
• 4
mradermacher/LumiHathor-i1-GGUF
8B • Updated • 261
• 1
mradermacher/Yamase-12B-i1-GGUF
12B • Updated • 535
• 1
mradermacher/llama3-8b-cpt-sea-lionv2-instruct-i1-GGUF
8B • Updated • 594
• 1
mradermacher/calme-2.2-qwen2-72b-i1-GGUF
73B • Updated • 319
polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 11
mradermacher/shieldgemma-9b-i1-GGUF
9B • Updated • 469
• 1
polyverse/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 6
polyverse/Meta-Llama-3-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 10
polyverse/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 9
polyverse/gemma-2-2b-Q4_K_M-GGUF
Text Generation
• 3B • Updated • 32
polyverse/gemma-2-2b-it-Q4_K_M-GGUF
Text Generation
• 3B • Updated • 107
polyverse/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated • 6
polyverse/falcon-7b-Q4_K_M-GGUF
7B • Updated • 3
• 1
backyardai/Bionic-Cetacean-20B-GGUF
20B • Updated • 485
• 2
YukiTomita-CC/Llama-3-Swallow-8B-Instruct-v0.1-IMat-GGUF_dolly-15k-ja-prompt
8B • Updated • 184
• 1
fluidapp/meta-llama-3.1-8b-instruct-gguf
8B • Updated • 391
mradermacher/Evolved-Mistral-7B-i1-GGUF
7B • Updated • 17
• 1
qnixsynapse/Gemma-V2-2B-Instruct-GGUF
Text Generation
• 3B • Updated • 40