Inference Providers
Active filters: imatrix
bartowski/Palmyra-Med-70B-32K-GGUF
Text Generation
• 71B • Updated • 1.11k
• 4
matrixportalx/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF
Text Generation
• 8B • Updated • 15
Felladrin/gguf-sharded-Qwen2-1.5B-Instruct-imat
Text Generation
• 2B • Updated • 37
Reiterate3680/Sekhmet_Gimmel-L3.1-8B-v0.3-GGUF
Text Generation
• 8B • Updated • 46
bartowski/Palmyra-Fin-70B-32K-GGUF
Text Generation
• 71B • Updated • 1.03k
• 5
mradermacher/Nous-Hermes-2-Mistral-7B-DPO-prune-i1-GGUF
7B • Updated • 31
mradermacher/Evolved-Llama3-8B-i1-GGUF
7B • Updated • 409
• 1
mradermacher/Bioinspired-Llama-3-1-8B-128k-gamma-i1-GGUF
8B • Updated • 286
mradermacher/Infinity-Instruct-7M-0729-mistral-7B-i1-GGUF
7B • Updated • 577
• 1
mradermacher/Nemo-12B-Marlin-v2-i1-GGUF
12B • Updated • 93
• 1
mradermacher/Meltemi-7B-v1.5-i1-GGUF
7B • Updated • 454
mradermacher/LocalAI-Llama3.1-8b-Function-Call-v0.3-i1-GGUF
8B • Updated • 342
• 1
mradermacher/lama-2-7b-chat-hf-playbooks-finetuned-i1-GGUF
7B • Updated • 85
mradermacher/tamilan-2-27b-i1-GGUF
27B • Updated • 94
kaetemi/falcon-11B-Q4_K_M-GGUF-its-garbage
11B • Updated • 14
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-4lc
Text Generation
• 8B • Updated • 6
polyverse/Meta-Llama-3.1-8B-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 50
mradermacher/Mistral-Large-218B-Instruct-i1-GGUF
218B • Updated • 115
• 3
mradermacher/Waie1-i1-GGUF
71B • Updated • 52
mradermacher/Gemma-2-27B-Chinese-Chat-i1-GGUF
27B • Updated • 368
mradermacher/FinChat298B_Llama-3.1-8Bi-i1-GGUF
8B • Updated • 425
mradermacher/Evolved-Llama3-ELYZA-Uncensored-8B-i1-GGUF
8B • Updated • 67
polyverse/Meta-Llama-3-8B-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 7
mradermacher/Med-Llama3-0.5-i1-GGUF
8B • Updated • 30
bartowski/Llama-3.1-70B-Instruct-lorablated-GGUF
Text Generation
• 71B • Updated • 2k
• 21
mradermacher/Yi-34B-200K-HESOYAM-TURTLE-0208-i1-GGUF
34B • Updated • 173
duyntnet/TableLLM-13b-imatrix-GGUF
Text Generation
• 13B • Updated • 753
Reiterate3680/MN-12B-Lyra-v1-GGUF
Text Generation
• 12B • Updated • 55
mradermacher/US-mag-mini-21b-i1-GGUF
20B • Updated • 78
mradermacher/Infinity-Instruct-7M-0729-Llama3_1-70B-i1-GGUF
71B • Updated • 1.27k