Inference Providers
Active filters: imatrix
MugenYume/Phi-3-mini-4k-instruct-IQ4_NL-GGUF
Text Generation
• 4B • Updated • 4
MugenYume/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated • 9
MugenYume/Phi-3-mini-4k-instruct-Q5_K_M-GGUF
Text Generation
• 4B • Updated • 6
NickLamb/Mistral-7B-Instruct-v0.3
7B • Updated • 9
mradermacher/Mixtral-instruct-56B-i1-GGUF
47B • Updated • 618
bartowski/DeepSeek-V2-Chat-0628-GGUF
Text Generation
• 236B • Updated • 691
• 7
mmnga/pfnet-Llama3-Preferred-MedSwallow-70B-gguf
71B • Updated • 1.44k
qwp4w3hyb/Mistral-Nemo-Instruct-2407-iMat-GGUF
Text Generation
• 12B • Updated • 256
• 6
aifeifei798/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated • 14
aifeifei798/Phi-3-mini-4k-instruct-IQ4_NL-GGUF
Text Generation
• 4B • Updated • 12
bartowski/Arcee-Nova-GGUF
Text Generation
• 73B • Updated • 138
• 5
mradermacher/L3-Hecate-8B-v1.2-i1-GGUF
8B • Updated • 164
nisten/deepseek-0628-gguf
236B • Updated • 338
• 35
mradermacher/Einstein-v4-7B-i1-GGUF
7B • Updated • 918
• 1
mradermacher/civic-ai-llama-i1-GGUF
8B • Updated • 122
mradermacher/SaoRPM-2x8B-i1-GGUF
14B • Updated • 591
• 2
mradermacher/llama-3-tulu-2-dpo-70b-i1-GGUF
71B • Updated • 24
mradermacher/Arcee-Nova-i1-GGUF
73B • Updated • 127
mradermacher/llama-3-tulu-2-8b-i1-GGUF
8B • Updated • 376
duyntnet/Qwen1.5-7B-Chat-imatrix-GGUF
Text Generation
• 8B • Updated • 275
mradermacher/openbuddy-zero-14b-v22.3-32k-i1-GGUF
14B • Updated • 408
mradermacher/llama-3-tulu-2-dpo-8b-i1-GGUF
8B • Updated • 301
mradermacher/StellarDong-72b-i1-GGUF
73B • Updated • 138
mradermacher/Samantha-qwen-0.5b-ptbr-i1-GGUF
0.5B • Updated • 433
• 1
mradermacher/DiagnosisGPT-6B-i1-GGUF
6B • Updated • 61
mradermacher/L3-8B-Celeste-V1.2-i1-GGUF
8B • Updated • 39
mradermacher/Tiger-Gemma-9B-v2-i1-GGUF
9B • Updated • 109
• 1
mradermacher/BeyondInfinity-v2-4x7B-i1-GGUF
24B • Updated • 679
• 2
bartowski/turbcat-instruct-72b-GGUF
Text Generation
• 73B • Updated • 152
• 2
mradermacher/stablelm-tuned-alpha-7b-i1-GGUF
8B • Updated • 789
• 1