Inference Providers
Active filters: imatrix
bartowski/Yi-1.5-34B-Chat-16K-GGUF
Text Generation
• 34B • Updated • 1.02k
• 6
mradermacher/Deep-Miqu-103B-i1-GGUF
103B • Updated • 83
• 1
fluidapp/meta-llama-3-8b-instruct-gguf
8B • Updated • 30
mradermacher/L3_SnowStorm_4x8B-i1-GGUF
25B • Updated • 507
• 4
mradermacher/MAmmoTH2-8x7B-Plus-i1-GGUF
47B • Updated • 287
duyntnet/HamSter-0.2-imatrix-GGUF
Text Generation
• 7B • Updated • 507
mradermacher/MAmmoTH2-8x7B-i1-GGUF
47B • Updated • 260
duyntnet/TenyxChat-7B-v1-imatrix-GGUF
Text Generation
• 7B • Updated • 258
mradermacher/Llama-3-70Bx2-MOE-i1-GGUF
127B • Updated • 180
• 1
shing3232/sakura-14b-qwen2beta-v0.9.2-IMX
14B • Updated • 78
• 3
qwp4w3hyb/Phi-3-medium-128k-instruct-iMat-GGUF
Text Generation
• 14B • Updated • 287
• 4
bartowski/Phi-3-medium-4k-instruct-GGUF
Text Generation
• 14B • Updated • 5.57k
• 39
bartowski/Phi-3-medium-128k-instruct-GGUF
Text Generation
• 14B • Updated • 4.48k
• 61
InferenceIllusionist/Llama3-ChatQA-1.5-8B-iMat-GGUF
8B • Updated • 114
duyntnet/Phi-3-medium-4k-instruct-imatrix-GGUF
Text Generation
• 14B • Updated • 1.29k
mradermacher/HelpingAI-9B-i1-GGUF
9B • Updated • 580
mradermacher/L3-8B-Stheno-v3.1-i1-GGUF
8B • Updated • 274
• 1
mradermacher/FinalFintetuning-XVIII-v1.1-2x8B-i1-GGUF
14B • Updated • 227
• 1
hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF
Text Generation
• 14B • Updated • 1.07k
• 1
duyntnet/IceLatteRP-7b-imatrix-GGUF
Text Generation
• 7B • Updated • 346
• 1
Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix
7B • Updated • 511
• 5
SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf
Text Generation
• 4B • Updated • 23
mmnga/Phi-3-medium-128k-instruct-gguf
14B • Updated • 1.2k
• 5
duyntnet/Phi-SoSerious-Mini-V1-imatrix-GGUF
Text Generation
• 4B • Updated • 604
• 2
mradermacher/Smaug-Llama-3-70B-Instruct-abliterated-v3-i1-GGUF
71B • Updated • 790
• 5
hermes42/Mistral-7B-Instruct-v0.3-imatrix-GGUF
Text Generation
• 7B • Updated • 502
• 4
duyntnet/Mistral-7B-Instruct-v0.3-imatrix-GGUF
Text Generation
• 7B • Updated • 817
qwp4w3hyb/Phi-3-medium-4k-instruct-iMat-GGUF
Text Generation
• 14B • Updated • 142
mradermacher/llama-3-daybreak-v0.3-70b-hf-i1-GGUF
71B • Updated • 60
mradermacher/dolphin-2.9.1-llama-3-70b-i1-GGUF
71B • Updated • 1.02k
• 1