Inference Providers
Active filters: imatrix
mradermacher/nyun-c1-llama3-60B-i1-GGUF
60B • Updated • 186
mradermacher/nyun-c1-llama3-62B-i1-GGUF
62B • Updated • 100
Text Generation
• 3B • Updated • 779
• 208
mradermacher/llama3-8B-DarkIdol-1.0-i1-GGUF
8B • Updated • 351
• 2
mradermacher/prometheus-2-llama-3-8b-i1-GGUF
8B • Updated • 705
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation
• 16B • Updated • 130k
• 182
mradermacher/Samantha-Qwen2-7B-i1-GGUF
8B • Updated • 306
• 2
lmstudio-community/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation
• 16B • Updated • 24.2k
• 90
mradermacher/Stheno-TheSpice-v1-i1-GGUF
8B • Updated • 176
legraphista/DeepSeek-Coder-V2-Lite-Instruct-IMat-GGUF
Text Generation
• 16B • Updated • 3.48k
• 9
bartowski/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation
• 16B • Updated • 1.53k
• 9
legraphista/DeepSeek-Coder-V2-Lite-Base-IMat-GGUF
Text Generation
• 16B • Updated • 1.09k
• 2
dreamgen/opus-v1.4-70b-llama3-gguf
Text Generation
• 71B • Updated • 208
• 4
CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF
16B • Updated • 2.25k
• 3
legraphista/DeepSeek-Coder-V2-Instruct-IMat-GGUF
Text Generation
• 236B • Updated • 491
• 6
mradermacher/Augmentasanguis-8x7B-i1-GGUF
47B • Updated • 81
• 1
mradermacher/AmberChat-i1-GGUF
7B • Updated • 822
DavidAU/DarkForest-20B-V3-Ultra-Quality-ImatP2-GGUF
Text Generation
• 20B • Updated • 263
• 9
mradermacher/HumanlikeRP-i1-GGUF
9B • Updated • 557
• 1
mradermacher/DeepSeek-Coder-V2-Lite-Instruct-i1-GGUF
16B • Updated • 1.9k
• 2
duyntnet/chronos-13b-v2-imatrix-GGUF
Text Generation
• 13B • Updated • 343
mradermacher/Storm-7B-i1-GGUF
7B • Updated • 380
• 1
alpindale/magnum-72b-v1-gguf
73B • Updated • 26
• 4
Quant-Cartel/magnum-72b-v1-iMat-GGUF
73B • Updated • 1.22k
• 3
mradermacher/L3-Umbral-Mind-RP-v1.0-8B-i1-GGUF
8B • Updated • 74
• 1
mradermacher/magnum-72b-v1-i1-GGUF
73B • Updated • 337
• 10
mradermacher/Sycho-8B-L3-RP-i1-GGUF
8B • Updated • 67
• 1
mradermacher/L3-Nymeria-15B-i1-GGUF
15B • Updated • 153
• 11
mradermacher/SuperQwen2-7B-Chat-i1-GGUF
8B • Updated • 68
• 1
mradermacher/colossus_120b-i1-GGUF
118B • Updated • 76
• 1