Inference Providers
Active filters: imatrix
duyntnet/Phi-3-medium-128k-instruct-imatrix-GGUF
Text Generation
• 14B • Updated • 2.54k
bartowski/aya-23-35B-GGUF
Text Generation
• 35B • Updated • 702
• 29
lmstudio-community/aya-23-35B-GGUF
Text Generation
• 35B • Updated • 300
• 14
InferenceIllusionist/dolphin-2.9.1-mixtral-1x22b-iMat-GGUF
22B • Updated • 511
mradermacher/L3-8B-daybreak-stheno-v3.1-i1-GGUF
8B • Updated • 85
• 3
mradermacher/aya-23-8B-i1-GGUF
8B • Updated • 372
mradermacher/aya-23-35B-i1-GGUF
35B • Updated • 436
bartowski/dolphin-2.9.1-llama-3-70b-GGUF
Text Generation
• 71B • Updated • 1.14k
• 10
knifeayumu/LLM_Collection
32B • Updated • 16.4k
• 11
mradermacher/dolphin-2.9.1-mixtral-1x22b-i1-GGUF
22B • Updated • 1.47k
• 3
mradermacher/Meta-LLama-3-Cat-A-LLama-70b-i1-GGUF
71B • Updated • 278
mradermacher/badger-iota-llama-3-8b-i1-GGUF
8B • Updated • 151
bartowski/dolphin-2.9.1-mixtral-1x22b-GGUF
Text Generation
• 22B • Updated • 1.28k
• 9
Lewdiculous/Mahou-1.2-llama3-8B-GGUF-IQ-Imatrix
8B • Updated • 270
• 6
mradermacher/Halu-8B-Llama3-v0.3-i1-GGUF
8B • Updated • 236
• 1
mradermacher/Llama-3-Chatty-2x8B-i1-GGUF
14B • Updated • 118
• 1
duyntnet/internlm2-chat-7b-imatrix-GGUF
Text Generation
• 8B • Updated • 161
duyntnet/aya-23-8B-imatrix-GGUF
Text Generation
• 8B • Updated • 371
mradermacher/WestLake-10.7B-v2-i1-GGUF
11B • Updated • 52
mradermacher/Mirai-Nova-Mistral-LocalAI-7B-v0.1-i1-GGUF
7B • Updated • 115
lmstudio-community/openchat-3.6-8b-20240522-GGUF
Text Generation
• 8B • Updated • 147
• 7
mradermacher/Llama-Salad-4x8B-i1-GGUF
25B • Updated • 66
• 2
mradermacher/LLaMa-3-CursedStock-v1.6-8B-i1-GGUF
8B • Updated • 68
• 1
legraphista/Phi-3-mini-4k-instruct-IMat-GGUF
Text Generation
• 4B • Updated • 598
legraphista/RoLlama2-7b-Base-IMat-GGUF
Text Generation
• 7B • Updated • 848
legraphista/RoLlama2-7b-Chat-IMat-GGUF
Text Generation
• 7B • Updated • 365
legraphista/RoLlama2-7b-Instruct-IMat-GGUF
Text Generation
• 7B • Updated • 2.23k
duyntnet/Psyfighter-13B-imatrix-GGUF
Text Generation
• 13B • Updated • 321
mradermacher/Llama-3-70b-Arimas-story-RP-V1-i1-GGUF
71B • Updated • 615
• 1
lmstudio-community/deepseek-coder-6.7B-kexer-GGUF
Text Generation
• 7B • Updated • 2.7k
• 5