Inference Providers
Active filters: 4bit
legraphista/Minitron-4B-Base-GGUF
Text Generation
• 4B • Updated • 68
legraphista/Minitron-8B-Base-GGUF
Text Generation
• 8B • Updated • 104
legraphista/Llama-3.1-Storm-8B-IMat-GGUF
Text Generation
• 8B • Updated • 860
legraphista/Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
• 4B • Updated • 683
• 1
legraphista/Mistral-NeMo-Minitron-8B-Base-IMat-GGUF
Text Generation
• 8B • Updated • 403
• 1
legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
• 4B • Updated • 181
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Text Generation
• 2B • Updated • 51
• 3
speakleash/Bielik-11B-v2.2-Instruct-Quanto-4bit
Text Generation
• 6B • Updated • 20
• 3
alexwww94/glm-4v-9b-gptq-4bit
14B • Updated • 250
• 7
0xroyce/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
• 8B • Updated • 871
• 7
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
• 104B • Updated • 208
• 6
jhangmez/CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 27
• 1
legraphista/xLAM-7b-r-IMat-GGUF
Text Generation
• 7B • Updated • 121
jhangmez/CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 687
• 3
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
• 47B • Updated • 191
• 1
legraphista/xLAM-8x22b-r-IMat-GGUF
Text Generation
• 141B • Updated • 129
legraphista/granite-20b-code-instruct-IMat-GGUF
Text Generation
• 20B • Updated • 417
legraphista/Yi-Coder-1.5B-IMat-GGUF
Text Generation
• 1B • Updated • 1.45k
legraphista/Yi-Coder-1.5B-Chat-IMat-GGUF
Text Generation
• 1B • Updated • 86
legraphista/Yi-Coder-9B-Chat-IMat-GGUF
Text Generation
• 9B • Updated • 286
• 1
legraphista/Yi-Coder-9B-IMat-GGUF
Text Generation
• 9B • Updated • 212
legraphista/Reflection-Llama-3.1-70B-IMat-GGUF
Text Generation
• 71B • Updated • 191
• 8
legraphista/DeepSeek-V2.5-IMat-GGUF
Text Generation
• 236B • Updated • 143
• 4
legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF
Text Generation
• 236B • Updated • 74
• 1
legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF
Text Generation
• 8B • Updated • 471
• 1
legraphista/reader-lm-0.5b-IMat-GGUF
Text Generation
• 0.5B • Updated • 107
legraphista/reader-lm-1.5b-IMat-GGUF
Text Generation
• 2B • Updated • 126
legraphista/datagemma-rag-27b-it-IMat-GGUF
Text Generation
• 27B • Updated • 129
legraphista/datagemma-rig-27b-it-IMat-GGUF
Text Generation
• 27B • Updated • 173
legraphista/Mistral-Small-Instruct-2409-IMat-GGUF
Text Generation
• 22B • Updated • 118