Inference Providers
Active filters: 4bit
legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF
Text Generation
• 73B • Updated • 199
ModelCloud/EXAONE-3.0-7.8B-Instruct-gptq-4bit
8B • Updated • 2
• 3
legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF
Text Generation
• 8B • Updated • 213
• 1
legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF
Text Generation
• 71B • Updated • 400
• 1
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
• 5B • Updated • 508
• 13
legraphista/Minitron-4B-Base-GGUF
Text Generation
• 4B • Updated • 173
legraphista/Minitron-8B-Base-GGUF
Text Generation
• 8B • Updated • 471
legraphista/Llama-3.1-Storm-8B-IMat-GGUF
Text Generation
• 8B • Updated • 465
legraphista/Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
• 4B • Updated • 894
• 1
legraphista/Mistral-NeMo-Minitron-8B-Base-IMat-GGUF
Text Generation
• 8B • Updated • 684
• 1
legraphista/unsloth-Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
• 4B • Updated • 688
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Text Generation
• 2B • Updated • 178
• 3
speakleash/Bielik-11B-v2.2-Instruct-Quanto-4bit
Text Generation
• 6B • Updated • 63
• 3
alexwww94/glm-4v-9b-gptq-4bit
14B • Updated • 28
• 7
0xroyce/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
• 8B • Updated • 1.49k
• 7
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
• 104B • Updated • 635
• 6
jhangmez/CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 42
• 1
legraphista/xLAM-7b-r-IMat-GGUF
Text Generation
• 7B • Updated • 369
jhangmez/CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 1.14k
• 3
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
• 47B • Updated • 2.22k
• 1
legraphista/xLAM-8x22b-r-IMat-GGUF
Text Generation
• 141B • Updated • 166
legraphista/granite-20b-code-instruct-IMat-GGUF
Text Generation
• 20B • Updated • 1.54k
legraphista/Yi-Coder-1.5B-IMat-GGUF
Text Generation
• 1B • Updated • 532
legraphista/Yi-Coder-1.5B-Chat-IMat-GGUF
Text Generation
• 1B • Updated • 273
legraphista/Yi-Coder-9B-Chat-IMat-GGUF
Text Generation
• 9B • Updated • 1.14k
• 1
legraphista/Yi-Coder-9B-IMat-GGUF
Text Generation
• 9B • Updated • 521
legraphista/Reflection-Llama-3.1-70B-IMat-GGUF
Text Generation
• 71B • Updated • 510
• 8
legraphista/DeepSeek-V2.5-IMat-GGUF
Text Generation
• 236B • Updated • 527
• 4
legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF
Text Generation
• 236B • Updated • 3.21k
• 1
legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF
Text Generation
• 8B • Updated • 715
• 1