Inference Providers
Active filters: 2-bit
MaziyarPanahi/calme-2.2-qwen2-72b-GGUF
Text Generation
• 73B • Updated • 58
• 2
ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ
123B • Updated • 6
• 25
MaziyarPanahi/RYS-XLarge-GGUF
Text Generation
• 78B • Updated • 93
• 7
MaziyarPanahi/calme-2.3-legalkit-8b-GGUF
Text Generation
• 8B • Updated • 908
• 8
MaziyarPanahi/Qwen2-Math-1.5B-Instruct-GGUF
Text Generation
• 2B • Updated • 252
• 2
MaziyarPanahi/Qwen2-Math-7B-Instruct-GGUF
Text Generation
• 8B • Updated • 299
• 1
MaziyarPanahi/Qwen2-Math-72B-Instruct-GGUF
Text Generation
• 73B • Updated • 414
• 2
Alignment-Lab-AI/w2g64-mistral-large-intruct-gptq
123B • Updated • 6
HHD-QiXuan/RYS-XLarge-GGUF
Text Generation
• 78B • Updated • 12
• 1
Orion-zhen/TinyLlama-1.1B-Chat-v1.0-2.0bpw-exl2
MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF
Text Generation
• 2B • Updated • 1.02k
• 7
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 113k
• 33
AminBH/Llama-3-8B-GPTQ-wiki-2bit
Text Generation
• 8B • Updated • 3
jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 98
jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 138
jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF
Text Generation
• 410B • Updated • 20
jburmeister/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 210
MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF
Text Generation
• 4B • Updated • 105
• 1
MaziyarPanahi/xLAM-8x22b-r-GGUF
Text Generation
• 141B • Updated • 1.24k
• 1
zewenwu/phi-3.5-w2g64-gptq
4B • Updated MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
• 1B • Updated • 82.7k
• 18
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 81.4k
• 8
BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.0bpw_h6
Text Generation
• Updated • 2
MaziyarPanahi/DeepSeek-V2.5-GGUF
Text Generation
• 236B • Updated • 665
• 3
MaziyarPanahi/ref_70_e3-GGUF
Text Generation
• 71B • Updated • 356
MaziyarPanahi/reader-lm-0.5b-GGUF
Text Generation
• 0.5B • Updated • 529
• 4
MaziyarPanahi/reader-lm-1.5b-GGUF
Text Generation
• 2B • Updated • 732
• 2
Xu-Ouyang/pythia-1b-deduped-int2-step2000-GPTQ-wikitext2-uva
Text Generation
• 1B • Updated • 3
Xu-Ouyang/pythia-1b-deduped-int2-step4000-GPTQ-wikitext2-uva
Text Generation
• 1B • Updated • 6
Xu-Ouyang/pythia-1b-deduped-int2-step6000-GPTQ-wikitext2-uva
Text Generation
• 1B • Updated • 3