-
-
-
-
-
-
Inference Providers
Active filters:
2-bit
MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
121k
•
40
MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF
Text Generation
•
410B
•
Updated
•
120k
•
15
MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF
Text Generation
•
123B
•
Updated
•
326
•
21
Maximofn/Llama-3-8B-Instruct-GPTQ-2bits
Text Generation
•
8B
•
Updated
•
1
MaziyarPanahi/calme-2.1-llama3.1-70b-GGUF
Text Generation
•
71B
•
Updated
•
20
•
2
MaziyarPanahi/gemma-2-2b-it-GGUF
Text Generation
•
3B
•
Updated
•
123k
•
13
MaziyarPanahi/calme-2.2-qwen2-72b-GGUF
Text Generation
•
73B
•
Updated
•
40
•
2
ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ
Updated
•
7
•
25
MaziyarPanahi/RYS-XLarge-GGUF
Text Generation
•
78B
•
Updated
•
84
•
7
MaziyarPanahi/calme-2.3-legalkit-8b-GGUF
Text Generation
•
8B
•
Updated
•
153
•
8
MaziyarPanahi/Qwen2-Math-1.5B-Instruct-GGUF
Text Generation
•
2B
•
Updated
•
33
•
2
MaziyarPanahi/Qwen2-Math-7B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
10
•
1
MaziyarPanahi/Qwen2-Math-72B-Instruct-GGUF
Text Generation
•
73B
•
Updated
•
19
•
2
Alignment-Lab-AI/w2g64-mistral-large-intruct-gptq
123B
•
Updated
HHD-QiXuan/RYS-XLarge-GGUF
Text Generation
•
78B
•
Updated
•
22
•
1
Orion-zhen/TinyLlama-1.1B-Chat-v1.0-2.0bpw-exl2
Updated
MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF
Text Generation
•
2B
•
Updated
•
86
•
7
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
151k
•
25
AminBH/Llama-3-8B-GPTQ-wiki-2bit
Text Generation
•
8B
•
Updated
jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
64
jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
•
71B
•
Updated
•
61
jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF
Text Generation
•
410B
•
Updated
•
3
jburmeister/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
84
MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF
Text Generation
•
4B
•
Updated
•
33
•
1
MaziyarPanahi/xLAM-8x22b-r-GGUF
Text Generation
•
141B
•
Updated
•
64
•
1
zewenwu/phi-3.5-w2g64-gptq
4B
•
Updated
MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF
Text Generation
•
1B
•
Updated
•
121k
•
18
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
•
9B
•
Updated
•
121k
•
6
BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.0bpw_h6
Text Generation
•
Updated
•
2
MaziyarPanahi/DeepSeek-V2.5-GGUF
Text Generation
•
236B
•
Updated
•
22
•
3