-
-
-
-
-
-
Inference Providers
Active filters:
2-bit
MaziyarPanahi/Matsu-7B-GGUF
Text Generation
•
8B
•
Updated
•
8
Text Generation
•
15B
•
Updated
•
146k
•
5
mlx-community/qwen2.5-0.5b-instruct-q2
Text Generation
•
Updated
•
12
Text Generation
•
Updated
•
11
•
1
MaziyarPanahi/phi3.5_mini_exp_825_uncensored-GGUF
Text Generation
•
4B
•
Updated
•
35
MaziyarPanahi/phi-2-instruct-v0.1-GGUF
Text Generation
•
3B
•
Updated
•
4
MaziyarPanahi/phi-2-pytdml-GGUF
Text Generation
•
3B
•
Updated
•
5
MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF
Text Generation
•
14B
•
Updated
•
5
MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF
Text Generation
•
4B
•
Updated
•
11
MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF
Text Generation
•
4B
•
Updated
•
6
MaziyarPanahi/fietje-2-instruct-GGUF
Text Generation
•
3B
•
Updated
•
6
mlx-community/phi-4-abliterated-2bit
Text Generation
•
Updated
•
5
CuckmeisterFuller/phi-4-Q2-mlx
Text Generation
•
1B
•
Updated
•
4
CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx
Text Generation
•
2B
•
Updated
•
13
CuckmeisterFuller/Cydonia-22B-v1.2-Q2-mlx
2B
•
Updated
•
3
CuckmeisterFuller/Cydonia-22B-v1.3-Q2-mlx
2B
•
Updated
•
2
lilmeaty/SmolLM2-135M-Instruct-GPTQ
Text Generation
•
0.1B
•
Updated
•
78
lilmeaty/SmolLM2-135M-Instruct-GPTQ-2bit
Text Generation
•
0.1B
•
Updated
•
1
roleplaiapp/ReaderLM-v2-Q2_K-GGUF
Text Generation
•
2B
•
Updated
•
5
roleplaiapp/Dria-Agent-a-3B-Q2_K-GGUF
Text Generation
•
Updated
•
1
roleplaiapp/Dria-Agent-a-7B-Q2_K-GGUF
Text Generation
•
Updated
roleplaiapp/AceInstruct-72B-Q2_K-GGUF
Text Generation
•
Updated
•
4
roleplaiapp/Wayfarer-12B-Q2_K-GGUF
Text Generation
•
12B
•
Updated
•
14
roleplaiapp/Codestral-22B-v0.1-Q2_K-GGUF
Text Generation
•
22B
•
Updated
•
1
roleplaiapp/AceInstruct-7B-Q2_K-GGUF
Text Generation
•
8B
•
Updated
•
1
•
1
roleplaiapp/AceInstruct-1.5B-Q2_K-GGUF
Text Generation
•
2B
•
Updated
Text Generation
•
Updated
•
1
umgbhalla/mlx-DeepSeek-R1-Distill-Qwen-1.5B-v0.1-2bit
Text Generation
•
0.2B
•
Updated
•
13
roleplaiapp/ALIA-40b-Q2_K-GGUF
Text Generation
•
40B
•
Updated
•
7
roleplaiapp/ALIA-40b-Q8_0-GGUF
Text Generation
•
40B
•
Updated
•
4
•
3