-
-
-
-
-
-
Inference Providers
Active filters:
2-bit
MaziyarPanahi/GLM-4-32B-0414-GGUF
Text Generation
•
33B
•
Updated
•
56
•
1
MaziyarPanahi/cogito-v1-preview-llama-3B-GGUF
Text Generation
•
4B
•
Updated
•
3
•
1
MaziyarPanahi/cogito-v1-preview-llama-8B-GGUF
Text Generation
•
8B
•
Updated
•
4
•
1
MaziyarPanahi/cogito-v1-preview-llama-70B-GGUF
Text Generation
•
71B
•
Updated
•
2
•
1
Erland/softpick-340M-4096-model-GPTQ-2bit
Text Generation
•
0.4B
•
Updated
Erland/vanilla-340M-4096-model-GPTQ-2bit
Text Generation
•
0.4B
•
Updated
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-32g-2048-gptq
73B
•
Updated
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-64g-2048-gptq
73B
•
Updated
•
1
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-128g-2048-gptq
73B
•
Updated
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-32g-4096-gptq
73B
•
Updated
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-64g-4096-gptq
73B
•
Updated
kaitchup/Qwen2.5-72B-Instruct-autoround-2bit-128g-4096-gptq
73B
•
Updated
steampunque/Llama-4-Scout-17B-16E-Instruct-Hybrid-GGUF
Text Generation
•
108B
•
Updated
•
43
•
1
MaziyarPanahi/Qwen3-0.6B-GGUF
Text Generation
•
0.8B
•
Updated
•
219k
•
8
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
•
2B
•
Updated
•
217k
•
6
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
216k
•
8
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
221k
•
7
MaziyarPanahi/Qwen3-32B-GGUF
Text Generation
•
33B
•
Updated
•
212k
•
2
MaziyarPanahi/Qwen3-30B-A3B-GGUF
Text Generation
•
31B
•
Updated
•
215k
•
4
16B
•
Updated
•
2
kaitchup/Qwen3-32B-autoround-2bit-gptq
33B
•
Updated
•
81
•
1
Cozmicalz/Lycanthropic-Thoughts-32B-mlx-2Bit
kaitchup/Qwen3-14B-autoround-2bit-gptq
15B
•
Updated
•
5
kaitchup/Qwen3-8B-autoround-2bit-gptq
8B
•
Updated
•
18
DanyDA/Qwen3-32B-exl3-2.0bpw
Text Generation
•
5B
•
Updated
•
1
Siddharth63/Qwen3-8B-Base-2bits-AutoRound-GPTQ-sym
8B
•
Updated
•
1
Siddharth63/Qwen3-8B-Base-2bits-AutoRound-sym
MaziyarPanahi/INTELLECT-2-GGUF
Text Generation
•
33B
•
Updated
•
136k
•
2
kaitchup/Qwen3-14B-Base-autoround-2bit-gptq
15B
•
Updated
•
3
kaitchup/Qwen3-32B-autoround-2bit-128g-gptq
33B
•
Updated
•
2