-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
unsloth/Qwen3-8B-bnb-4bit
8B
•
Updated
•
191k
•
8
MaziyarPanahi/Qwen3-30B-A3B-GGUF
Text Generation
•
31B
•
Updated
•
275k
•
4
Text Generation
•
33B
•
Updated
•
273k
•
124
Text Generation
•
15B
•
Updated
•
1.03M
•
54
Text Generation
•
8B
•
Updated
•
137k
•
36
Text Generation
•
4B
•
Updated
•
86.4k
•
23
Any-to-Any
•
11B
•
Updated
•
41.2k
•
17
Qwen/Qwen2.5-Omni-7B-GPTQ-Int4
Any-to-Any
•
11B
•
Updated
•
36.8k
•
13
mlx-community/Devstral-Small-2505-4bit-DWQ
Text Generation
•
4B
•
Updated
•
75
•
4
Text Generation
•
2B
•
Updated
•
572
•
8
MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
189k
•
8
Narutoouz/GLM-4-9B-0414-4bit-DWQ
Text Generation
•
1B
•
Updated
•
24
•
2
mlx-community/Qwen3-8B-4bit-DWQ-053125
Text Generation
•
Updated
•
104
•
2
mlx-community/Qwen3-14B-4bit-DWQ-053125
Text Generation
•
Updated
•
83
•
5
steampunque/Qwen3-32B-Hybrid-GGUF
33B
•
Updated
•
13
•
1
mlx-community/Josiefied-Qwen3-30B-A3B-abliterated-v2-4bit
Text Generation
•
31B
•
Updated
•
163
•
3
lmstudio-community/gemma-3n-E2B-it-MLX-4bit
Image-Text-to-Text
•
2B
•
Updated
•
427
•
1
TechxGenus/Seed-Coder-8B-Base-DWQ
Text Generation
•
1B
•
Updated
•
10
•
1
TechxGenus/Seed-Coder-8B-Instruct-DWQ
Text Generation
•
1B
•
Updated
•
17
•
1
mlx-community/SmolLM3-3B-4bit
Text Generation
•
Updated
•
2.33k
•
5
mlx-community/LFM2-350M-4bit
Text Generation
•
55.4M
•
Updated
•
345
•
5
mlx-community/Devstral-Small-2507-4bit-DWQ
Text Generation
•
24B
•
Updated
•
126
•
11
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit
Text Generation
•
31B
•
Updated
•
142k
•
13
mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit-DWQ
Text Generation
•
Updated
•
317
•
5
mlx-community/gpt-oss-120b-4bit
Text Generation
•
117B
•
Updated
•
847
•
8
unsloth/Qwen3-4B-Instruct-2507-unsloth-bnb-4bit
Text Generation
•
4B
•
Updated
•
169k
•
12
unsloth/gpt-oss-120b-unsloth-bnb-4bit
Text Generation
•
117B
•
Updated
•
24.9k
•
13
openbmb/MiniCPM-V-4_5-AWQ
Image-Text-to-Text
•
9B
•
Updated
•
5.11k
•
12
lmstudio-community/Hermes-4-405B-MLX-4bit
Text Generation
•
406B
•
Updated
•
94
•
1
MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF
Text Generation
•
31B
•
Updated
•
92.1k
•
4