-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
•
2B
•
Updated
•
144k
•
10
mlx-community/GLM-4.7-Flash-6bit
Text Generation
•
30B
•
Updated
•
3.59k
•
4
mlx-community/DeepScaleR-1.5B-6.5bit
Text Generation
•
0.4B
•
Updated
•
20
•
4
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
4B
•
Updated
•
200k
•
18
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
•
2B
•
Updated
•
220k
•
6
MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF
Text Generation
•
12B
•
Updated
•
70.3k
•
2
lmstudio-community/GLM-4.7-Flash-MLX-6bit
Text Generation
•
30B
•
Updated
•
290k
•
2
arcee-ai/Trinity-Nano-Preview-MLX-6bit
Text Generation
•
1B
•
Updated
•
74
•
4
inferencerlabs/GLM-4.7-Flash-MLX-6.5bit
Text Generation
•
30B
•
Updated
•
406
•
2
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
7B
•
Updated
•
1.27k
•
56
MaziyarPanahi/gemma-7b-it-GGUF
Text Generation
•
9B
•
Updated
•
718
•
8
MaziyarPanahi/Saul-Instruct-v1-GGUF
Text Generation
•
7B
•
Updated
•
221
•
10
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
170k
•
25
MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF
Text Generation
•
0.5B
•
Updated
•
126
•
2
MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF
Text Generation
•
12B
•
Updated
•
37
•
3
MaziyarPanahi/Llama-3.2-3B-ToxicKod-GGUF
Text Generation
•
3B
•
Updated
•
34
•
1
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
219k
•
8
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
228k
•
7
mlx-community/Qwen3-0.6B-6bit
Text Generation
•
Updated
•
416
•
1
lmstudio-community/LFM2.5-1.2B-Instruct-MLX-6bit
Text Generation
•
0.3B
•
Updated
•
601k
•
2
McG-221/Valkyrie-49B-v2.1-mlx-6Bit
50B
•
Updated
•
91
•
1
mlx-community/Qwen3-TTS-12Hz-0.6B-Base-6bit
Text-to-Speech
•
0.5B
•
Updated
•
153
•
1
mlx-community/Qwen3-TTS-12Hz-1.7B-VoiceDesign-6bit
Text-to-Speech
•
0.7B
•
Updated
•
132
•
1
DeathGodlike/DarkArtsForge_Avnas-7B-v1_EXL3
Text Generation
•
Updated
•
1
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
2
•
1
Text Generation
•
3B
•
Updated
•
473
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
90
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
58
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
77
•
5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
•
7B
•
Updated
•
26
•
3