Inference Providers
Active filters: 6-bit
MaziyarPanahi/Clarus-7B-v0.1-GGUF
Text Generation
• 8B • Updated • 48
MaziyarPanahi/DeepSeek-R1-Distill-Llama-3B-GGUF
Text Generation
• 3B • Updated • 119
• 1
alexgusevski/Fino1-8B-q6-mlx
Text Generation
• 2B • Updated • 5
MaziyarPanahi/ZYH-LLM-Qwen2.5-14B-V3-GGUF
Text Generation
• 15B • Updated • 35
MaziyarPanahi/LLaMA-3-8B-GRPO-Finance-Math-TR-GGUF
Text Generation
• 8B • Updated • 96
lukagra/PLLuM-12B-nc-base-Q6-mlx
3B • Updated • 15
lukagra/PLLuM-12B-nc-instruct-Q6-mlx
3B • Updated • 11
MaziyarPanahi/Sombrero-Opus-14B-Elite6-GGUF
Text Generation
• 15B • Updated • 38
mlx-community/perplexity-ai-r1-1776-6bit
147B • Updated • 26
• 1
lukagra/PLLuM-12B-instruct-Q6-mlx
3B • Updated • 14
lukagra/PLLuM-12B-base-Q6-mlx
3B • Updated • 10
lukagra/PLLuM-12B-chat-Q6-mlx
3B • Updated • 8
mlx-community/DeepSeek-Coder-V2-Lite-Instruct-6bit
3B • Updated • 226
• 1
alexgusevski/Ministral-8B-Instruct-2410-q6-mlx
2B • Updated • 5
alexgusevski/LLaMA-Mesh-q6-mlx
Text-to-3D
• 2B • Updated • 17
• 1
mlx-community/gemma-2-2b-it-abliterated-6bit
0.6B • Updated • 36
mlx-community/Impish_LLAMA_3B-6bit
0.7B • Updated • 12
mlx-community/SmolLM2-360M-Instruct-6bit
Text Generation
• 79.2M • Updated • 65
mlx-community/Megrez-3B-Instruct-abliterated-6bit
Text Generation
• 0.6B • Updated • 7
alexgusevski/DeepSeek-R1-DRAFT-Qwen2.5-0.5B-q6-mlx
Text Generation
• 0.1B • Updated • 9
mlx-community/Qwen2.5-1.5B-Instruct-abliterated-6bit
Text Generation
• 0.3B • Updated • 24
alexgusevski/Selene-1-Mini-Llama-3.1-8B-q6-mlx
Text Generation
• 2B • Updated • 9
alexgusevski/granite-3.2-2b-instruct-q6-mlx
Text Generation
• 0.6B • Updated • 14
mlx-community/SmallThinker-3B-Preview-6bit
Text Generation
• 0.7B • Updated • 9
mlx-community/Phi-4-mini-instruct-6bit
Text Generation
• 0.8B • Updated • 70
• 2
Scotto2025/Llama-3-8B-Instruct-Coding-Expert-Q6-mlx
Text Generation
• 2B • Updated • 53
MaziyarPanahi/Llama_3.1_8b_DoberWild_v2.03-GGUF
Text Generation
• 8B • Updated • 54
MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.03-GGUF
Text Generation
• 8B • Updated • 60
MaziyarPanahi/cursa-o1-7b-v1.1-GGUF
Text Generation
• 8B • Updated • 44
MaziyarPanahi/Llama_3.1_8b_DodoWild_v2.02-GGUF
Text Generation
• 8B • Updated • 44