Inference Providers
Active filters: 6-bit
mlx-community/GLM-4-32B-Base-0414-6bit
Text Generation
• 7B • Updated • 12
zerofata/L3.3-GeneticLemonade-Unleashed-v2-70b_6bpw-hb8-exl2
Text Generation
• Updated • 7
MetaphoricalCode/BlackSheep-24B-6.0bpw-h8-exl2
mlx-community/Llama-OuteTTS-1.0-1B-6bit
Text-to-Speech
• 0.3B • Updated • 15
• 1
MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-6.0bpw-h8-exl2
Text Generation
• Updated • 8
• 1
mlx-community/Llama-3.2-3B-Instruct-abliterated-6bit
Text Generation
• 0.7B • Updated • 329
mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit
Text Generation
• 0.7B • Updated • 638
• 4
mlx-community/Pleias-RAG-350M-6-bit
Text Generation
• 77.4M • Updated • 14
• 1
mlx-community/Pleias-RAG-1B-6-bit
Text Generation
• 0.3B • Updated • 9
atisharma/narratrix-exl2-6.0bpw-h6
Text Generation
• Updated • 9
mlx-community/Dia-1.6B-6bit
Text-to-Speech
• 2B • Updated • 28
• 10
riveRiPH/Violet_Magcap-12B-6bpw-h8-exl2
mlx-community/GLM-Z1-9B-0414-abliterated-6bit
Text Generation
• 2B • Updated • 27
dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw
Updated • 15
• 33
isogen/Mistral-Nemo-Instruct-2407-exl3-6bpw
5B • Updated • 7
mlx-community/CodeLlama-34b-Instruct-hf-6bit-mlx
Text Generation
• 7B • Updated • 51
• 1
mlx-community/CodeLlama-7b-Instruct-hf-6bit-mlx
Text Generation
• 1B • Updated • 11
mlx-community/CodeLlama-13b-hf-6bit-mlx
Text Generation
• 3B • Updated • 11
Jellon/GLM4-9B-Neon-v2-exl2-6bpw
Text Generation
• Updated • 14
MetaphoricalCode/Omega-Darker_The-Final-Directive-24B_EXL2_6.0bpw_H8
Text Generation
• Updated • 12
narpas/Alkahest-V9.2-Unhinged-RP-Alpha-V2-Llama-3.3-70B-6.0bpw-h8-exl2
Text Generation
• Updated • 10
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
• 8B • Updated • 298k
• 11
mlx-community/Qwen3-0.6B-6bit
Text Generation
• 0.1B • Updated • 77
• 1
mlx-community/Qwen3-1.7B-6bit
Text Generation
• 0.4B • Updated • 47
mlx-community/Qwen3-4B-6bit
Text Generation
• 0.9B • Updated • 58
MaziyarPanahi/Qwen3-14B-GGUF
Text Generation
• 15B • Updated • 302k
• 11
mlx-community/Qwen3-30B-A3B-6bit
Text Generation
• 7B • Updated • 44
• 1
mlx-community/Qwen3-8B-6bit
Text Generation
• 2B • Updated • 787
• 4
mlx-community/Qwen3-14B-6bit
Text Generation
• 3B • Updated • 489
• 1
zerofata/L3.3-GeneticLemonade-Unleashed-v2.1-70B-6bpw-hb8-exl2
Text Generation
• Updated • 13