Inference Providers
Active filters: 3-bit
irish-quant/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B-3bit
31B • Updated • 11
irish-quant/deepseek-ai-DeepSeek-R1-Distill-Qwen-7B-3bit
7B • Updated • 11
MetaphoricalCode/Skyfall-36B-v2-exl3-3bpw-hb6
8B • Updated • 5
mlx-community/Qwen2.5-7B-Medicine-3bit
Text Generation
• 1.0B • Updated • 14
ALYTV/DeepCoder-14B-Preview-mlx-3Bit
Text Generation
• 2B • Updated • 6
RossAscends/24B-XortronCriminalComputingConfig-3bpw-EXL3
Text Generation
• 5B • Updated • 6
zerofata/MS3.2-PaintedFantasy-24B_exl3-3bpw
Text Generation
• 5B • Updated • 6
DeusImperator/Strawberrylemonade-70B-v1.2_exl3_3.0bpw_H6
Text Generation
• 14B • Updated • 7
• 1
irish-quant/Qwen-Qwen2.5-0.5B-Instruct-3bit
0.5B • Updated • 6
irish-quant/Qwen-Qwen2.5-0.5B-3bit
0.5B • Updated • 7
irish-quant/Qwen-Qwen2.5-1.5B-Instruct-3bit
1B • Updated • 5
irish-quant/Qwen-Qwen2.5-1.5B-3bit
1B • Updated • 8
irish-quant/Qwen-Qwen2.5-14B-Instruct-3bit
14B • Updated • 7
irish-quant/Qwen-Qwen2.5-14B-3bit
14B • Updated • 10
irish-quant/Qwen-Qwen2.5-3B-Instruct-3bit
3B • Updated • 8
irish-quant/Qwen-Qwen2.5-3B-3bit
3B • Updated • 7
irish-quant/Qwen-Qwen2.5-7B-Instruct-3bit
7B • Updated • 6
irish-quant/Qwen-Qwen2.5-7B-3bit
7B • Updated • 7
mlx-community/Qwen3-30B-A3B-3bit
Text Generation
• 31B • Updated • 88
• 2
mlx-community/Qwen3-32B-3bit
33B • Updated • 28
• 2
DeusImperator/Anubis-70B-v1.1_exl3_3.0bpw_H6
14B • Updated • 5
SicariusSicariiStuff/Nano_Imp_1B_EXL3_3.0bpw
Text Generation
• 0.5B • Updated • 6
beezu/StrawberryLemonade-70B-v1.2-MLX-3Bit
Text Generation
• 71B • Updated • 7
zerofata/MS3.2-PaintedFantasy-Visage-33B_exl3_3bpw
Text Generation
• 7B • Updated • 10
SicariusSicariiStuff/Impish_LLAMA_4B_EXL3_3.0bpw
Text Generation
• 1B • Updated • 6
mlx-community/gemma-3n-E2B-it-3bit
Image-Text-to-Text
• 2B • Updated • 17
mlx-community/gemma-3n-E2B-3bit
Image-Text-to-Text
• 2B • Updated • 10
mlx-community/gemma-3n-E4B-it-3bit
Image-Text-to-Text
• 2B • Updated • 26
mlx-community/gemma-3n-E4B-3bit
Image-Text-to-Text
• 2B • Updated • 25
pcuenq/Hunyuan-7B-Instruct-tokenizer
Text Generation
• Updated • 5