Inference Providers
Active filters: 2-bit
mrtoots/unsloth-GLM-4.5-MLX-2Bit
Text Generation
• 353B • Updated • 23
OPEA/DeepSeek-R1-0528-int2-mixed-AutoRound
56B • Updated • 1
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 105k
• 3
MaziyarPanahi/Qwen3-30B-A3B-Instruct-2507-GGUF
Text Generation
• 31B • Updated • 52.7k
• 4
Matt300209/1B-instruct-int2
1B • Updated Matt300209/1B-tulu-sft-int2
1B • Updated Matt300209/8B-instruct-int2
8B • Updated • 1
Matt300209/8B-tulu-sft-int2
8B • Updated • 3
genai-archive/Qwen3-30B-A3B-Instruct-2507-MLX-Q2
Text Generation
• 31B • Updated • 19
Text Generation
• 0.5B • Updated • 3
Text Generation
• 0.5B • Updated • 3
1B • Updated • 1
jesusoctavioas/gpt-oss-120b-mlx-2Bit
Text Generation
• 117B • Updated • 253
• 2
mrtoots/unsloth-Hermes-4-405B-mlx-2Bit
Text Generation
• 406B • Updated • 39
mrtoots/Hermes-3-Llama-3.1-405B-mlx-2Bit
Text Generation
• 406B • Updated • 34
ncard/Qwen3-30B-A3B-Thinking-2507-mlx-2Bit
Text Generation
• 31B • Updated • 14
mlx-community/Ling-mini-2.0-2bit
Text Generation
• 16B • Updated • 8
mlx-community/Ling-mini-2.0-2bit-DWQ
Text Generation
• 16B • Updated • 16
• 1
Wwayu/DeepSeek-V2-Chat-mlx-2Bit
Updated • 16
Wwayu/DeepSeek-V2-Chat-0628-mlx-2Bit
Updated • 16
Matt300209/1B-tulu-sft-int4-asym
1B • Updated • 1
Matt300209/1B-tulu-sft-int2-asym
1B • Updated • 2
mlx-community/Apriel-1.5-15b-Thinker-2bit-MLX
Image-Text-to-Text
• Updated • 11
• 1
Text Generation
• Updated • 25
Wwayu/Llama-3_1-Nemotron-Ultra-253B-v1-mlx-2Bit
Text Generation
• Updated • 55
Wwayu/Qwen3-235B-A22B-Thinking-2507-mlx-2Bit
Text Generation
• Updated • 47
Wwayu/Qwen3-235B-A22B-Instruct-2507-1M-mlx-2Bit
Text Generation
• Updated • 51
Matt300209/1B-tulu-sft-2bit-gr16
1B • Updated XXXXyu/Qwen3-1.7B-w2g64-gptq_v2
2B • Updated • 492
Matt300209/1B_tulu_sft_full_pr_1e5_2bit_new
1B • Updated • 1