Inference Providers
Active filters: 4-bit
mlx-community/Qwen3.5-9B-MTP-4bit
Text Generation
• 38M • Updated • 19
• 1
mlx-community/Qwen3.5-4B-MTP-4bit
Text Generation
• 18.9M • Updated • 9
• 1
ETS-METADIDOMI/MetadidomIA-7B-v01062612-bnb-4bit
7B • Updated • 17
• 1
jedisct1/Mellum2-12B-A2.5B-Thinking-mlx-4bit
Text Generation
• 12B • Updated • 1
CohereLabs/c4ai-command-r-plus-4bit
Text Generation
• 105B • Updated • 3.88k
• 261
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit
Text Generation
• 31B • Updated • 199k
• 30
mlx-community/gpt-oss-20b-MXFP4-Q8
Text Generation
• 21B • Updated • 422k
• 61
mlx-community/Qwen3.5-9B-MLX-4bit
Image-Text-to-Text
• 2B • Updated • 48.7k
• 126
mlx-community/gemma-4-26b-a4b-it-4bit
Image-Text-to-Text
• 5B • Updated • 44.3k
• 63
lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit
Image-Text-to-Text
• 5B • Updated • 69.8k
• 6
unsloth/Qwen3.6-27B-UD-MLX-4bit
Image-Text-to-Text
• 10B • Updated • 53.4k
• 54
Jundot/Qwen3.6-35B-A3B-oQ4-mtp
6B • Updated • 3.35k
• 5
LeaderboardModel1/Qwen3.5-27B-Writer-V2-AutoRound-W4A16-RTN
Text Generation
• 3B • Updated • 2
Novaciano/SENTIMENTAL_SEX-3.2-1B
Text Generation
• 1B • Updated • 956
• • 9
mlx-community/Qwen3-VL-8B-NSFW-Caption-V4.5-mxfp4
2B • Updated • 1.14k
• 7
NeshVerse/Ultra_Flash_Financial_SFT_Nanbeige_4.1-3B
Text Generation
• 4B • Updated • 12
• 4
Text Generation
• 7B • Updated • 51
• 31
Text Generation
• 13B • Updated • 26
• 38
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
• 7B • Updated • 26
• 15
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
• 33B • Updated • 48
• 20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
• 13B • Updated • 23
• 20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
• 65B • Updated • 58
• 29
TheBloke/medalpaca-13B-GPTQ
Text Generation
• 13B • Updated • 724
• 29
TheBloke/wizardLM-7B-GPTQ
Text Generation
• 7B • Updated • 72
• 106
TheBloke/stable-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 34
• 218
TheBloke/OpenAssistant-SFT-7-Llama-30B-GPTQ
Text Generation
• 33B • Updated • 216
• 35
TheBloke/wizard-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 22
• 97
TheBloke/WizardLM-7B-uncensored-GPTQ
Text Generation
• 7B • Updated • 783
• 195
TheBloke/GPT4All-13B-snoozy-GPTQ
Text Generation
• 13B • Updated • 18
• 31
TheBloke/gpt4-x-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 25
• 34