Inference Providers
Active filters: 4-bit
dawncr0w/MiniMax-M2.7-ultra-uncensored-heretic-oQ4-MLX
Text Generation
• 36B • Updated • 698
• 1
shinigamiRaj/Llama-3.2-1B-Instruct-gptqmodel-4bit
1B • Updated • 39
• 1
cyankiwi/LFM2.5-8B-A1B-AWQ-INT4
Text Generation
• 8B • Updated • 597
• 1
Sarveshyadav19/text2sql-qwen
Text Generation
• 0.5B • Updated • 51
• 1
mlx-community/Qwen3.5-9B-MTP-4bit
Text Generation
• 38M • Updated • 207
• 1
mlx-community/Qwen3.5-4B-MTP-4bit
Text Generation
• 18.9M • Updated • 116
• 1
ETS-METADIDOMI/MetadidomIA-7B-v01062612-bnb-4bit
7B • Updated • 173
• 1
openbmb/MiniCPM-o-2_6-GPTQ
Any-to-Any
• 9B • Updated • 1
CohereLabs/c4ai-command-r-plus-4bit
Text Generation
• 105B • Updated • 3.88k
• 261
lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit
Text Generation
• 31B • Updated • 199k
• 30
mlx-community/gpt-oss-20b-MXFP4-Q8
Text Generation
• 21B • Updated • 421k
• 61
mlx-community/Qwen3.5-9B-MLX-4bit
Image-Text-to-Text
• 2B • Updated • 48.3k
• 126
mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit
27B • Updated • 36k
• 205
mlx-community/gemma-4-26b-a4b-it-4bit
Image-Text-to-Text
• 5B • Updated • 44.1k
• 63
lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit
Image-Text-to-Text
• 5B • Updated • 69.7k
• 6
unsloth/Qwen3.6-27B-UD-MLX-4bit
Image-Text-to-Text
• 10B • Updated • 51.6k
• 54
Jundot/Qwen3.6-35B-A3B-oQ4-mtp
6B • Updated • 3.46k
• 5
LeaderboardModel1/Qwen3.5-27B-Writer-V2-AutoRound-W4A16-RTN
Text Generation
• 3B • Updated • 17
• 2
Novaciano/SENTIMENTAL_SEX-3.2-1B
Text Generation
• 1B • Updated • 928
• • 9
mlx-community/Qwen3-VL-8B-NSFW-Caption-V4.5-mxfp4
2B • Updated • 1.14k
• 7
NeshVerse/Ultra_Flash_Financial_SFT_Nanbeige_4.1-3B
Text Generation
• 4B • Updated • 12
• 4
Text Generation
• 7B • Updated • 50
• 31
Text Generation
• 13B • Updated • 26
• 38
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
• 7B • Updated • 26
• 15
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
• 33B • Updated • 50
• 20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
• 13B • Updated • 23
• 20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
• 65B • Updated • 56
• 29
TheBloke/medalpaca-13B-GPTQ
Text Generation
• 13B • Updated • 707
• 29
TheBloke/wizardLM-7B-GPTQ
Text Generation
• 7B • Updated • 70
• 106
TheBloke/stable-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 34
• 218