Inference Providers
Active filters: 4-bit
mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit
Text Generation
• 25B • Updated • 3.65k
• 5
Jundot/Qwen3.6-35B-A3B-oQ4-mtp
6B • Updated • 3.13k
• 5
mlx-community/Qwen3-VL-8B-NSFW-Caption-V4.5-mxfp4
2B • Updated • 1.17k
• 7
NeshVerse/Ultra_Flash_Financial_SFT_Nanbeige_4.1-3B
Text Generation
• 4B • Updated • 10
• 4
Text Generation
• 2B • Updated • 8
• • 1
Text Generation
• 7B • Updated • 45
• 31
Text Generation
• 13B • Updated • 22
• 38
TheBloke/vicuna-7B-v0-GPTQ
Text Generation
• 7B • Updated • 22
• 15
TheBloke/gpt4-alpaca-lora-30B-GPTQ
Text Generation
• 33B • Updated • 44
• 20
TheBloke/gpt4-alpaca-lora-13B-GPTQ
Text Generation
• 13B • Updated • 20
• 20
TheBloke/alpaca-lora-65B-GPTQ
Text Generation
• 65B • Updated • 54
• 29
TheBloke/medalpaca-13B-GPTQ
Text Generation
• 13B • Updated • 753
• 29
TheBloke/wizardLM-7B-GPTQ
Text Generation
• 7B • Updated • 70
• 106
TheBloke/stable-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 29
• 218
TheBloke/OpenAssistant-SFT-7-Llama-30B-GPTQ
Text Generation
• 33B • Updated • 214
• 35
TheBloke/wizard-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 18
• 97
TheBloke/WizardLM-7B-uncensored-GPTQ
Text Generation
• 7B • Updated • 871
• 195
TheBloke/GPT4All-13B-snoozy-GPTQ
Text Generation
• 13B • Updated • 13
• 31
TheBloke/gpt4-x-vicuna-13B-GPTQ
Text Generation
• 13B • Updated • 23
• 34
TheBloke/h2ogpt-oasst1-512-30B-GPTQ
Text Generation
• 33B • Updated • 8
• 5
TheBloke/dromedary-65B-lora-GPTQ
Text Generation
• 65B • Updated • 7
• 6
TheBloke/gpt4-alpaca-lora_mlp-65B-GPTQ
Text Generation
• 65B • Updated • 14
• 14
TheBloke/wizard-mega-13B-GPTQ
Text Generation
• 13B • Updated • 20
• 108
TheBloke/VicUnlocked-30B-LoRA-GPTQ
Text Generation
• 33B • Updated • 26
• 20
TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ
Text Generation
• 7B • Updated • 564
• 164
TheBloke/Manticore-13B-GPTQ
Text Generation
• 13B • Updated • 14
• 37
Text Generation
• 7B • Updated • 5
TheBloke/WizardLM-30B-Uncensored-GPTQ
Text Generation
• 33B • Updated • 25
• 118
TheBloke/airoboros-13B-GPTQ
Text Generation
• 13B • Updated • 13
• 13
TheBloke/manticore-13b-chat-pyg-GPTQ
Text Generation
• 13B • Updated • 19
• 33