Inference Providers
Active filters: 8bit
mlx-community/gemma-4-e4b-it-OptiQ-4bit
Text Generation
• 8B • Updated • 6.33k
• 14
mlx-community/Qwen3.5-0.8B-OptiQ-4bit
Text Generation
• 0.2B • Updated • 7.42k
• 19
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.8B • Updated • 5.01k
• 14
mlx-community/Qwen3.5-2B-OptiQ-4bit
Text Generation
• 0.4B • Updated • 3.39k
• 8
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 138k
• 35
OsaurusAI/gemma-4-E4B-it-8bit
Any-to-Any
• 3B • Updated • 881
• 1
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation
• 27B • Updated • 6.18k
• 8
mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit
Text Generation
• 25B • Updated • 2.41k
• 2
mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit
Text Generation
• 35B • Updated • 1.86k
• 2
mlx-community/gemma-4-31B-it-OptiQ-4bit
Text Generation
• 31B • Updated • 1.99k
• 2
GiaHuy/Darwin-36B-Opus-mlx-text-only-8bit
Text Generation
• 35B • Updated • 158
• 2
speakleash/Bielik-11B-v3.0-Instruct-FP8-Dynamic
Text Generation
• 11B • Updated • 3.97k
• 6
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 7
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 10
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 15
• 4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 24
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 13
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 12
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 11
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 5
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 21
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 17
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 44
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 7
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 95
• 9
BioMistral/BioMistral-7B-BnB.8
Text Generation
• 7B • Updated • 4
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation
• 7B • Updated • 128
• 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation
• 7B • Updated • 12
• 2
alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2
Text Generation
• Updated • 9
• 1
alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2
Text Generation
• Updated • 9
• 1