Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47,222

Base only

Active filters: 4-bit

mlx-community/Qwen2.5-7B-Instruct-Uncensored-4bit

Text Generation • Updated Oct 21, 2024 • 757 • 7

MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF

Text Generation • 8B • Updated Oct 29, 2024 • 1.65k • 7

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • 7B • Updated Nov 6, 2024 • 47 • 2

lmstudio-community/Qwen2.5-14B-Instruct-MLX-4bit

Text Generation • 2B • Updated Nov 13, 2024 • 2.42k • 2

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • 11B • Updated Feb 26, 2025 • 3.18k • 10

unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated May 12, 2025 • 7.24k • 16

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech • 3B • Updated Mar 24, 2025 • 4.61k • 18

unsloth/orpheus-3b-0.1-ft-bnb-4bit

Text-to-Speech • 3B • Updated Mar 24, 2025 • 228 • 1

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • 33B • Updated Apr 6, 2025 • 247k • 64

mlx-community/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-4bit

Text Generation • 1B • Updated Apr 17, 2025 • 112 • 2

mlx-community/Qwen3-8B-4bit

Text Generation • Updated Apr 28, 2025 • 30.3k • 11

mlx-community/MiMo-7B-RL-4bit

Text Generation • Updated May 2, 2025 • 42 • 1

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 533k • 31

Qwen/Qwen3-30B-A3B-MLX-4bit

Text Generation • 4B • Updated Jul 7, 2025 • 517 • 12

huynguyendbs/Qwen3-Embedding-8B-4bit-MLX

Text Generation • 1B • Updated Jun 12, 2025 • 289 • 2

mlx-community/deepseek-coder-33b-instruct

Text Generation • Updated Jun 21, 2025 • 153 • 2

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 80B • Updated Jul 11, 2025 • 251 • 53

mlx-community/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-4bit

Text Generation • 1B • Updated Jun 30, 2025 • 111 • 2

mlx-community/Dolphin-Mistral-24B-Venice-Edition-DWQ

Text Generation • 24B • Updated Jul 7, 2025 • 306 • 4

mlx-community/SmolLM3-3B-4bit

Text Generation • Updated Jul 8, 2025 • 3.53k • 7

mlx-community/Kimi-Dev-72B-4bit-DWQ

Text Generation • 73B • Updated Jul 12, 2025 • 1.8k • 20

wikeeyang/Nexus-GenV2-nf4-fp8

Any-to-Any • 8B • Updated Jul 22, 2025 • 12 • 5

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated Jul 31, 2025 • 166k • 34

nightmedia/gpt-oss-20b-q4-hi-mlx

Text Generation • 21B • Updated Aug 6, 2025 • 115 • 3

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit-dwq-v2

Text Generation • Updated Aug 9, 2025 • 1.31k • 10

mlx-community/VibeThinker-1.5B-mlx-4bit

Text Generation • 0.2B • Updated Nov 19, 2025 • 2.97k • 26

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 39.3k • 3

mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit

Image-Text-to-Text • 5B • Updated 12 days ago • 120k • 6

Manik444/qwen-clinical-sft-merged

Text Generation • 4B • Updated Jan 5 • 3 • 1

Disty0/FLUX.2-klein-4B-SDNQ-4bit-dynamic

Image-to-Image • 2B • Updated Mar 27 • 10.6k • 13