Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

954

Base only

Active filters: 4bit

ekryski/diffusiongemma-26B-A4B-it-4bit

5B • Updated 28 days ago • 1.85k

marcusnogueira/llama-guard-3-8b-awq-4bit

Text Generation • 8B • Updated 19 days ago • 80

TerminatorPower/Qwen3-VL-2B-Instruct-4bit

Image-Text-to-Text • 0.7B • Updated 28 days ago • 71

TerminatorPower/Qwen3-VL-4B-Thinking-4bit

Image-Text-to-Text • 1B • Updated 28 days ago • 33

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 13 days ago • 4.79k • 8

sourabhsp23/agri-llama3.1-merged

Text Generation • 8B • Updated 25 days ago • 90 • 1

DJLougen/Harmonic-Hermes-9B-MLX-4bit

Text Generation • 1B • Updated 25 days ago • 364 • 1

tarirozw/medgemma-1.5-4b-4bit-v1

Text Generation • 4B • Updated 24 days ago • 21

mlx-community/gemma-4-26B-A4B-it-qat-OptiQ-4bit

Text Generation • 25B • Updated 13 days ago • 2.37k • 3

Alennnndy/Qwen3.6-27B-GPTQ-4bit

Text Generation • 27B • Updated 16 days ago • 55 • 1

divyeshkamalanaban/nucleotide-transformer-2.5b-multi-species-NF4-Q4

Fill-Mask • 3B • Updated 21 days ago • 57 • 1

baya1116/sp-recall-v2-pooler-q4

Updated 21 days ago

nassimjp/Ministral-8B-Instruct-2410-4bit

Text Generation • 8B • Updated 21 days ago • 630

Guess1212/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated 21 days ago • 787 • 1

dawahealth/medgemma-1.5-4b-4bit-v1

Text Generation • 4B • Updated 21 days ago • 77

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 13 days ago • 3.59k • 5

LLYYZZSS/gemma-4-12B-it-OptiQ-4bit

Text Generation • 12B • Updated 20 days ago • 106

nassimjp/Ghanam-7B-Base-Pashto-v0.1

Text Generation • 7B • Updated 20 days ago • 56

shamsghi/Qwen-9B-Claude-Fable-5-1M-MLX-4bit

Text Generation • 1B • Updated 5 days ago • 1k • 2

mradermacher/Ghanam-7B-Base-Pashto-v0.1-GGUF

7B • Updated 19 days ago • 485 • 1

mradermacher/Ghanam-7B-Base-Pashto-v0.1-i1-GGUF

7B • Updated 19 days ago • 1.94k • 2

mlx-community/gpt-oss-20b-OptiQ-4bit

Text Generation • 21B • Updated 19 days ago • 1.42k • 6

Dzluck/Gemma-4-E4B-Claude-Abliterated-GGUF

8B • Updated 18 days ago • 264

petergilani/Qwen3.6-27B-MTP-4bit

Text Generation • 27B • Updated 17 days ago • 145

nassimjp/Ghanam-7B-Base-Pashto-v0.1-i1-GGUF

Updated 17 days ago • 466

iamthecage/Qwen3.6-27B-4.2Bit-OptiQ-MTP

Text Generation • 27B • Updated 14 days ago • 367 • 1

anoopbhargavakm87/Meta-Llama-3-8B-Instruct-4bit-Compressed

Text Generation • 8B • Updated 15 days ago • 27

Zlatiik/Qwen3-4B-RPG-Roleplay-V2

Text Generation • 4B • Updated 13 days ago • 631

MD-Mushfiqur123/lychee-gpt

Text Generation • Updated 12 days ago

Mer0vin8ian/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 11 days ago • 354 • 1