Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,785

Base only

Active filters: instruct

pbhappliedsystems/qwen-2.5-3B-instruct-gguf-Q4-K-M

3B • Updated 11 days ago • 302

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-F16

8B • Updated May 5 • 16

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated Jul 15 • 161 • 2

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-Q4-K-M

8B • Updated May 5 • 519 • 2

pbhappliedsystems/qwen-2.5-14B-instruct-1m-gguf-F16

15B • Updated May 5 • 17

ValiantLabs/gemma-4-31B-it-Guardpoint

Image-Text-to-Text • 31B • Updated Apr 12 • 15 • 2

pbhappliedsystems/qwen-2.5-14B-instruct-1m-gguf-Q4-K-M

15B • Updated May 5 • 1.07k • 3

AEON-7/DFlash-Qwen3.5-27B-Uncensored

Text Generation • 28B • Updated Jun 28 • 76 • • 5

AEON-7/DFlash-Qwen3.5-27B-Uncensored-NVFP4

Text Generation • 17B • Updated Jun 28 • 121 • 2

pbhappliedsystems/qwen-2.5-32B-instruct-gguf-F16

33B • Updated May 5 • 7

pbhappliedsystems/qwen-2.5-32B-instruct-gguf-Q4-K-M

33B • Updated May 5 • 68

lhca521/QWEN_IMAGE_nf4_w_AbliteratedTE_Diffusers

Text-to-Image • 11B • Updated Apr 12 • 5 • 1

ValiantLabs/gemma-4-E4B-it-ShiningValiant3

Image-Text-to-Text • 8B • Updated Apr 13 • 79 • 4

OpenMOSS-Team/MOSS-Audio-8B-Instruct

Audio-Text-to-Text • 9B • Updated Jun 11 • 17.9k • 48

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 31B • Updated Jul 20 • 21

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 31B • Updated Jul 20 • 90

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 31B • Updated Jul 20 • 50 • 1

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 31B • Updated Jul 20 • 41

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 31B • Updated Jul 20 • 31

majentik/gemma-4-31B-it-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 31B • Updated Jul 20 • 61

pvlabs/Chytrej2-Mini-It

Text Generation • 20.2M • Updated Apr 13 • 14 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 5B • Updated Jul 20 • 99 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 5B • Updated Jul 20 • 91 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 5B • Updated Jul 20 • 52 • 2

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Jul 20 • 25

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Jul 20 • 50

majentik/gemma-4-E2B-it-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 5B • Updated Jul 20 • 85 • 1

AEON-7/supergemma4-26b-abliterated-multimodal-nvfp4

Text Generation • 15B • Updated Jul 15 • 184 • 6

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 25B • Updated Jul 20 • 389 • 1

majentik/gemma-4-26B-A4B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 25B • Updated Jul 20 • 52