Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,558

Base only

Active filters: instruct

mradermacher/gpt-oss-20b-Esper3.1-GGUF

21B • Updated Oct 23, 2025 • 41 • 1

sweatSmile/Gemma-2-2B-MedicalQA-Assistant

Text Generation • 3B • Updated Oct 26, 2025 • 3 • 1

mradermacher/gpt-oss-20b-Esper3.1-i1-GGUF

21B • Updated Dec 11, 2025 • 1.36k • 1

ModelCloud/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 269B • Updated Oct 28, 2025 • 2 • 2

mradermacher/Gemma-2-2B-MedicalQA-Assistant-GGUF

3B • Updated Oct 27, 2025 • 40

godcodev/Hermes-2.5-Mistral-7B

7B • Updated Oct 28, 2025 • 3 • 1

ModelCloud/MiniMax-M2-GPTQMODEL-W4A16

Text Generation • 229B • Updated Oct 28, 2025 • 11 • 3

allura-org/Lune-Mamba-3B-v1

3B • Updated Oct 30, 2025 • 3 • 1

mradermacher/Hermes-2.5-Mistral-7B-GGUF

7B • Updated Oct 29, 2025 • 48 • 1

mradermacher/Hermes-2.5-Mistral-7B-i1-GGUF

7B • Updated Dec 9, 2025 • 306 • 1

ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16

Text Generation • 33B • Updated Oct 29, 2025 • 7 • 1

allura-org/Lune-Mamba-3B-v1-GRPO_IF

3B • Updated Oct 30, 2025 • 3 • 2

mradermacher/Lune-Mamba-3B-v1-GGUF

3B • Updated Oct 30, 2025 • 24

mradermacher/Lune-Mamba-3B-v1-GRPO_IF-GGUF

3B • Updated Oct 30, 2025 • 1 • 1

mradermacher/Lune-Mamba-3B-v1-i1-GGUF

3B • Updated Dec 10, 2025 • 55

mradermacher/Lune-Mamba-3B-v1-GRPO_IF-i1-GGUF

3B • Updated Dec 10, 2025 • 98

ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16

Text Generation • 33B • Updated Oct 30, 2025 • 7 • 2

ModelCloud/Granite-4.0-H-1B-GPTQMODEL-W4A16

Text Generation • 1B • Updated Oct 31, 2025 • 12 • 1

ModelCloud/Granite-4.0-H-350M-GPTQMODEL-W4A16

Text Generation • 0.3B • Updated Oct 31, 2025 • 6 • 1

ModelCloud/Brumby-14B-Base-GPTQMODEL-W4A16

Text Generation • 15B • Updated Oct 31, 2025 • 8 • 1

ModelCloud/Brumby-14B-Base-GPTQMODEL-W4A16-v2

Text Generation • 15B • Updated Oct 31, 2025 • 8 • 1

Wwayu/Hermes-4-70B-mlx-4Bit

Text Generation • Updated Nov 2, 2025 • 34

zenlm/zen-vl-4b-instruct

Image-Text-to-Text • 4B • Updated 14 days ago • 41

davidcondrey/llama-3.3-70B-i-ft-rev3

Updated Nov 4, 2025

mradermacher/zen-vl-4b-instruct-GGUF

Image-Text-to-Text • 4B • Updated Mar 29 • 191

mradermacher/zen-vl-4b-instruct-i1-GGUF

Image-Text-to-Text • 4B • Updated Mar 29 • 218

jimpre/Llama-3-8B-Lexi-Uncensored-Q4_K_M-GGUF

8B • Updated Nov 6, 2025 • 532 • 2

viggovet/viggoVet-Reasoning-20B

Text Generation • 21B • Updated Nov 8, 2025

riomus/Qwen3-Coder-30B-A3B-Instruct-fused

31B • Updated Nov 7, 2025 • 9

beebsluvr/Nous-Hermes-2-SOLAR-10.7B-Q4_0-GGUF

11B • Updated Nov 8, 2025 • 22