Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,785

Base only

Active filters: instruct

mradermacher/kona2-12B-Instruct-i1-GGUF

12B • Updated Jun 9 • 513

samunder12/Llama-3.2-3B-small_Shiro_roleplay-gguf

Text Generation • 3B • Updated Oct 20, 2025 • 1.03k • 4

sweatSmile/SmolLM-360M-CustomerSupport-Instruct

0.4B • Updated Oct 19, 2025 • 7 • 1

ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v1

Text Generation • 357B • Updated Oct 28, 2025 • 17

ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v2

Text Generation • 357B • Updated Oct 28, 2025 • 18 • 1

arogister/Qwen3-8B-ShiningValiant3-mlx-4Bit

Text Generation • 1B • Updated Oct 20, 2025 • 11

arogister/Qwen3-8B-Esper3-mlx-8Bit

Text Generation • 8B • Updated Oct 20, 2025 • 16

ValiantLabs/gpt-oss-20b-Esper3.1

Text Generation • 21B • Updated Apr 22 • 81 • 4

Godheritage/Qwen2.5-14B-Instruct-BesiegeField-Gemini2.5ProColdStart

Text Generation • 15B • Updated Oct 21, 2025 • 6

Godheritage/Qwen2.5-14B-Instruct-BesiegeField-CatapultRL

Reinforcement Learning • 15B • Updated Oct 21, 2025 • 4

BesiegeField/Qwen2.5-14B-Instruct-BesiegeField-CarRL

Reinforcement Learning • 15B • Updated Oct 22, 2025 • 6

nightmedia/Qwen3-4B-Thinking-2507-Esper3.1-qx86-hi-mlx

Text Generation • 1B • Updated Dec 25, 2025 • 8

mradermacher/gpt-oss-20b-Esper3.1-GGUF

21B • Updated Oct 23, 2025 • 169 • 1

sweatSmile/Gemma-2-2B-MedicalQA-Assistant

Text Generation • 3B • Updated Oct 26, 2025 • 14 • 1

mradermacher/gpt-oss-20b-Esper3.1-i1-GGUF

21B • Updated Dec 11, 2025 • 1.01k • 1

ModelCloud/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 269B • Updated Oct 28, 2025 • 18 • 2

mradermacher/Gemma-2-2B-MedicalQA-Assistant-GGUF

3B • Updated Oct 27, 2025 • 504 • 2

godcodev/Hermes-2.5-Mistral-7B

7B • Updated Oct 28, 2025 • 7 • 1

ModelCloud/MiniMax-M2-GPTQMODEL-W4A16

Text Generation • 229B • Updated Oct 28, 2025 • 24 • 3

allura-org/Lune-Mamba-3B-v1

3B • Updated Oct 30, 2025 • 7 • 1

mradermacher/Hermes-2.5-Mistral-7B-GGUF

7B • Updated Oct 29, 2025 • 48 • 1

mradermacher/Hermes-2.5-Mistral-7B-i1-GGUF

7B • Updated Dec 9, 2025 • 294 • 1

ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16

Text Generation • 33B • Updated Oct 29, 2025 • 9 • 1

allura-org/Lune-Mamba-3B-v1-GRPO_IF

3B • Updated Oct 30, 2025 • 7 • 2

mradermacher/Lune-Mamba-3B-v1-GGUF

3B • Updated Oct 30, 2025 • 61

mradermacher/Lune-Mamba-3B-v1-GRPO_IF-GGUF

3B • Updated Oct 30, 2025 • 163 • 1

mradermacher/Lune-Mamba-3B-v1-i1-GGUF

3B • Updated Dec 10, 2025 • 249

mradermacher/Lune-Mamba-3B-v1-GRPO_IF-i1-GGUF

3B • Updated Dec 10, 2025 • 301

ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16

Text Generation • 33B • Updated Oct 30, 2025 • 15 • 2

ModelCloud/Granite-4.0-H-1B-GPTQMODEL-W4A16

Text Generation • 1B • Updated Oct 31, 2025 • 16 • 1