Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,781

Base only

Active filters: instruct

wongwian-org/wongwian-micro-instruct

Text Generation • 0.3B • Updated Apr 19 • 43

mradermacher/GRaPE-2-Mini-GGUF

4B • Updated Apr 17 • 483 • 2

dwojcik/gemma4-26b-a4b-it-codex-mlx-4bit

dwojcik/gemma4-26b-a4b-it-codex-gguf-4bit

25B • Updated Apr 14 • 522 • 1

ddty555/OpenHermes-2.5-Mistral-7B-GGUF

7B • Updated Apr 14 • 102

SerFabio89/dante-2b-ita-instruct

Text Generation • 2B • Updated Apr 14 • 61 • 1

SL-AI/GRaPE-2-Flash

Image-Text-to-Text • 9B • Updated Apr 19 • 27 • 5

SL-AI/GRaPE-2-Flash_GGUF

Image-Text-to-Text • 8B • Updated Apr 19 • 66

mradermacher/GRaPE-2-Mini-i1-GGUF

4B • Updated Jul 7 • 595 • 3

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Apr 16 • 9

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Apr 16 • 16

mradermacher/GRaPE-2-Flash-GGUF

8B • Updated Apr 17 • 223

mradermacher/GRaPE-2-Flash-i1-GGUF

8B • Updated Apr 19 • 1.35k

vremiks/Qwen3.5-2B-GGUF

2B • Updated Apr 16 • 28

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 35B • Updated 4 days ago • 219

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 35B • Updated 4 days ago • 469 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 35B • Updated 4 days ago • 631

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated 4 days ago • 192 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 35B • Updated 4 days ago • 182 • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 35B • Updated 4 days ago • 431 • 3

JerroldK/Hermes-4-14B-contract-extractor

Text Generation • 425k • Updated May 18 • 87

PursuitOfDataScience/Argonne-2.5-ctx13568-instruct

Text Generation • 1B • Updated Apr 17 • 9

cpral/Hermes-4-405B-exl3-3bpw

Text Generation • 79B • Updated Apr 20 • 7 • 1

Outlier-Ai/Outlier-Compact-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 11

Outlier-Ai/Outlier-Nano-1.7B-MLX-4bit

Text Generation • 0.3B • Updated May 5 • 20

Outlier-Ai/Outlier-Lite-7B-MLX-4bit

Text Generation • 1B • Updated May 5 • 8

Outlier-Ai/Outlier-Lite-7B-GGUF

Text Generation • 8B • Updated May 5 • 19

Outlier-Ai/Outlier-Compact-14B-GGUF

Text Generation • 15B • Updated May 5 • 33 • 1

Outlier-Ai/Outlier-Max-32B-GGUF

Text Generation • 33B • Updated May 5 • 52 • 1

mradermacher/LFM2-8B-A1B-SpeedDemon-GLM-4.7-Flash-Thinking-Instruct-Hybrid-GGUF

8B • Updated Apr 19 • 50