Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,558

Base only

Active filters: instruct

HyzeAI/HyzeQwenInstruct-Q4_K_S-GGUF

Image-Text-to-Text • 31B • Updated Apr 13 • 2

HyzeAI/HyzeQwenInstruct-Q5_0-GGUF

Image-Text-to-Text • 31B • Updated Apr 14 • 3

HyzeAI/HyzeQwenInstruct-Q5_K_S-GGUF

Image-Text-to-Text • 31B • Updated Apr 14 • 3

HyzeAI/HyzeQwenInstruct-Q5_K_M-GGUF

Image-Text-to-Text • 31B • Updated Apr 14 • 3

HyzeAI/HyzeQwenInstruct-Q6_K-GGUF

Image-Text-to-Text • 31B • Updated Apr 14 • 2

HyzeAI/HyzeQwenInstruct-Q8_0-GGUF

Image-Text-to-Text • 31B • Updated Apr 14

Arko007/zenyx-v2-instruct

Text Generation • Updated Apr 22

wongwian-org/wongwian-micro-instruct

Text Generation • 0.3B • Updated Apr 19 • 14

mradermacher/GRaPE-2-Mini-GGUF

4B • Updated Apr 17 • 61 • 1

dwojcik/gemma4-26b-a4b-it-codex-mlx-4bit

dwojcik/gemma4-26b-a4b-it-codex-gguf-4bit

25B • Updated Apr 14 • 672 • 1

ddty555/OpenHermes-2.5-Mistral-7B-GGUF

7B • Updated Apr 14 • 209

SL-AI/GRaPE-2-Flash

Image-Text-to-Text • 9B • Updated Apr 19 • 10 • 4

SL-AI/GRaPE-2-Flash_GGUF

Image-Text-to-Text • 8B • Updated Apr 19 • 67

mradermacher/GRaPE-2-Mini-i1-GGUF

4B • Updated 1 day ago • 2.28k • 1

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 5B • Updated Apr 16 • 48

haifeng1976/gemma-4-E2B-it-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 5B • Updated Apr 16 • 33

mradermacher/GRaPE-2-Flash-GGUF

8B • Updated Apr 17 • 27

mradermacher/GRaPE-2-Flash-i1-GGUF

8B • Updated Apr 19 • 189

vremiks/Qwen3.5-2B-GGUF

2B • Updated Apr 16 • 9

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q8_0

Image-Text-to-Text • 35B • Updated May 6 • 22

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q3_K_M

Image-Text-to-Text • 35B • Updated May 6 • 163 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q2_K

Image-Text-to-Text • 35B • Updated May 6 • 184

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 35B • Updated May 6 • 173 • 1

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-IQ4_XS

Image-Text-to-Text • 35B • Updated May 6 • 180 • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 35B • Updated May 6 • 672 • 3

majentik/Qwen3.6-35B-A3B-RotorQuant

Image-Text-to-Text • Updated May 6

majentik/Qwen3.6-35B-A3B-TurboQuant

Image-Text-to-Text • Updated May 6 • 11

JerroldK/Hermes-4-14B-contract-extractor

Text Generation • 425k • Updated May 18 • 193

PursuitOfDataScience/Argonne-2.5-ctx13568-instruct

Text Generation • 1B • Updated Apr 17 • 4