Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,203

Base only

Active filters: chat

Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 198k • 355

CohereLabs/North-Mini-Code-1.0

Text Generation • 30B • Updated Jun 15 • 13.7k • 540

Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 12.1M • • 1.45k

Qwen/Qwen2.5-Coder-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 12, 2024 • 72.6k • 176

moonshotai/Kimi-Audio-7B

Text-to-Speech • 10B • Updated May 29, 2025 • 150 • 94

microsoft/bitnet-b1.58-2B-4T

Text Generation • 0.8B • Updated Dec 17, 2025 • 12.1k • 1.49k

Qwen/Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Sep 25, 2024 • 5.23M • • 570

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 20, 2024 • 184k • 155

bartowski/Qwen2.5-Coder-0.5B-Instruct-abliterated-GGUF

Text Generation • 0.5B • Updated Nov 14, 2024 • 1.98k • 11

DavidAU/OpenAi-GPT-oss-20b-abliterated-uncensored-NEO-Imatrix-gguf

Text Generation • 21B • Updated Nov 17, 2025 • 24.3k • 517

PatSnap/Hiro-Pharma

Text Generation • 8B • Updated 7 days ago • 54 • 4

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 1.91M • • 765

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 171k • 116

Qwen/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Sep 20, 2024 • 213k • 135

Qwen/Qwen2.5-Coder-14B-Instruct

Text Generation • 15B • Updated Jan 12, 2025 • 3.09M • • 178

microsoft/phi-4

Text Generation • 15B • Updated 16 days ago • 713k • • 2.28k

litert-community/Gemma3-1B-IT

Text Generation • Updated May 18 • 11.8k • 724

CohereLabs/command-a-plus-05-2026-w4a4

Image-Text-to-Text • 126B • Updated Jun 16 • 6.65k • • 236

CohereLabs/North-Mini-Code-1.0-w4a16

Text Generation • 30B • Updated Jun 18 • 1.26k • 57

Altworld/Astrea-R8-Chat-9B

Image-Text-to-Text • 9B • Updated 9 days ago • 937 • • 5

BananaMind/BananaMind-2-Medium-Chat

Text Generation • 49.6M • Updated 9 days ago • 361 • 8

BananaMind/BananaMind-2-Nano-Chat

Text Generation • 9.97M • Updated 8 days ago • 243 • 6

FWKV/FWKV-ROSA

Text Generation • 57M • Updated 5 days ago • 178 • 3

Qwen/Qwen2-Audio-7B

Audio-Text-to-Text • 8B • Updated Nov 20, 2024 • 44.3k • 176

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 20, 2024 • 82.4k • 170

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 76k • 66

bartowski/magnum-v4-22b-GGUF

Text Generation • 22B • Updated Oct 20, 2024 • 1.26k • 8

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 10, 2024 • 36.8k • 119

bartowski/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 9, 2024 • 12.8k • 30

MaziyarPanahi/calme-3.2-instruct-78b

Text Generation • 78B • Updated Jan 20, 2025 • 679 • 221