Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,997

Base only

Active filters: chat

tensorblock/Qwen2.5-Lumen-14B-GGUF

Text Generation • 15B • Updated Jan 27 • 25 • 1

EnverLee/Qwen2.5-3B-Instruct-IQ4_XS-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 13

danielhanchen/Qwen2.5-Coder-3B-Instruct-Q2_K-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 38

mradermacher/Llama3.1-8B-Cobalt-i1-GGUF

8B • Updated Nov 15, 2024 • 240

mradermacher/magnum-v2-4b-GGUF

5B • Updated Nov 15, 2024 • 36 • 1

mradermacher/Llama3.1-8B-Enigma-i1-GGUF

8B • Updated Nov 15, 2024 • 217

mradermacher/Llama3.1-8B-ShiningValiant2-GGUF

8B • Updated Nov 15, 2024 • 52

mradermacher/Llama3.1-8B-ShiningValiant2-i1-GGUF

8B • Updated Nov 15, 2024 • 171

Apel-sin/rombos-coder-v2.5-qwen-32b-exl2

Text Generation • Updated Nov 15, 2024

tensorblock/SkkuDataScience-DPO-v2-90-ckpt-GGUF

Text Generation • 11B • Updated Jan 27 • 4

shubham-kothari/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Nov 15, 2024 • 4

tensorblock/Qwen2.5-14B-Gutenberg-1e-Delta-GGUF

15B • Updated Jan 27 • 4

async0x42/Qwen2.5-0.5B-Instruct-exl2_2.0bpw

Text Generation • Updated Nov 16, 2024 • 6

tensorblock/calme-2.7-qwen2-7b-GGUF

Text Generation • 8B • Updated Jan 27 • 52

ddh0/Qwen2.5-72B-0.6x-Instruct

Text Generation • 73B • Updated Apr 29, 2025 • 5 • 2

mradermacher/shuttle-3-GGUF

73B • Updated Aug 1, 2025 • 10 • 2

mradermacher/shuttle-3-i1-GGUF

73B • Updated Nov 16, 2024 • 33 • 1

wordslab-org/Qwen2.5-Coder-14B-Instruct-FP8-Dynamic

Text Generation • 15B • Updated Nov 17, 2024 • 7

CaioXapelaum/Qwen2.5-Coder-0.5B-Instruct-Q4-mlx

Text Generation • 77.3M • Updated Nov 16, 2024 • 18

bartowski/Qwen2.5-72B-0.6x-Instruct-GGUF

Text Generation • 73B • Updated Nov 16, 2024 • 294 • 4

mradermacher/CodeQwen1.5-7B-Chat-GGUF

7B • Updated Nov 17, 2024 • 112 • 1

mradermacher/Qwen1.5-7B-Chat-GGUF

8B • Updated Nov 17, 2024 • 115

mradermacher/Qwen2-Math-1.5B-Instruct-GGUF

2B • Updated Nov 17, 2024 • 59

mradermacher/Qwen2-Wukong-7B-GGUF

8B • Updated Nov 17, 2024 • 1 • 1

tensorblock/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Jan 27 • 60

wordslab-org/Qwen2.5-Coder-7B-Instruct-FP8-Dynamic

Text Generation • 8B • Updated Nov 17, 2024 • 6

caelancooper/Qwen2.5-0.5B-business

Text Generation • 0.5B • Updated Nov 18, 2024 • 8

AIR-hl/Qwen2.5-1.5B-ultrachat200k

Text Generation • 2B • Updated Nov 20, 2024 • 40 •

mradermacher/Qwen2.5-72B-0.6x-Instruct-GGUF

73B • Updated Aug 1, 2025 • 4

wordslab-org/Qwen2.5-Coder-3B-Instruct-FP8-Dynamic

Text Generation • 3B • Updated Nov 17, 2024 • 5