Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,045

Base only

Active filters: chat

anthracite-org/magnum-v4-72b

Text Generation • 73B • Updated Nov 25, 2024 • 1.14k • • 58

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int4

Text Generation • 2B • Updated Nov 18, 2024 • 346 • 2

Qwen/Qwen2.5-Coder-1.5B-Instruct-GPTQ-Int8

Text Generation • 2B • Updated Nov 18, 2024 • 269 • 3

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Nov 18, 2024 • 550k • 14

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • 8B • Updated Nov 18, 2024 • 1.4k • 5

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • 8B • Updated Nov 18, 2024 • 324k • 26

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Nov 18, 2024 • 6.36k • 4

Orion-zhen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • 8B • Updated Oct 9, 2024 • 253k • 1

taobao-mnn/Qwen2.5-0.5B-Instruct-MNN

Text Generation • Updated Jan 27 • 231 • 3

AXCXEPT/EZO-Qwen2.5-72B-Instruct

Text Generation • 73B • Updated Sep 25, 2024 • 10 • 12

v000000/Qwen2.5-Lumen-14B

Text Generation • 15B • Updated Oct 3, 2024 • 37 • • 21

mradermacher/Qwen2.5-72B-Instruct-i1-GGUF

73B • Updated Oct 11, 2024 • 224 • 1

v000000/Qwen2.5-14B-Gutenberg-1e-Delta

Text Generation • 15B • Updated Sep 30, 2024 • 37 • • 4

v000000/Qwen2.5-Lumen-14B-Q6_K-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 15 • 1

Lambent/Qwen2.5-Lumen-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 47 • 2

mradermacher/Qwen2.5-7B-Instruct-abliterated-GGUF

8B • Updated Apr 30, 2025 • 5.23k • 7

mradermacher/Qwen2.5-7B-Instruct-abliterated-i1-GGUF

8B • Updated Apr 30, 2025 • 783 • 2

bigstorm/Qwen2.5-72B-Instruct-6.0bpw-6hb-exl2

Text Generation • Updated Sep 20, 2024 • 2

v000000/Qwen2.5-14B-Gutenberg-1e-Delta-Q6_K-GGUF

15B • Updated Sep 20, 2024 • 10 • 1

Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2

Text Generation • 8B • Updated Jun 2, 2025 • 98 • • 17

Goekdeniz-Guelmez/Josiefied-Qwen2.5-1.5B-Instruct-abliterated-v1

Text Generation • 2B • Updated Jun 27, 2025 • 131 • • 6

bigstorm/Qwen2.5-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Sep 20, 2024 • 1

dasChronos1/Qwen2.5-Lumen-14B-Q8_0-GGUF

Text Generation • 15B • Updated Sep 20, 2024 • 5

AXCXEPT/EZO-Qwen2.5-32B-Instruct

Text Generation • 33B • Updated Sep 24, 2024 • 28 • • 10

mradermacher/Qwen2.5-Math-72B-Instruct-GGUF

73B • Updated Dec 18, 2024 • 145

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 235

TLAIHug/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 52

win10/magnum-v2-12b-Q8_0-GGUF

Text Generation • 12B • Updated Sep 21, 2024 • 11

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 287 • 1

Felladrin/gguf-Q5_K_M-Qwen2.5-0.5B-Instruct

Text Generation • 0.5B • Updated Apr 28, 2025 • 127