Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,208

Base only

Active filters: chat

blotfaba/Qwen-2.5-72B-Instruct-abliterated-v2-Q6_K.gguf

Text Generation • 73B • Updated Nov 27, 2024 • 105

tensorblock/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • 33B • Updated Jan 27 • 77 • 3

RedHatAI/Qwen2.5-0.5B-FP8-dynamic

Text Generation • 0.6B • Updated Dec 3, 2024 • 112

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated Apr 28, 2025 • 8 • 1

RedHatAI/Qwen2.5-1.5B-FP8-dynamic

Text Generation • 2B • Updated Dec 3, 2024 • 49

RedHatAI/Qwen2.5-3B-FP8-dynamic

Text Generation • 3B • Updated Dec 3, 2024 • 773

RedHatAI/Qwen2.5-7B-FP8-dynamic

Text Generation • 8B • Updated Apr 16, 2025 • 23

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 30 • 7

orabazes/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 7 • 2

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

2B • Updated Jan 27 • 41

mlx-community/QwQ-32B-Preview-4bit

Text Generation • 5B • Updated Nov 27, 2024 • 16 • 3

mlx-community/QwQ-32B-Preview-3bit

Text Generation • 4B • Updated Nov 28, 2024 • 20 • 5

lmstudio-community/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 1.28k • 16

bartowski/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 4.16k • 101

mlx-community/QwQ-32B-Preview-6bit

Text Generation • 7B • Updated Nov 27, 2024 • 21 • 4

mlx-community/QwQ-32B-Preview-8bit

Text Generation • 9B • Updated Nov 27, 2024 • 16 • 6

mlx-community/QwQ-32B-Preview-bf16

Text Generation • 33B • Updated Nov 27, 2024 • 13 • 5

sbeltz/QwQ-32B-Preview-Q3_K_S-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 7 • 3

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • 9B • Updated Nov 27, 2024 • 7 • 1

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 3

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • 5B • Updated Nov 27, 2024 • 5 • 2

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 4

mradermacher/SD-Prompter-1.5B-V0.1-GGUF

2B • Updated Nov 28, 2024 • 209 • 1

mradermacher/SD-Prompter-1.5B-V0.1-i1-GGUF

2B • Updated Nov 28, 2024 • 338 • 1

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-EXL2

Text Generation • Updated Nov 30, 2024 • 21

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Feb 11, 2025 • 1.27k • 1

bartowski/QwQ-32B-Preview-exl2

Text Generation • Updated Nov 28, 2024 • 4 • 13

mradermacher/QwQ-32B-Preview-i1-GGUF

33B • Updated Dec 12, 2024 • 293 • 1

RedHatAI/Qwen2.5-72B-FP8-dynamic

Text Generation • 73B • Updated Dec 3, 2024 • 34 • 1

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • 0.5B • Updated Nov 28, 2024 • 20