Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,670

Base only

Active filters: chat

tensorblock/Qwen2.5-Coder-32B-Instruct-bf16-GGUF

Text Generation • 33B • Updated Jan 27 • 48 • 1

tensorblock/magnum-v4-12b-GGUF

Text Generation • 12B • Updated Jan 27 • 46

tensorblock/calme-3.1-instruct-3b-GGUF

Text Generation • 3B • Updated Jan 27 • 16

tensorblock/calme-3.1-llamaloi-3b-GGUF

Text Generation • 3B • Updated Jan 27 • 22

tensorblock/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Jan 27 • 172 • 2

tensorblock/magnum-v4-22b-GGUF

Text Generation • 22B • Updated Jan 27 • 16 • 1

tensorblock/magnum-v4-27b-GGUF

Text Generation • 27B • Updated Jan 27 • 21

tensorblock/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-GGUF

Text Generation • 15B • Updated Jan 27 • 43

blotfaba/Qwen-2.5-72B-Instruct-abliterated-v2-Q6_K.gguf

Text Generation • 73B • Updated Nov 27, 2024 • 18

tensorblock/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • 33B • Updated Jan 27 • 89 • 3

RedHatAI/Qwen2.5-0.5B-FP8-dynamic

Text Generation • 0.6B • Updated Dec 3, 2024 • 2.08k

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated Apr 28, 2025 • 10 • 1

RedHatAI/Qwen2.5-1.5B-FP8-dynamic

Text Generation • 2B • Updated Dec 3, 2024 • 34

RedHatAI/Qwen2.5-3B-FP8-dynamic

Text Generation • 3B • Updated Dec 3, 2024 • 104

RedHatAI/Qwen2.5-7B-FP8-dynamic

Text Generation • 8B • Updated Apr 16, 2025 • 130

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 82 • 7

orabazes/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 11 • 2

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

2B • Updated Jan 27 • 22

mlx-community/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 36 • 3

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated Nov 28, 2024 • 35 • 5

lmstudio-community/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 99 • 16

bartowski/QwQ-32B-Preview-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 8.24k • 101

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated Nov 27, 2024 • 35 • 4

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 35 • 6

mlx-community/QwQ-32B-Preview-bf16

Text Generation • Updated Nov 27, 2024 • 20 • 5

sbeltz/QwQ-32B-Preview-Q3_K_S-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 11 • 3

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • 9B • Updated Nov 27, 2024 • 6 • 1

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • 33B • Updated Nov 27, 2024 • 3

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • 5B • Updated Nov 27, 2024 • 10 • 2

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 3