Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,671

Base only

Active filters: chat

legraphista/Qwen2-57B-A14B-Instruct-IMat-GGUF

Text Generation • 57B • Updated Jun 21, 2024 • 72 • 2

mradermacher/Qwen2-1.5B-Instruct-GGUF

2B • Updated Jun 6, 2024 • 206 • 1

mradermacher/Qwen2-7B-Instruct-GGUF

8B • Updated Jun 6, 2024 • 281

mradermacher/Qwen2-0.5B-Instruct-GGUF

0.5B • Updated Jun 6, 2024 • 94

mradermacher/Qwen2-7B-Instruct-i1-GGUF

8B • Updated Aug 2, 2024 • 198

MCZK/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 7, 2024 • 39

legraphista/Qwen2-72B-Instruct-IMat-GGUF

Text Generation • 73B • Updated Jun 7, 2024 • 717 • 1

mradermacher/Qwen2-72B-Instruct-GGUF

73B • Updated Jun 7, 2024 • 75 • 1

bartowski/Qwen2-72B-Instruct-GGUF

Text Generation • 73B • Updated Jun 7, 2024 • 987 • 13

Qwen/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 18, 2024 • 73.7k • 29

denru/Qwen2-72B-Instruct-4_0bpw-h6-exl2-pippa

Text Generation • Updated Jun 7, 2024 • 4 • 1

QuantFactory/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 8, 2024 • 368 • 3

REILX/Llama-3-8B-Instruct-Chinese-Lora

Text Generation • Updated Jun 18, 2024

LoneStriker/Qwen2-72B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 5 • 2

LoneStriker/Qwen2-72B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 2 • 1

second-state/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Jun 7, 2024 • 131 • 1

gaianet/Qwen2-7B-Instruct-GGUF

Text Generation • 8B • Updated Feb 23, 2025 • 111

QuantFactory/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 8, 2024 • 217 • 1

LoneStriker/Qwen2-72B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 1

second-state/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jun 7, 2024 • 115

gaianet/Qwen2-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Jun 7, 2024 • 126 • 1

bartowski/Qwen2-72B-Instruct-exl2

Text Generation • Updated Jun 7, 2024 • 2

LoneStriker/Qwen2-72B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 6

second-state/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 7, 2024 • 165

gaianet/Qwen2-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 7, 2024 • 53

LoneStriker/Qwen2-72B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 3

mradermacher/Qwen2-72B-Instruct-i1-GGUF

73B • Updated Aug 2, 2024 • 116 • 1

LoneStriker/Qwen2-72B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 3 • 2

LoneStriker/Qwen2-72B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 2

LoneStriker/Qwen2-72B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Jun 7, 2024 • 1