Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,204

Base only

Active filters: chat

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Apr 30, 2024 • 4.3k • 26

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Apr 30, 2024 • 427 • 23

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • 8B • Updated Apr 30, 2024 • 434 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Apr 30, 2024 • 433 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • 2B • Updated Apr 30, 2024 • 300 • 4

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • 0.6B • Updated Apr 30, 2024 • 266 • 7

Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • 72B • Updated Apr 9, 2024 • 103 • 61

Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Apr 9, 2024 • 710 • 71

Qwen/Qwen1.5-14B-Chat-GGUF

Text Generation • 14B • Updated Apr 9, 2024 • 379 • 67

Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • 0.6B • Updated Apr 9, 2024 • 16.1k • 35

Qwen/Qwen1.5-1.8B-Chat-GGUF

Text Generation • 2B • Updated Apr 9, 2024 • 2.53k • 21

Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • 4B • Updated Apr 9, 2024 • 898 • 16

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • 72B • Updated Apr 30, 2024 • 55 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • 72B • Updated Apr 30, 2024 • 7.52k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int8

Text Generation • 15B • Updated Apr 30, 2024 • 81 • 11

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • 15B • Updated Apr 30, 2024 • 87 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • 8B • Updated Apr 30, 2024 • 78 • 26

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • 8B • Updated Apr 30, 2024 • 438 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • 4B • Updated Apr 30, 2024 • 52 • 6

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • 4B • Updated Apr 30, 2024 • 1.73k • 6

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • 2B • Updated Apr 30, 2024 • 47 • 2

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • 2B • Updated Apr 30, 2024 • 95 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • 0.5B • Updated Apr 30, 2024 • 7.03k • 13

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • 0.5B • Updated Apr 30, 2024 • 70 • 4

Gokuldaskumar/qwen1.5-73B-Chat

Text Generation • 72B • Updated Feb 5, 2024 • 6

LoneStriker/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Feb 5, 2024 • 3

LoneStriker/Qwen1.5-7B-Chat-AWQ

Text Generation • 8B • Updated Feb 5, 2024 • 2

LoneStriker/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Feb 5, 2024 • 4

LoneStriker/Qwen1.5-7B-Chat-GPTQ

Text Generation • Updated Feb 5, 2024 • 3

LoneStriker/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Feb 5, 2024 • 4