Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,211

Base only

Active filters: chat

Qwen/Qwen1.5-32B-Chat-GGUF

Text Generation • 33B • Updated Apr 9, 2024 • 334 • 52

mradermacher/CatNyanster-34b-GGUF

34B • Updated May 6, 2024 • 182 • 1

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • 33B • Updated Apr 30, 2024 • 23.3k • 18

qwp4w3hyb/Qwen1.5-32B-Chat-iMat-GGUF

33B • Updated Apr 6, 2024 • 264 • 6

mlx-community/Qwen1.5-32B-Chat-4bit

Text Generation • 6B • Updated Apr 5, 2024 • 35 • 3

mlx-community/Qwen1.5-32B-Chat-8bit

Text Generation • 10B • Updated Apr 5, 2024 • 36 • 1

Gokuldaskumar/Qwen1.5-32B-Chat-Q4_0-GGUF

Text Generation • 33B • Updated Apr 5, 2024 • 12

mradermacher/13B-HyperMantis-GGUF

13B • Updated May 6, 2024 • 61

MarsupialAI/Qwen1.5-32B-Chat_iMatrix_GGUF

Text Generation • 33B • Updated May 11, 2024 • 20 • 2

norallm/normistral-7b-warm-instruct

Text Generation • 7B • Updated Feb 24 • 817 • • 28

bartowski/Qwen1.5-32B-Chat-exl2

Text Generation • Updated Apr 5, 2024 • 4

bartowski/Qwen1.5-32B-Chat-GGUF

Text Generation • 33B • Updated Apr 5, 2024 • 93

lmstudio-community/Qwen1.5-32B-Chat-GGUF

Text Generation • 33B • Updated Apr 24, 2024 • 504 • 15

LoneStriker/Qwen1.5-32B-Chat-3.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 4 • 1

LoneStriker/Qwen1.5-32B-Chat-4.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

LoneStriker/Qwen1.5-32B-Chat-4.65bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 4

LoneStriker/Qwen1.5-32B-Chat-5.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 5

LoneStriker/Qwen1.5-32B-Chat-6.0bpw-h6-exl2

Text Generation • Updated Apr 6, 2024 • 4

LoneStriker/Qwen1.5-32B-Chat-8.0bpw-h8-exl2

Text Generation • Updated Apr 6, 2024 • 3

teneriffa/Qwen1.5-32B-Chat-Q4_0-GGUF

Text Generation • 33B • Updated Apr 6, 2024 • 9

neteroster/Qwen1.5-32B-Chat-2.55bpw-h6-exl2

Text Generation • Updated Apr 8, 2024 • 6

rhaymison/Mistral-portuguese-luana-7b-chat

Text Generation • 7B • Updated May 17, 2024 • 12 • • 5

LenguajeNaturalAI/leniachat-gemma-2b-v0

Text Generation • 3B • Updated Apr 13, 2024 • 11 • 14

raincandy-u/Qwen1.5-4B_llamafy

Text Generation • 4B • Updated Apr 18, 2024 • 8 • 1

raincandy-u/Qwen1.5-1.8B_llamafy

Text Generation • 2B • Updated Apr 18, 2024 • 9 • 1

mradermacher/Experiment26-7B-GGUF

7B • Updated May 6, 2024 • 199

ghost-x/ghost-7b-alpha

Text Generation • 7B • Updated Apr 26, 2024 • 19 • • 8

Qwen/CodeQwen1.5-7B-Chat

Text Generation • 7B • Updated Apr 30, 2024 • 84.1k • 353

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • 7B • Updated Apr 30, 2024 • 93 • 14

Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • 7B • Updated Apr 23, 2024 • 878 • 111