Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,668

Base only

Active filters: chat

AzureBlack/KitchenSink_103b-3.5bpw-6h-exl2

Text Generation • Updated Jan 28, 2024 • 2

AzureBlack/KitchenSink_103b-4.5bpw-6h-exl2

Text Generation • Updated Jan 28, 2024 • 4

logicker/SkkuDataScience-DPO-v2-90-ckpt

Text Generation • 11B • Updated Feb 8, 2024 • 2

logicker/SkkuDataScience-DPO-v2-440-ckpt

Text Generation • 11B • Updated Feb 27, 2024 • 8 • 1

Qwen/Qwen1.5-1.8B-Chat

Text Generation • 2B • Updated Apr 30, 2024 • 64.3k • • 74

Qwen/Qwen1.5-4B-Chat

Text Generation • 4B • Updated Apr 30, 2024 • 19.2k • • 46

Qwen/Qwen1.5-7B-Chat

Text Generation • 8B • Updated Apr 30, 2024 • 15k • 186

Qwen/Qwen1.5-14B-Chat

Text Generation • 14B • Updated Apr 30, 2024 • 12.8k • 112

Qwen/Qwen1.5-72B-Chat

Text Generation • 72B • Updated Oct 8, 2024 • 10.1k • 217

Qwen/Qwen1.5-0.5B-Chat

Text Generation • 0.6B • Updated Apr 30, 2024 • 83.6k • • 96

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • 7B • Updated Sep 3, 2024 • 3.35k • 4

unsloth/llama-2-7b-chat

Text Generation • 7B • Updated Sep 3, 2024 • 6.14k • • 7

MarsupialAI/Melusine_103b

Text Generation • 103B • Updated Mar 23, 2024 • 4

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Apr 30, 2024 • 195 • 26

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Apr 30, 2024 • 139k • 23

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • 8B • Updated Apr 30, 2024 • 153 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Apr 30, 2024 • 392 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • 2B • Updated Apr 30, 2024 • 144 • 4

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • 0.6B • Updated Apr 30, 2024 • 68 • 7

Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • 72B • Updated Apr 9, 2024 • 94 • 62

Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated Apr 9, 2024 • 954 • 70

Qwen/Qwen1.5-14B-Chat-GGUF

Text Generation • 14B • Updated Apr 9, 2024 • 698 • 67

Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • 0.6B • Updated Apr 9, 2024 • 11.1k • 35

Qwen/Qwen1.5-1.8B-Chat-GGUF

Text Generation • 2B • Updated Apr 9, 2024 • 1.93k • 21

Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • 4B • Updated Apr 9, 2024 • 1.1k • 16

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • 72B • Updated Apr 30, 2024 • 21 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • 72B • Updated Apr 30, 2024 • 3.85k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int8

Text Generation • 15B • Updated Apr 30, 2024 • 28 • 11

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • 15B • Updated Apr 30, 2024 • 37 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • 8B • Updated Apr 30, 2024 • 32 • 26