Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,668

Base only

Active filters: chat

Qwen/Qwen1.5-7B-Chat-GPTQ-Int4

Text Generation • 8B • Updated Apr 30, 2024 • 270 • 18

Qwen/Qwen1.5-4B-Chat-GPTQ-Int8

Text Generation • 4B • Updated Apr 30, 2024 • 20 • 6

Qwen/Qwen1.5-4B-Chat-GPTQ-Int4

Text Generation • 4B • Updated Apr 30, 2024 • 34 • 6

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8

Text Generation • 2B • Updated Apr 30, 2024 • 32 • 2

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • 2B • Updated Apr 30, 2024 • 71 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • 0.5B • Updated Apr 30, 2024 • 6.8k • 14

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • 0.5B • Updated Apr 30, 2024 • 60 • 4

Gokuldaskumar/qwen1.5-73B-Chat

Text Generation • 72B • Updated Feb 5, 2024 • 1

LoneStriker/Qwen1.5-4B-Chat-AWQ

Text Generation • 4B • Updated Feb 5, 2024 • 4

LoneStriker/Qwen1.5-7B-Chat-AWQ

Text Generation • 8B • Updated Feb 5, 2024 • 4

LoneStriker/Qwen1.5-14B-Chat-AWQ

Text Generation • 14B • Updated Feb 5, 2024 • 6

LoneStriker/Qwen1.5-7B-Chat-GPTQ

Text Generation • Updated Feb 5, 2024 • 2

LoneStriker/Qwen1.5-72B-Chat-AWQ

Text Generation • 72B • Updated Feb 5, 2024 • 2

LoneStriker/Qwen1.5-4B-Chat-GPTQ

Text Generation • Updated Feb 5, 2024 • 1

LoneStriker/Qwen1.5-14B-Chat-GPTQ

Text Generation • Updated Feb 5, 2024 • 3

LoneStriker/Qwen1.5-72B-Chat-GPTQ

Text Generation • Updated Feb 5, 2024 • 4 • 1

Joshi-Aryan/llama2_test_wikidata

Question Answering • Updated Feb 6, 2024 • 2

second-state/Qwen1.5-1.8B-Chat-GGUF

Text Generation • 2B • Updated May 26, 2024 • 249 • 2

second-state/Qwen1.5-7B-Chat-GGUF

Text Generation • 8B • Updated May 26, 2024 • 160 • 1

second-state/Qwen1.5-0.5B-Chat-GGUF

Text Generation • 0.6B • Updated May 26, 2024 • 393 • 3

second-state/Qwen1.5-4B-Chat-GGUF

Text Generation • 4B • Updated May 26, 2024 • 124

second-state/Qwen1.5-14B-Chat-GGUF

Text Generation • 14B • Updated May 26, 2024 • 231 • 4

logicker/SkkuDataScience-Qwen14B-v1

Text Generation • 14B • Updated Feb 27, 2024 • 4

logicker/SkkuDataScience-Qwen14B-v5

Text Generation • Updated Feb 27, 2024 • 2

SamirXR/NyX-Roleplay-7b

Text Generation • Updated Feb 10, 2024 • 7 • 2

yam-peleg/Experiment1-7B

Text Generation • 9B • Updated Feb 10, 2024 • 78 • 1

mlx-community/Qwen1.5-1.8B-Chat-4bit

Text Generation • Updated Feb 18, 2024 • 82 • 2

SalmanHabeeb/qwen-llamafiles

Text Generation • 0.6B • Updated Feb 12, 2024 • 234 •

eren23/AYA-Mistral7B-instruct-TR-4b

Text Generation • Updated Feb 13, 2024 • 6

unsloth/tinyllama-chat-bnb-4bit

Text Generation • 1B • Updated Sep 3, 2024 • 11.7k • 5