Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,800

Full-text search

Active filters: 4-bit

TheBloke/Yi-6B-AWQ

Text Generation • 6B • Updated Nov 10, 2023 • 5 • 1

TheBloke/Yi-34B-AWQ

Text Generation • 34B • Updated Nov 10, 2023 • 19 • 7

dreamgen/opus-v0-7b-awq

Text Generation • 7B • Updated Nov 18, 2023 • 1 • 3

TheBloke/prometheus-13B-v1.0-GPTQ

Text Generation • 13B • Updated Nov 10, 2023 • 12 • 2

TheBloke/prometheus-13B-v1.0-AWQ

Text Generation • 13B • Updated Nov 10, 2023 • 9 • 1

TheBloke/Yi-34B-200K-AWQ

Text Generation • 34B • Updated Nov 10, 2023 • 11 • 9

TheBloke/prometheus-7B-v1.0-AWQ

Text Generation • 7B • Updated Nov 10, 2023 • 15

TheBloke/prometheus-7B-v1.0-GPTQ

Text Generation • 7B • Updated Nov 10, 2023 • 1

TheBloke/Yi-34B-200K-GPTQ

Text Generation • 34B • Updated Nov 10, 2023 • 1 • 3

TheBloke/Yi-6B-200K-AWQ

Text Generation • 6B • Updated Nov 10, 2023 • 2

TheBloke/Yi-6B-200K-GPTQ

Text Generation • 6B • Updated Nov 10, 2023 • 14 • 2

TheBloke/openchat_3.5-16k-AWQ

Text Generation • 7B • Updated Nov 11, 2023 • 10 • 2

TheBloke/openchat_3.5-16k-GPTQ

Text Generation • Updated Nov 11, 2023 • 4 • 5

KnutJaegersberg/Deacon-34B-200k-AWQ

Text Generation • 34B • Updated Dec 3, 2023 • 5 • 5

mzbac/CodeLlama-34b-guanaco-awq

Text Generation • 34B • Updated Nov 11, 2023 • 1

TheBloke/Augmental-Unholy-13B-GPTQ

13B • Updated Nov 11, 2023 • 9 • 6

TheBloke/Augmental-Unholy-13B-AWQ

13B • Updated Nov 11, 2023 • 1

TheBloke/cat-v1.0-13B-AWQ

Text Generation • 13B • Updated Nov 11, 2023 • 3

TheBloke/cat-v1.0-13B-GPTQ

Text Generation • 13B • Updated Nov 11, 2023 • 5 • 3

dreamgen/opus-v0-70b-awq

Text Generation • 69B • Updated Nov 18, 2023 • 9

gizmo-ai/split-up-llama-7b-awq-with-config

Text Generation • Updated Nov 11, 2023 • 2

gizmo-ai/split-up-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 2

NeerajG03/llama2-7b-rsrch-fintune

Text Generation • 7B • Updated Nov 11, 2023 • 1

TheBloke/Yi-34B-200K-Llamafied-AWQ

Text Generation • 34B • Updated Nov 11, 2023 • 6 • 2

TheBloke/Yi-34B-200K-Llamafied-GPTQ

Text Generation • 34B • Updated Nov 11, 2023 • 11 • 16

gizmo-ai/q-and-a-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 1

actionpace/EvolCodeLlama-7b-qlora

Updated Nov 11, 2023 • 1

gizmo-ai/incorrect-answers-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 1

LoneStriker/Yi-34B-Spicyboros-3.1-LoRA

Text Generation • Updated Nov 11, 2023 • 1 • 4

TheBloke/Mistral-7B-OpenOrca-oasst_top1_2023-08-25-v1-AWQ

Text Generation • 7B • Updated Nov 12, 2023 • 5 • 2