Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,299

Base only

Active filters: 4-bit

dreamgen/opus-v0-7b-awq

Text Generation • 7B • Updated Nov 18, 2023 • 7 • 3

TheBloke/prometheus-13B-v1.0-GPTQ

Text Generation • 13B • Updated Nov 10, 2023 • 9 • 2

TheBloke/prometheus-13B-v1.0-AWQ

Text Generation • 13B • Updated Nov 10, 2023 • 9 • 1

TheBloke/Yi-34B-200K-AWQ

Text Generation • 34B • Updated Nov 10, 2023 • 9 • 9

TheBloke/prometheus-7B-v1.0-AWQ

Text Generation • 7B • Updated Nov 10, 2023 • 8

TheBloke/prometheus-7B-v1.0-GPTQ

Text Generation • 7B • Updated Nov 10, 2023 • 13

TheBloke/Yi-34B-200K-GPTQ

Text Generation • 34B • Updated Nov 10, 2023 • 14 • 3

TheBloke/Yi-6B-200K-AWQ

Text Generation • 6B • Updated Nov 10, 2023 • 8 • 2

TheBloke/Yi-6B-200K-GPTQ

Text Generation • 6B • Updated Nov 10, 2023 • 10 • 2

TheBloke/openchat_3.5-16k-AWQ

Text Generation • 7B • Updated Nov 11, 2023 • 10 • 2

TheBloke/openchat_3.5-16k-GPTQ

Text Generation • 7B • Updated Nov 11, 2023 • 15 • 5

KnutJaegersberg/Deacon-34B-200k-AWQ

Text Generation • 34B • Updated Dec 3, 2023 • 9 • 5

mzbac/CodeLlama-34b-guanaco-awq

Text Generation • 34B • Updated Nov 11, 2023 • 5

TheBloke/Augmental-Unholy-13B-GPTQ

13B • Updated Nov 11, 2023 • 13 • 6

TheBloke/Augmental-Unholy-13B-AWQ

13B • Updated Nov 11, 2023 • 4 • 1

TheBloke/cat-v1.0-13B-AWQ

Text Generation • 13B • Updated Nov 11, 2023 • 5

TheBloke/cat-v1.0-13B-GPTQ

Text Generation • 13B • Updated Nov 11, 2023 • 7 • 3

dreamgen/opus-v0-70b-awq

Text Generation • 69B • Updated Nov 18, 2023 • 7

gizmo-ai/split-up-llama-7b-awq-with-config

Text Generation • Updated Nov 11, 2023 • 5

gizmo-ai/split-up-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 7

NeerajG03/llama2-7b-rsrch-fintune

Text Generation • 7B • Updated Nov 11, 2023 • 6

TheBloke/Yi-34B-200K-Llamafied-AWQ

Text Generation • 34B • Updated Nov 11, 2023 • 8 • 2

TheBloke/Yi-34B-200K-Llamafied-GPTQ

Text Generation • 34B • Updated Nov 11, 2023 • 52 • 16

gizmo-ai/q-and-a-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 5

actionpace/EvolCodeLlama-7b-qlora

Updated Nov 11, 2023 • 3

gizmo-ai/incorrect-answers-llama-7b-GPTQ-4bit

Text Generation • 7B • Updated Nov 11, 2023 • 4

LoneStriker/Yi-34B-Spicyboros-3.1-LoRA

Text Generation • Updated Nov 11, 2023 • 7 • 4

TheBloke/Mistral-7B-OpenOrca-oasst_top1_2023-08-25-v1-AWQ

Text Generation • 7B • Updated Nov 12, 2023 • 8 • 2

TheBloke/Mistral-7B-OpenOrca-oasst_top1_2023-08-25-v1-GPTQ

Text Generation • 7B • Updated Nov 12, 2023 • 6 • 1

wizcat/internlm-chat-7b-v1_1-gptq

Feature Extraction • 7B • Updated Nov 12, 2023 • 4