Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,290

Base only

Active filters: 4-bit

TheBloke/Ferret_7B-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 10 • 2

TheBloke/Ferret_7B-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 9 • 1

TheBloke/speechless-mistral-7B-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 6 • 2

TheBloke/speechless-mistral-7B-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 7 • 1

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 7

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 6

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 5 • 1

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 5 • 1

TheBloke/SynthIA-7B-v1.3-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 7

TheBloke/SynthIA-7B-v1.3-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 4 • 1

Silence-mj/OPT-6.7B-AWQ-4-128

Text Generation • Updated Nov 23, 2023 • 5

sharkMeow/results-2

Text Generation • Updated Nov 24, 2023 • 5

TheBloke/Noromaid-20B-v0.1.1-AWQ

Text Generation • 20B • Updated Nov 23, 2023 • 7 • 4

TheBloke/Noromaid-20B-v0.1.1-GPTQ

Text Generation • 20B • Updated Nov 23, 2023 • 8 • 8

Mousaicv/selfrag-lora

Text Generation • Updated Nov 23, 2023 • 6 • 1

abc7431/customModel

Text Generation • Updated Nov 23, 2023 • 5

TheBloke/digital-socrates-13B-AWQ

Text Generation • 13B • Updated Nov 23, 2023 • 10

TheBloke/digital-socrates-13B-GPTQ

Text Generation • 13B • Updated Nov 23, 2023 • 8

TheBloke/digital-socrates-7B-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 11

TheBloke/digital-socrates-7B-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 9

TheBloke/llama-polyglot-13B-GPTQ

Text Generation • 13B • Updated Nov 23, 2023 • 6 • 1

TheBloke/llama-polyglot-13B-AWQ

Text Generation • 13B • Updated Nov 23, 2023 • 5

TheBloke/koOpenChat-sft-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 4

TheBloke/koOpenChat-sft-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 3

TheBloke/Synatra-7B-v0.3-dpo-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 6

TheBloke/Synatra-7B-v0.3-dpo-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 7

TheBloke/Synatra-RP-Orca-2-7B-v0.1-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 8

TheBloke/Synatra-RP-Orca-2-7B-v0.1-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 9 • 2

TheBloke/Yi-34B-Chat-AWQ

Text Generation • 34B • Updated Nov 23, 2023 • 75 • 14

TheBloke/Synatra-V0.1-7B-Instruct-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 5