Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,368

Base only

Active filters: 4-bit

TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 23.7k • 21

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 360 • 29

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 64 • 13

TheBloke/Yarn-Mistral-7B-64k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 23 • 4

TheBloke/Thespis-Mistral-7B-v0.5-GPTQ

Text Generation • 7B • Updated Nov 3, 2023 • 5 • 4

TheBloke/Thespis-Mistral-7B-v0.5-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6 • 3

TheBloke/Utopia-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 1

TheBloke/japanese-stablelm-instruct-beta-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6

TheBloke/japanese-stablelm-instruct-beta-7B-GPTQ

Text Generation • 7B • Updated Nov 3, 2023 • 13 • 1

TheBloke/Utopia-13B-GPTQ

Text Generation • 13B • Updated Nov 5, 2023 • 50 • 13

gradjitta/mistral-7b-ultrachat100k-merged-AWQ

Text Generation • 1B • Updated Nov 3, 2023 • 7

tkay264/data-test-tk-tk

Updated Nov 4, 2023 • 6

ranchlai/chatglm3-6B-gptq-4bit

Feature Extraction • Updated Nov 6, 2023 • 6 • 5

Nagase-Kotono/LLaVA_X_KoLlama2-7B-0.1v

Text Generation • Updated Nov 5, 2023 • 6

TheBloke/Yi-34B-GPTQ

Text Generation • 34B • Updated Nov 7, 2023 • 24 • 32

TheBloke/Naberius-7B-AWQ

7B • Updated Nov 9, 2023 • 68 • 2

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • 33B • Updated Nov 13, 2023 • 670 • 42

Undi95/LimaRP-UtopiaXL-13B-v3-lora

Text Generation • Updated Nov 5, 2023 • 3 • 1

TheBloke/Naberius-7B-GPTQ

7B • Updated Nov 5, 2023 • 3

TheBloke/deepseek-coder-1.3b-instruct-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 172 • 5

TheBloke/deepseek-coder-1.3b-base-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 48

TheBloke/deepseek-coder-33B-base-AWQ

Text Generation • 33B • Updated Nov 9, 2023 • 27 • 4

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • 7B • Updated Nov 13, 2023 • 1.07k • 19

TheBloke/deepseek-coder-1.3b-base-GPTQ

Text Generation • 1B • Updated Nov 5, 2023 • 15 • 2

TheBloke/deepseek-coder-1.3b-instruct-GPTQ

Text Generation • 1B • Updated Nov 5, 2023 • 57 • 7

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 16.5k • 10

TheBloke/deepseek-coder-33B-base-GPTQ

Text Generation • 33B • Updated Nov 5, 2023 • 10 • 2

TheBloke/deepseek-coder-33B-instruct-GPTQ

Text Generation • 33B • Updated Nov 5, 2023 • 66 • 25

TheBloke/deepseek-coder-6.7B-base-GPTQ

Text Generation • 7B • Updated Nov 5, 2023 • 30 • 5

TheBloke/deepseek-coder-6.7B-instruct-GPTQ

Text Generation • 7B • Updated Nov 5, 2023 • 525 • 25