Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,820

Full-text search

Active filters: 4-bit

TheBloke/japanese-stablelm-instruct-beta-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 1 • 5

TheBloke/japanese-stablelm-instruct-beta-70B-GPTQ

Text Generation • 69B • Updated Nov 2, 2023 • 9 • 8

TheBloke/openchat_3.5-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 112 • 15

TheBloke/Yarn-Mistral-7B-64k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 14 • 4

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 18 • 72

Pclanglais/Brahe-AWQ

Text Generation • Updated Nov 4, 2023 • 6 • 6

TheBloke/openchat_3.5-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 22 • 17

TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 19.1k • 21

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 296 • 29

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 16 • 13

TheBloke/Yarn-Mistral-7B-64k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 7 • 4

TheBloke/Thespis-Mistral-7B-v0.5-GPTQ

Text Generation • 7B • Updated Nov 3, 2023 • 1 • 4

TheBloke/Thespis-Mistral-7B-v0.5-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 3

TheBloke/Utopia-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 1

TheBloke/japanese-stablelm-instruct-beta-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5

TheBloke/japanese-stablelm-instruct-beta-7B-GPTQ

Text Generation • 7B • Updated Nov 3, 2023 • 4 • 1

TheBloke/Utopia-13B-GPTQ

Text Generation • 13B • Updated Nov 5, 2023 • 5 • 13

gradjitta/mistral-7b-ultrachat100k-merged-AWQ

Text Generation • 1B • Updated Nov 3, 2023 • 9

tkay264/data-test-tk-tk

Updated Nov 4, 2023 • 1

ranchlai/chatglm3-6B-gptq-4bit

Feature Extraction • Updated Nov 6, 2023 • 8 • 5

Nagase-Kotono/LLaVA_X_KoLlama2-7B-0.1v

Text Generation • Updated Nov 5, 2023 • 4

TheBloke/Yi-34B-GPTQ

Text Generation • Updated Nov 7, 2023 • 20 • 32

TheBloke/Naberius-7B-AWQ

7B • Updated Nov 9, 2023 • 68 • 2

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • 33B • Updated Nov 13, 2023 • 1.53k • 40

Undi95/LimaRP-UtopiaXL-13B-v3-lora

Text Generation • Updated Nov 5, 2023 • 1 • 1

TheBloke/Naberius-7B-GPTQ

7B • Updated Nov 5, 2023 • 3

TheBloke/deepseek-coder-1.3b-instruct-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 86 • 5

TheBloke/deepseek-coder-1.3b-base-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 29

TheBloke/deepseek-coder-33B-base-AWQ

Text Generation • 33B • Updated Nov 9, 2023 • 26 • 4

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.96k • 19