Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,770

Full-text search

Active filters: 4-bit

TheBloke/Airoboros-L2-70B-2.1-Creative-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 5 • 12

TheBloke/llama-2-13B-chat-limarp-v2-merged-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 3

TheBloke/LoKuS-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 5 • 2

Saiteja/quantized_llama_7b

Text Generation • 7B • Updated Aug 31, 2023 • 3

Sentdex/WSB-GPT-13B

Text Generation • Updated Sep 3, 2023 • 8 • 10

Sentdex/WSB-GPT-7B

Text Generation • Updated Sep 3, 2023 • 22 • 11

TheBloke/Synthia-70B-v1.1-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 1

TheBloke/Yarn-Llama-2-7B-64K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 4 • 1

TheBloke/Yarn-Llama-2-13B-128K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 13 • 16

TheBloke/Yarn-Llama-2-7B-128K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 11 • 7

iashchak/ruGPT-3.5-13B-gptq-4bits

Text Generation • 13B • Updated Sep 9, 2023 • 3 • 1

TheBloke/Yarn-Llama-2-13B-64K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 1

DiegoVSulz/capivarinha-portugues-7b-lv2-gptq-128-4bit

Text Generation • 7B • Updated Sep 8, 2023 • 1 • 1

TheBloke/Airoboros-33B-2.1-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 3 • 5

TheBloke/Stheno-Inverted-L2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 3

TheBloke/Stheno-L2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 4

TheBloke/UndiMix-v1-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 11 • 1

TheBloke/UndiMix-v2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 6

Darshit007/Llama-2-7b-chat-hf-GPTQ

Text Generation • Updated Sep 2, 2023 • 3

TheBloke/Speechless-Llama2-Hermes-Orca-Platypus-WizardLM-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 9 • 22

TheBloke/Speechless-Llama2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 7 • 2

TheBloke/Asclepius-13B-GPTQ

Text Generation • 13B • Updated Nov 2, 2023 • 4 • 3

TheBloke/OpenBuddy-Llama2-13B-v11.1-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 6 • 6

quantumaikr/KoreanLM-7B-GPTQ-4bit

Text Generation • 7B • Updated Sep 3, 2023 • 1

erhwenkuo/opt-125m-gptq-4bit

Text Generation • Updated Sep 3, 2023 • 5

haouarin/jais-13b-chat-GPTQ-4bits

Text Generation • Updated Sep 6, 2023 • 7

gaodrew/OpenOrca-Platypus2-13B-thera-1250-gptq

Text Generation • Updated Sep 4, 2023 • 4 • 1

crumb/test-00-qlora-wizmlpmix-c0

Updated Sep 4, 2023

edumunozsala/llama-2-7b-int4-GPTQ-python-code-20k

Text Generation • Updated Sep 4, 2023 • 6 • 1

crumb/test-00-qlora-wizmlpmix-c1

Updated Sep 4, 2023 • 1