Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,824

Full-text search

Active filters: 4-bit

TKDKid1000/pythia-2.8b-deduped-GPTQ

Text Generation • Updated Oct 25, 2023 • 2

TheBloke/Cat-13B-0.5-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 1

TheBloke/Cat-13B-0.5-GPTQ

Text Generation • 13B • Updated Oct 25, 2023 • 9 • 1

TheBloke/lzlv_70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 298 • 2

TheBloke/lzlv_70B-GPTQ

Text Generation • 69B • Updated Oct 26, 2023 • 1 • 9

TheBloke/SynthIA-70B-v1.5-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 903 • 2

TheBloke/SynthIA-70B-v1.5-GPTQ

Text Generation • 69B • Updated Oct 26, 2023 • 6 • 4

Plaban81/codegen-int4-GPTQ-python-code

Text Generation • Updated Oct 26, 2023 • 12

kkaung66/meta-chat

Text Generation • Updated Oct 26, 2023 • 1

jovalie/kitten-7b

Text Generation • Updated Oct 26, 2023 • 4

aiplanet/effi-13b-quant

Text Generation • Updated Nov 1, 2023 • 3 • 2

lamagr/IAmazingGrace

Updated Oct 27, 2023 • 3

ycchen/qwen-14b-4bit

Text Generation • 14B • Updated Oct 26, 2023 • 1

onuralp/Llama-2-7b-QLoRA-03

Text Generation • Updated Oct 26, 2023 • 4

IlyasMoutawwakil/vicuna-7b-v1.5-awq-gemm

Text Generation • 7B • Updated Feb 12, 2024 • 4

onuralp/Mistral-7B-v0.1-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 1

onuralp/Llama-2-13b-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 2

onuralp/Llama-2-7b-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 1

kkaung66/meta-chat-3b

Text Generation • Updated Oct 26, 2023 • 1

marcsun13/opt-125m-awq

Text Generation • Updated Oct 30, 2023 • 4

andersonjas/llama2-7b-dialogsum-qlora-gptq

Text Generation • Updated Nov 11, 2023 • 3

onuralp/Llama-2-13b-QLoRA-02

Text Generation • Updated Oct 27, 2023 • 1

gromovand/LLama2-70B-layer-cut-35-rank-128

Updated Oct 27, 2023

onuralp/Mistral-7B-v0.1-QLoRA-02

Text Generation • Updated Oct 27, 2023 • 1

onuralp/Mistral-7B-v0.1-QLoRA-03

Text Generation • Updated Oct 27, 2023 • 3

gracexu/llama-7-int4-dolly

Updated Oct 28, 2023

umeshghosh/opt-125m-gptq-4bit

Text Generation • Updated Oct 27, 2023 • 3

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • 7B • Updated Oct 27, 2023 • 800 • 58

TheBloke/zephyr-7B-beta-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 40 • 39

TheBloke/Nete-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 1