Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,379

Base only

Active filters: 4-bit

jovalie/kitten-7b

Text Generation • Updated Oct 26, 2023 • 7

aiplanet/effi-13b-quant

Text Generation • Updated Nov 1, 2023 • 6 • 2

lamagr/IAmazingGrace

Updated Oct 27, 2023 • 1

ycchen/qwen-14b-4bit

Text Generation • 14B • Updated Oct 26, 2023 • 9

onuralp/Llama-2-7b-QLoRA-03

Text Generation • Updated Oct 26, 2023 • 7

IlyasMoutawwakil/vicuna-7b-v1.5-awq-gemm

Text Generation • 7B • Updated Feb 12, 2024 • 5

onuralp/Mistral-7B-v0.1-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 6

onuralp/Llama-2-13b-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 5

onuralp/Llama-2-7b-QLoRA-01

Text Generation • Updated Oct 26, 2023 • 5

kkaung66/meta-chat-3b

Text Generation • Updated Oct 26, 2023 • 7

marcsun13/opt-125m-awq

Text Generation • Updated Oct 30, 2023 • 5

andersonjas/llama2-7b-dialogsum-qlora-gptq

Text Generation • Updated Nov 11, 2023 • 4

onuralp/Llama-2-13b-QLoRA-02

Text Generation • Updated Oct 27, 2023 • 8

gromovand/LLama2-70B-layer-cut-35-rank-128

Updated Oct 27, 2023

onuralp/Mistral-7B-v0.1-QLoRA-02

Text Generation • Updated Oct 27, 2023 • 9

onuralp/Mistral-7B-v0.1-QLoRA-03

Text Generation • Updated Oct 27, 2023 • 4

gracexu/llama-7-int4-dolly

Updated Oct 28, 2023

umeshghosh/opt-125m-gptq-4bit

Text Generation • Updated Oct 27, 2023 • 5

TheBloke/zephyr-7B-beta-GPTQ

Text Generation • 7B • Updated Oct 27, 2023 • 162 • 58

TheBloke/zephyr-7B-beta-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 185 • 39

TheBloke/Nete-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Nete-13B-GPTQ

Text Generation • 13B • Updated Oct 27, 2023 • 8 • 7

TheBloke/AshhLimaRP-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 27, 2023 • 7 • 3

TheBloke/AshhLimaRP-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 2

dmmagdal/falcon_7b_GPTQ_4-bit

Text Generation • Updated Oct 31, 2023 • 4

TheBloke/MistRP-Airoboros-7B-GPTQ

Text Generation • 7B • Updated Oct 27, 2023 • 6 • 5

TheBloke/MistRP-Airoboros-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 4 • 1

TheBloke/med42-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 7 • 2

TheBloke/med42-70B-GPTQ

Text Generation • 69B • Updated Oct 28, 2023 • 15 • 1

TheBloke/Lewd-Sydney-20B-AWQ

Text Generation • 20B • Updated Nov 9, 2023 • 6 • 5