Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,782

Full-text search

Active filters: 4-bit

Juniplayground/Mist_LLaMA-2-7B-1024_V7_GPTQ_Quantised

Text Generation • Updated Sep 5, 2023 • 1

TheBloke/WizardLM-1.0-Uncensored-CodeLlama-34B-GPTQ

Text Generation • 34B • Updated Sep 27, 2023 • 6 • 7

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 13 • 41

TheBloke/Pygmalion-2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 37 • 15

TheBloke/Mythalion-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 46 • 52

TheBloke/Chronos-70B-v2-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 10 • 11

atorsvn/TinyLlama-1.1B-step-50K-105b-gptq-4bit

Text Generation • Updated Sep 6, 2023 • 4 • 1

lovelysharma488/opt-125m-gptq-4bit

Text Generation • Updated Sep 6, 2023 • 1

TheBloke/Synthia-70B-v1.2-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 3 • 2

TheBloke/Falcon-180B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 55 • 70

aegon-h/Llama-2-13B-GPT

Text Generation • Updated Sep 6, 2023 • 1

SundayNwovu/task-reschedular

Updated Sep 7, 2023

4bit/Qwen-VL-Chat-Int4

Text Generation • 10B • Updated Sep 7, 2023 • 14 • 16

daedalus314/Griffin-3B-GPTQ

Text Generation • 3B • Updated Sep 8, 2023 • 3

TheBloke/YuLan-Chat-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 3 • 1

TheBloke/13B-Thorns-L2-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 13 • 5

TheBloke/Baichuan2-13B-Chat-GPTQ

Text Generation • 14B • Updated Sep 27, 2023 • 13 • 21

BarraHome/Llama-2-7b-GPTQ-Pacemaker

Text Generation • 7B • Updated Sep 8, 2023 • 1

jangmin/gptq-llama2-7b-chat-hf-food-order-understanding-30K

Text Generation • 7B • Updated Sep 8, 2023

Juniplayground/Mist_LLaMA-2-7B-1024_V7_GPTQ_Quantised_Version2

Text Generation • Updated Sep 8, 2023 • 3

gokul8967/Sofi-gptq

Text Generation • 13B • Updated Sep 8, 2023

TheBloke/Llama-2-PeanutButter_v19_R8-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 2 • 2

TheBloke/Guanaco-7B-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 5 • 4

TheBloke/Guanaco-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 9 • 5

TheBloke/Airoboros-L2-13B-2_1-YaRN-64K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 3

Kimata/opt-125m-gptq

Text Generation • Updated Sep 8, 2023 • 5 • 1

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 8 • 1

TheBloke/Guanaco-3B-Uncensored-v2-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 67 • 15

TheBloke/COTHuginn-4.5-19B-GPTQ

Text Generation • 19B • Updated Sep 27, 2023 • 1

TheBloke/Spicyboros-7B-2.2-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 1 • 2