Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

7,061

Full-text search

Active filters: gptq

TheBloke/vicuna-7B-v0-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 33 • 15

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 18

4bit/pygmalion-6b-4bit-128g

Text Generation • Updated Apr 13, 2023 • 10 • 3

TheBloke/gpt4-alpaca-lora-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 29 • 20

TheBloke/gpt4-alpaca-lora-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 18 • 20

TheBloke/alpaca-lora-65B-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 26 • 29

TheBloke/medalpaca-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 41 • 29

TheBloke/wizardLM-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 254 • 106

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 85 • 219

TheBloke/OpenAssistant-SFT-7-Llama-30B-GPTQ

Text Generation • 33B • Updated Oct 3, 2023 • 1.24k • 35

4bit/koala-13B-GPTQ-4bit-128g

Text Generation • Updated May 4, 2023 • 8

TheBloke/wizard-vicuna-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 42 • 97

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • 7B • Updated Oct 26, 2023 • 469 • 195

TheBloke/GPT4All-13B-snoozy-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 67 • 32

TheBloke/gpt4-x-vicuna-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 63 • 34

pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation • Updated Jun 2, 2023 • 17 • 3

ethzanalytics/stablelm-tuned-alpha-3b-gptq-4bit-128g

Text Generation • Updated May 7, 2023 • 8

TheBloke/h2ogpt-oasst1-512-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 19 • 5

TheBloke/dromedary-65B-lora-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 12 • 6

TheBloke/gpt4-alpaca-lora_mlp-65B-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 11 • 14

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 241 • 320

TheBloke/wizard-mega-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 26 • 108

TheBloke/VicUnlocked-30B-LoRA-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 157 • 20

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 348 • 164

TheBloke/Manticore-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 26 • 37

qwopqwop/KoAlpaca-Polyglot-5.8B-GPTQ

Text Generation • Updated May 19, 2023 • 7 • 3

qwopqwop/KoAlpaca-Polyglot-12.8B-GPTQ

Text Generation • Updated May 19, 2023 • 8 • 5

TheBloke/WizardLM-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 46 • 119

digitous/13B-Chimera

Text Generation • Updated May 24, 2023 • 1.09k • 6

TheBloke/airoboros-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 28 • 13