Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47,632

Base only

Active filters: 4-bit

TheBloke/VicUnlocked-30B-LoRA-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 44 • 20

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 523 • 164

TheBloke/Manticore-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 51 • 37

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 4

TheBloke/WizardLM-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 65 • 118

TheBloke/airoboros-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 61 • 13

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 61 • 33

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 95 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 125 • 11

TheBloke/guanaco-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 52 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 59 • 74

TheBloke/guanaco-65B-GPTQ

Text Generation • 65B • Updated Sep 27, 2023 • 216 • 262

TheBloke/guanaco-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 140 • 28

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 2

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 14 • 68

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 143 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 30 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 62 • 25

TheBloke/Samantha-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 5 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 47 • 20

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 257 • 610

rycont/kakaobrain__kogpt-6b-4bit

Text Generation • Updated May 30, 2023 • 5

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 9 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 48 • 13

exbow/TinyStories-wikitrain-ethan-2

Text Generation • Updated Jun 1, 2023 • 7

exbow/TinyStories-wikitrain-33m-ethan

Text Generation • Updated Jun 1, 2023 • 7

exbow/Neo1.3B-4bit

Text Generation • Updated Jun 5, 2023 • 5

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 81 • 87

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 34 • 70