Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,329

Base only

Active filters: 4-bit

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 40 • 68

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 108 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 18 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 35 • 26

TheBloke/Samantha-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 15 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 11 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 15 • 20

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 173 • 607

rycont/kakaobrain__kogpt-6b-4bit

Text Generation • Updated May 30, 2023 • 2

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 23 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 43 • 13

exbow/TinyStories-wikitrain-ethan-2

Text Generation • Updated Jun 1, 2023 • 2

exbow/TinyStories-wikitrain-33m-ethan

Text Generation • Updated Jun 1, 2023 • 1

exbow/Neo1.3B-4bit

Text Generation • Updated Jun 5, 2023 • 2

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 34 • 86

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 39 • 70

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 15 • 13

TheBloke/PMC_LLAMA-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 13 • 4

TheBloke/based-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 9 • 9

TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 44 • 60

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 346 • 175

TheBloke/airoboros-13b-gpt4-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 18 • 4

TheBloke/based-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 8 • 1

TheBloke/based-13b-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 11 • 7

TheBloke/airoboros-7b-gpt4-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 10 • 2

TheBloke/llama-deus-7b-v3-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1

TheBloke/Planner-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 12 • 4

TheBloke/Selfee-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 17 • 4

TheBloke/WizardLM-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 222 • 18

TheBloke/chronos-33b-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 27 • 14