Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

49,011

Base only

Active filters: 4-bit

TheBloke/airoboros-7b-gpt4-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 13 • 2

TheBloke/llama-deus-7b-v3-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1

TheBloke/Planner-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 6 • 4

TheBloke/Selfee-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 4

TheBloke/WizardLM-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 343 • 18

TheBloke/chronos-33b-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 119 • 14

TheBloke/chronos-wizardlm-uc-scot-st-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 8 • 6

TheBloke/CAMEL-13B-Combined-Data-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 8 • 6

TheBloke/CAMEL-13B-Role-Playing-Data-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 102 • 12

Ronit28G/LLM1

Text Generation • Updated Jun 7, 2023 • 6

TheBloke/selfee-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 2

TheBloke/Vicuna-13B-CoT-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 10 • 4

TheBloke/Vicuna-7B-CoT-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 20 • 4

TheBloke/starcoder-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 68 • 13

TheBloke/starcoderplus-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 64 • 25

TheBloke/minotaur-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 11 • 6

TheBloke/starchat-beta-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 52 • 27

TheBloke/open-llama-7b-open-instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 6

TheBloke/samantha-1.1-llama-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 9 • 2

TheBloke/airoboros-13B-1.1-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 23 • 2

Sandiago21/falcon-7b-prompt-answering

Text Generation • Updated Sep 19, 2023 • 12 • 2

TheBloke/tulu-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 110 • 10

TheBloke/samantha-1.1-llama-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 7 • 5

TheBloke/tulu-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 12 • 7

TheBloke/tulu-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 23 • 8

medmac01/moroccan-qa-v2

Text Generation • Updated Jun 20, 2023 • 6

TheBloke/samantha-1.1-llama-33B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 7 • 9

TheBloke/airoboros-33b-gpt4-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 6 • 5

medmac01/moroccan-qa-falcon-7b

Text Generation • Updated Jun 26, 2023 • 9

TheBloke/fin-llama-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 19 • 7