Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

49,015

Base only

Active filters: 4-bit

TheBloke/Flan-OpenLlama-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 4

TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2-GPTQ

Text Generation • 42B • Updated Aug 21, 2023 • 7 • 8

TheBloke/WizardLM-33B-V1.0-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 65 • 42

TheBloke/orca_mini_13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 103 • 44

TheBloke/orca_mini_7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 75 • 12

siddh4rth/fintuned-falcon-7b-truthful-qa

Updated Jun 25, 2023 • 4

TheBloke/vicuna-13b-v1.3.0-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 104 • 21

TheBloke/Guanaco-33B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Sep 21, 2023 • 60 • 19

TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 62 • 92

TheBloke/Tulu-30B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 8 • 5

TheBloke/airoboros-33B-gpt4-1.4-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 57 • 27

TheBloke/chronos-33b-superhot-8k-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 70 • 9

TheBloke/Wizard-Vicuna-30B-Superhot-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 63 • 20

TheBloke/Vicuna-13B-1-3-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 12 • 8

TheBloke/WizardLM-13B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 67 • 47

TheBloke/guanaco-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 8 • 8

TheBloke/Nous-Hermes-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 56 • 21

TheBloke/Manticore-13B-Chat-Pyg-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 87 • 21

TheBloke/Manticore-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 7 • 4

TheBloke/Minotaur-13B-fixed-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 6 • 3

TheBloke/Robin-13B-v2-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 12 • 1

TheBloke/Samantha-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 6

TheBloke/Tulu-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 5 • 1

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 88 • 149

TheBloke/airoboros-13b-gpt4-1.4-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 59 • 31

TheBloke/CAMEL-13B-Role-Playing-Data-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 13 • 6

TheBloke/Chronos-Hermes-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 58 • 38

TheBloke/CAMEL-13B-Combined-Data-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 12 • 1

TheBloke/GPT4All-13B-Snoozy-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 7 • 6

TheBloke/Samantha-33B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 49 • 12