Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

49,000

Base only

Active filters: 4-bit

TheBloke/Guanaco-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1

TheBloke/Koala-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1

TheBloke/Robin-7B-v2-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 16 • 1

TheBloke/Baize-v2-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 1

TheBloke/Koala-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 6 • 2

TheBloke/Samantha-1-1-Llama-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 5

TheBloke/Selfee-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 11 • 2

TheBloke/Selfee-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 6 • 2

TheBloke/Tulu-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1

TheBloke/Vicuna-7B-v1-3-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 11 • 3

TheBloke/Vicuna-7B-CoT-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 9 • 6

TheBloke/Wizard-Vicuna-7B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 103 • 16

TheBloke/WizardLM-7B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 78 • 16

TheBloke/PMC_LLAMA-7B-10-Epoch-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 13 • 5

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 71 • 15

TheBloke/WizardLM-13B-V1.1-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 91 • 27

TheBloke/WizardLM-13B-V1-1-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 101 • 45

TheBloke/orca_mini_v2_13b-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 56 • 18

TheBloke/GodziLLa-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 16 • 5

TheBloke/openchat_v2-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 8 • 4

TheBloke/openchat_v2_w-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 6

TheBloke/WizardCoder-Guanaco-15B-V1.0-GPTQ

Text Generation • 16B • Updated Sep 3, 2023 • 74 • 16

TheBloke/Chronoboros-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 81 • 30

TheBloke/airochronos-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 28 • 7

TheBloke/open-llama-7B-v2-open-instruct-GPTQ

Text Generation • 7B • Updated Sep 10, 2023 • 11 • 2

aiknight87/falcon-40b-instruct-tuned-finance-qas

Updated Jul 12, 2023 • 3

TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 13 • 9

TheBloke/OpenOrca-Preview1-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 10 • 8

blakeho/flan-t5-critical-constructive-translator

Updated Jul 13, 2023 • 5

Leon68/falcon7b-openassistant

Text Generation • Updated Jul 13, 2023 • 12