Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

49,000

Base only

Active filters: 4-bit

TheBloke/wizard-vicuna-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 8 • 7

TheBloke/airoboros-33B-gpt4-1-4-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 73 • 26

vlkn/falcon_finetuned

Text Generation • Updated Jun 28, 2023 • 5

TheBloke/Manticore-13B-Chat-Pyg-Guanaco-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 108 • 19

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 64 • 48

TheBloke/GPlatty-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 53 • 5

TheBloke/Platypus-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 17 • 5

TheBloke/llama-30b-supercot-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 7 • 5

TheBloke/Platypus-30B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 9 • 4

TheBloke/GPlatty-30B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 11 • 7

TheBloke/airoboros-65B-gpt4-1.4-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 60 • 13

TheBloke/UltraLM-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 71 • 13

TheBloke/h2ogpt-research-oasst1-llama-65B-GPTQ

Text Generation • 65B • Updated Aug 21, 2023 • 9 • 5

TheBloke/LongChat-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 121 • 25

TheBloke/LongChat-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 68 • 10

TheBloke/Chinese-Alpaca-33B-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 53 • 11

TheBloke/vicuna-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 66 • 15

DioulaD/falcon-7b-instruct-qlora-ge-dq-v2

Text Generation • Updated Dec 20, 2023 • 20

TheBloke/Vicuna-33B-1-3-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 60 • 27

poojakp/output

Text Generation • Updated Jun 30, 2023 • 6

aiknight87/falcon-7b-instruct-tuned-finance-qas

Updated Jul 1, 2023 • 3

TheBloke/Redmond-Hermes-Coder-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 62 • 10

kbatyshchev/results

Text Generation • Updated Jul 4, 2023 • 5

TheBloke/SuperPlatty-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 19 • 4

TheBloke/orca_mini_v2_7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 67 • 22

vasimakram01/falcon_7b_q_100tokens

Text Generation • Updated Jul 12, 2023 • 5

TheBloke/CAMEL-33B-Combined-Data-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 9 • 4

TheBloke/Airoboros-7B-GPT4-1-4-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 6

TheBloke/Baize-v2-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 14 • 1

TheBloke/Guanaco-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 1