Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,633

Full-text search

Active filters: 4-bit

poojakp/output

Text Generation • Updated Jun 30, 2023 • 2

aiknight87/falcon-7b-instruct-tuned-finance-qas

Updated Jul 1, 2023

TheBloke/Redmond-Hermes-Coder-GPTQ

Text Generation • 16B • Updated Aug 21, 2023 • 5 • 10

kbatyshchev/results

Text Generation • Updated Jul 4, 2023 • 1

TheBloke/SuperPlatty-30B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 3 • 4

TheBloke/orca_mini_v2_7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 7 • 22

vasimakram01/falcon_7b_q_100tokens

Text Generation • Updated Jul 12, 2023 • 11

TheBloke/CAMEL-33B-Combined-Data-SuperHOT-8K-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 4 • 4

TheBloke/Airoboros-7B-GPT4-1-4-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 4 • 6

TheBloke/Baize-v2-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 1

TheBloke/Guanaco-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 4 • 1

TheBloke/Koala-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 3 • 1

TheBloke/Robin-7B-v2-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 2 • 1

TheBloke/Baize-v2-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 3 • 1

TheBloke/Koala-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 1 • 2

TheBloke/Samantha-1-1-Llama-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 2 • 5

TheBloke/Selfee-13B-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 3 • 2

TheBloke/Selfee-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 2 • 2

TheBloke/Tulu-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 1 • 1

TheBloke/Vicuna-7B-v1-3-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 3 • 3

TheBloke/Vicuna-7B-CoT-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 3 • 6

TheBloke/Wizard-Vicuna-7B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 24 • 16

TheBloke/WizardLM-7B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 8 • 16

TheBloke/PMC_LLAMA-7B-10-Epoch-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 4 • 5

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 29 • 15

TheBloke/WizardLM-13B-V1.1-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 20 • 27

TheBloke/WizardLM-13B-V1-1-SuperHOT-8K-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 845 • 46

TheBloke/orca_mini_v2_13b-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 9 • 18

TheBloke/GodziLLa-30B-GPTQ

Text Generation • 33B • Updated Aug 21, 2023 • 3 • 5

TheBloke/openchat_v2-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 1 • 4