Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,703

Full-text search

Active filters: 4-bit

TheBloke/WizardLM-70B-V1.0-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 2.79k • 37

TheBloke/huginnv1.2-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 7 • 5

TheBloke/AlpacaCielo2-7B-8K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 5 • 6

TheBloke/orca_mini_v3_7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 24 • 11

TheBloke/Stable-Platypus2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 16 • 8

TheBloke/orca_mini_v3_13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 10 • 10

TheBloke/Platypus2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 2

TheBloke/Camel-Platypus2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 8 • 3

TheBloke/Platypus2-70B-Instruct-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 12 • 25

TheBloke/Platypus2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 10 • 5

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 359 • 219

TheBloke/Camel-Platypus2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 9 • 2

TheBloke/WizardMath-7B-V1.0-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 5 • 2

TheBloke/WizardMath-13B-V1.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 5

TheBloke/WizardMath-70B-V1.0-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 9 • 5

TheBloke/Llama-2-13B-German-Assistant-v4-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 34 • 16

TheBloke/OpenOrca-Platypus2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 31 • 48

TheBloke/EverythingLM-13B-16K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 97 • 14

TheBloke/LlongOrca-7B-16K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 9 • 10

TheBloke/Huginn-v3-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 5 • 2

TheBloke/LosslessMegaCoder-Llama2-7B-Mini-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 5 • 8

TheBloke/CodeUp-Alpha-13B-HF-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 31 • 4

TheBloke/llama2-22B-daydreamer-v2-GPTQ

Text Generation • 22B • Updated Sep 27, 2023 • 2 • 8

TheBloke/PULI-GPT-3SX-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 7 • 4

TheBloke/LosslessMegaCoder-Llama2-13B-Mini-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 5 • 4

TheBloke/GodziLLa2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 70 • 4

TheBloke/Llama2-22B-Daydreamer-v3-GPTQ

Text Generation • 22B • Updated Sep 27, 2023 • 4 • 6

TheBloke/Scarlett-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 4 • 1

TheBloke/Scarlett-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 5

TheBloke/scarlett-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 4 • 7