Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,981

Base only

Active filters: 4-bit

TheBloke/EverythingLM-13b-V2-16K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 14 • 7

TheBloke/Llama2-28B-Air03-GPTQ

Text Generation • 28B • Updated Sep 27, 2023 • 7 • 3

TheBloke/Chronorctypus-Limarobormes-13b-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 23 • 6

TheBloke/Griffin-3B-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 14 • 2

TheBloke/Marx-3b-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 12 • 3

Andrei-Alex/Fine-Tune-Adapters

Text Generation • Updated Aug 26, 2023 • 9

TheBloke/Puma-3b-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 10 • 1

TheBloke/Synthia-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 15 • 3

TheBloke/Synthia-7B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 13 • 3

TheBloke/Zarablend-MX-L2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 8 • 2

TheBloke/Trurl-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 16 • 4

TheBloke/Trurl-2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 21 • 2

aiknight87/falcon-40b-instruct-test-system

Updated Aug 24, 2023 • 3

blackwhites/opt-125m-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 7

smjain/opt-125m-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 6

Devden/Llama2

Text Generation • 13B • Updated Aug 24, 2023 • 13

KoboldAI/LLaMA2-13B-Holomax-GPTQ

Text Generation • 13B • Updated Aug 23, 2023 • 8 • 2

smjain/WizardLM-7B-V1.0-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 7

TheBloke/PuddleJumper-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 9 • 2

Zestor/Llama-2-7b-chat-hf-apex-02082023-1255-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 6

HeshamHaroon/falcon-rw-1b-4bit

Text Generation • 1B • Updated Sep 9, 2023 • 8 • 1

muneerhanif7/Llama-2-13B-GPTQ

Text Generation • Updated Aug 24, 2023 • 7

TheBloke/Nous-Hermes-Llama2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 15 • 7

madhan2301/opt-125m-gptq-4bit

Text Generation • Updated Aug 24, 2023 • 7

TheBloke/Nous-Puffin-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 9 • 3

TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 299 • 46

TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 75 • 24

TheBloke/CodeLlama-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 108 • 14

TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 95 • 39

silvacarl/Llama-2-7b-chat-hf-gptq-4bit

Text Generation • Updated Aug 25, 2023 • 9