Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,762

Full-text search

Active filters: 4-bit

TheBloke/Zarablend-MX-L2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 6 • 2

TheBloke/Trurl-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 4

TheBloke/Trurl-2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 3 • 2

aiknight87/falcon-40b-instruct-test-system

Updated Aug 24, 2023

blackwhites/opt-125m-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 4

smjain/opt-125m-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 5

Devden/Llama2

Text Generation • 13B • Updated Aug 24, 2023 • 3

KoboldAI/LLaMA2-13B-Holomax-GPTQ

Text Generation • 13B • Updated Aug 23, 2023 • 2 • 2

smjain/WizardLM-7B-V1.0-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 5

TheBloke/PuddleJumper-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 6 • 2

Zestor/Llama-2-7b-chat-hf-apex-02082023-1255-gptq-4bit

Text Generation • Updated Aug 23, 2023 • 4

HeshamHaroon/falcon-rw-1b-4bit

Text Generation • 1B • Updated Sep 9, 2023 • 8 • 1

muneerhanif7/Llama-2-13B-GPTQ

Text Generation • Updated Aug 24, 2023 • 3

TheBloke/Nous-Hermes-Llama2-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 8 • 7

madhan2301/opt-125m-gptq-4bit

Text Generation • Updated Aug 24, 2023 • 4

TheBloke/Nous-Puffin-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 5 • 3

TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 139 • 46

TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 29 • 24

TheBloke/CodeLlama-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 12 • 14

TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 82 • 39

silvacarl/Llama-2-7b-chat-hf-gptq-4bit

Text Generation • Updated Aug 25, 2023 • 3

TheBloke/CodeLlama-13B-Python-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 17 • 20

TheBloke/CodeLlama-34B-Instruct-GPTQ

Text Generation • 34B • Updated Sep 27, 2023 • 78 • 74

Mikeer/opt-125m-gptq-4bit

Text Generation • Updated Aug 25, 2023 • 4

TheBloke/CodeLlama-34B-Python-GPTQ

Text Generation • 34B • Updated Sep 27, 2023 • 11 • 14

TheBloke/CodeLlama-34B-GPTQ

Text Generation • 34B • Updated Sep 27, 2023 • 20 • 20

Titli/opt-125m-gptq-4bit

Text Generation • Updated Aug 25, 2023 • 4

TheBloke/Samantha-1.11-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 9 • 3

TheBloke/Samantha-1.11-CodeLlama-34B-GPTQ

Text Generation • 34B • Updated Sep 27, 2023 • 11 • 21

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 9 • 9