Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,757

Full-text search

Active filters: 4-bit

TheBloke/scarlett-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 4 • 7

TheBloke/Carl-Llama-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 6 • 4

TheBloke/Carl-33B-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 6 • 3

TheBloke/Carl-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 5 • 6

TheBloke/orca_mini_v3_70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 19 • 13

RuterNorway/Llama-2-13b-chat-norwegian-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 11 • 10

TheBloke/Llama2-13B-MegaCode2-OASST-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 3

TheBloke/Octocoder-GPTQ

Text Generation • 16B • Updated Sep 27, 2023 • 14 • 8

TheBloke/Zarablend-L2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 8 • 10

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 8 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 9 • 3

Qwen/Qwen-7B-Chat-Int4

Text Generation • 8B • Updated Jan 4, 2024 • 1.58k • 75

TheBloke/LlongOrca-13B-16K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 6 • 5

TheBloke/Samantha-1.1-70B-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 1 • 2

TheBloke/Llama-2-7B-32K-Instruct-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 14 • 27

flozi00/Llama-2-13b-german-assistant-v6-4bit-autogptq

Text Generation • 13B • Updated Aug 23, 2023 • 4 • 4

TheBloke/L2-MythoMax22b-Instruct-Falseblock-GPTQ

Text Generation • 22B • Updated Sep 27, 2023 • 28 • 10

anandsinghbaghel/opt-125m-gptq-4bit

Text Generation • Updated Aug 21, 2023 • 4

TheBloke/Llama2-22B-GPLATTY-GPTQ

Text Generation • 22B • Updated Sep 27, 2023 • 4 • 4

TheBloke/EverythingLM-13b-V2-16K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 14 • 7

TheBloke/Llama2-28B-Air03-GPTQ

Text Generation • 28B • Updated Sep 27, 2023 • 25 • 3

TheBloke/Chronorctypus-Limarobormes-13b-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 6

TheBloke/Griffin-3B-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 9 • 2

TheBloke/Marx-3b-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 8 • 3

Andrei-Alex/Fine-Tune-Adapters

Text Generation • Updated Aug 26, 2023 • 1

TheBloke/Puma-3b-GPTQ

Text Generation • 3B • Updated Sep 27, 2023 • 8 • 1

TheBloke/Synthia-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 74 • 3

TheBloke/Synthia-7B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 5 • 3

TheBloke/Zarablend-MX-L2-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 6 • 2

TheBloke/Trurl-2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 4 • 4