Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,841

Full-text search

Active filters: 4-bit

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • 13B • Updated Oct 22, 2023 • 9 • 34

GAIR/autoj-13b-GPTQ-4bits

Text Generation • 13B • Updated Oct 22, 2023 • 2 • 4

TheBloke/CausalLM-14B-AWQ

Text Generation • 14B • Updated Nov 9, 2023 • 12 • 10

TheBloke/CausalLM-14B-GPTQ

Text Generation • 14B • Updated Oct 22, 2023 • 12 • 20

TheBloke/CausalLM-7B-AWQ

Text Generation • 8B • Updated Nov 9, 2023 • 4 • 3

TheBloke/CausalLM-7B-GPTQ

Text Generation • 8B • Updated Oct 22, 2023 • 8 • 5

TheBloke/Thespis-13B-v0.4-GPTQ

Text Generation • 13B • Updated Oct 22, 2023 • 2 • 2

TheBloke/Thespis-13B-v0.4-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 2

TheBloke/Mistral-7B-SciPhi-32k-GPTQ

Text Generation • 7B • Updated Oct 22, 2023 • 3 • 4

TheBloke/Mistral-7B-SciPhi-32k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 12 • 4

TheBloke/SynthIA-7B-v2.0-GPTQ

Text Generation • 7B • Updated Oct 22, 2023 • 5 • 1

TheBloke/SynthIA-7B-v2.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 3

CJ-gyuwonpark/ch-mi-7

Updated Oct 24, 2023

q-allen/Taiwan-LLaMa-v1.0-4bits-GPTQ

Text Generation • Updated Oct 25, 2023 • 7 • 1

jackkira/fb-opt-125m-gptq-4bit

Text Generation • Updated Oct 23, 2023

deuswoof/adapter_ingredients_ivan

Updated Oct 27, 2023 • 13

MaxZabarka/classifier-7b-v9

Text Generation • Updated Oct 23, 2023 • 1

codegood/Mistral_new_data

Updated Oct 23, 2023 • 3

codegood/Mistral_model_old_data

Updated Oct 23, 2023 • 3

heka-ai/mistral-test-GPTQ

Text Generation • Updated Oct 24, 2023 • 4

ybelkada/test-mistral-7b-v0.1-awq

Text Generation • 7B • Updated Oct 30, 2023 • 14

TheBloke/HornyEchidna-13B-v0.1-GPTQ

Text Generation • 13B • Updated Oct 24, 2023 • 8 • 12

TheBloke/HornyEchidna-13B-v0.1-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 3

TheBloke/Vigostral-7B-Chat-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 1

TheBloke/Vigostral-7B-Chat-GPTQ

Text Generation • 7B • Updated Oct 24, 2023 • 10 • 3

TheBloke/Augmental-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 1

TheBloke/Augmental-13B-GPTQ

Text Generation • 13B • Updated Oct 24, 2023 • 1 • 6

PhantHive/llama-momo-2.5

Updated Oct 24, 2023

TRAC-MTRY/traclm-v2-7b-instruct-GPTQ

Text Generation • 7B • Updated Dec 22, 2023

TheBloke/Dolphin-2.1-70B-GPTQ

Text Generation • 69B • Updated Oct 25, 2023 • 6 • 7