Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,889

Full-text search

Active filters: 4-bit

TheBloke/airoboros-m-7B-3.0-GPTQ

Text Generation • 7B • Updated Oct 6, 2023 • 2

TheBloke/airoboros-m-7B-3.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1

TheBloke/llama-2-7B-Arguments-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 2 • 1

TheBloke/llama-2-7B-Arguments-GPTQ

Text Generation • 7B • Updated Oct 6, 2023 • 3 • 2

chats-bug/multiple-subject-gen-finetuned

Text Generation • Updated Oct 6, 2023

fenil-vc/opt-125m-gptq-4bit

Text Generation • Updated Oct 6, 2023 • 1

tr416/4bit-gpt2-test

Text Generation • Updated Oct 6, 2023 • 1

TheBloke/UndiMix-v4-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 2 • 2

TheBloke/UndiMix-v4-13B-GPTQ

Text Generation • 13B • Updated Oct 6, 2023 • 2 • 6

khursani8/baby_angin_4bit

Text Generation • Updated Oct 7, 2023

phanerozoic/PirateTalk-13b-v1-GPTQ-4bit

Text Generation • 13B • Updated Oct 7, 2023 • 17

TheBloke/Mistral-Trismegistus-7B-GPTQ

Text Generation • 7B • Updated Oct 7, 2023 • 3 • 5

TheBloke/Mistral-Trismegistus-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 2

Wendy1130/opt125m-gptq-4bit

Text Generation • Updated Oct 8, 2023

le-vh/tinyllama-4bit

Text Generation • Updated Oct 8, 2023

le-vh/tinyllama-4bit-cpu

Text Generation • Updated Oct 8, 2023 • 1 • 3

TheBloke/sheep-duck-llama-2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 16 • 2

TheBloke/sheep-duck-llama-2-13B-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 4 • 2

TheBloke/Llama2-chat-AYB-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 2

TheBloke/Llama2-chat-AYB-13B-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 2 • 2

TheBloke/Athena-v4-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 10 • 8

TheBloke/Athena-v4-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 3

sbolouki/bloom-1b7-gptq

Text Generation • Updated Oct 8, 2023 • 3

TheBloke/PsyMedRP-v1-20B-AWQ

Text Generation • 20B • Updated Nov 9, 2023 • 1 • 5

TheBloke/PsyMedRP-v1-20B-GPTQ

Text Generation • 20B • Updated Oct 9, 2023 • 2 • 5

CJ-gyuwonpark/ch-70b-v7

Updated Oct 11, 2023

aiknight87/llama-2-7b-hf-tuned-100

Updated Oct 9, 2023 • 3

TheBloke/Ziya-Coding-34B-v1.0-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 3

TheBloke/Ziya-Coding-34B-v1.0-GPTQ

Text Generation • 34B • Updated Oct 9, 2023 • 27

nalinaksh/opt-125m-gptq

Text Generation • Updated Oct 9, 2023 • 1