Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,393

Base only

Active filters: 4-bit

khursani8/baby_angin_4bit

Text Generation • Updated Oct 7, 2023 • 6

phanerozoic/PirateTalk-13b-v1-GPTQ-4bit

Text Generation • 13B • Updated Oct 7, 2023 • 5

TheBloke/Mistral-Trismegistus-7B-GPTQ

Text Generation • 7B • Updated Oct 7, 2023 • 11 • 5

TheBloke/Mistral-Trismegistus-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 10.6k • 2

Wendy1130/opt125m-gptq-4bit

Text Generation • Updated Oct 8, 2023

le-vh/tinyllama-4bit

Text Generation • Updated Oct 8, 2023 • 8

le-vh/tinyllama-4bit-cpu

Text Generation • Updated Oct 8, 2023 • 9 • 3

TheBloke/sheep-duck-llama-2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 2

TheBloke/sheep-duck-llama-2-13B-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 8 • 2

TheBloke/Llama2-chat-AYB-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 2

TheBloke/Llama2-chat-AYB-13B-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 9 • 2

TheBloke/Athena-v4-GPTQ

Text Generation • 13B • Updated Oct 8, 2023 • 304 • 8

TheBloke/Athena-v4-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 3

sbolouki/bloom-1b7-gptq

Text Generation • Updated Oct 8, 2023 • 11

TheBloke/PsyMedRP-v1-20B-AWQ

Text Generation • 20B • Updated Nov 9, 2023 • 6 • 5

TheBloke/PsyMedRP-v1-20B-GPTQ

Text Generation • 20B • Updated Oct 9, 2023 • 6 • 5

CJ-gyuwonpark/ch-70b-v7

Updated Oct 11, 2023 • 1

aiknight87/llama-2-7b-hf-tuned-100

Updated Oct 9, 2023 • 7

TheBloke/Ziya-Coding-34B-v1.0-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 5

TheBloke/Ziya-Coding-34B-v1.0-GPTQ

Text Generation • 34B • Updated Oct 9, 2023 • 7

nalinaksh/opt-125m-gptq

Text Generation • Updated Oct 9, 2023 • 5

Joetib/results

Text Generation • Updated Oct 9, 2023 • 8

prattay/TinyLlama-chat-cpg-abinbev-finetune

Text Generation • Updated Oct 9, 2023 • 8

TheBloke/em_german_leo_mistral-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 9 • 6

TheBloke/em_german_leo_mistral-GPTQ

Text Generation • 7B • Updated Oct 10, 2023 • 101 • 10

TheBloke/sqlcoder2-GPTQ

Text Generation • 16B • Updated Oct 10, 2023 • 58 • 11

aiknight87/llama-2-7b-hf-tuned-200

Updated Oct 10, 2023 • 7

TheBloke/Tinyllama-2-1b-miniguanaco-GPTQ

Text Generation • 1B • Updated Oct 14, 2023 • 8 • 1

TheBloke/Tinyllama-2-1b-miniguanaco-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 7 • 3

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 414 • 18