Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,869

Full-text search

Active filters: 4-bit

Nagharjun17/zoningLlama2-GPTQ

Text Generation • 13B • Updated Oct 3, 2023 • 1

TheBloke/Mistral-7B-OpenOrca-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 282 • 41

TheBloke/Mistral-7B-OpenOrca-GPTQ

Text Generation • 7B • Updated Oct 16, 2023 • 1.27k • 99

TheBloke/Inkbot-13B-8k-0.2-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 2

TheBloke/Inkbot-13B-8k-0.2-GPTQ

Text Generation • 13B • Updated Oct 17, 2023 • 5 • 5

TheBloke/Nous-Capybara-7B-GPTQ

Text Generation • 7B • Updated Oct 2, 2023 • 4 • 4

TheBloke/Nous-Capybara-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 2

TheBloke/dolphin-2.0-mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 11 • 7

TheBloke/dolphin-2.0-mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 3, 2023 • 11 • 8

atorsvn/TinyLlama-1.1B-Chat-v0.3-gptq-4bit

Text Generation • Updated Oct 3, 2023 • 11 • 1

CJ-gyuwonpark/ch-70b-v4

Updated Oct 4, 2023

BobaZooba/Shurale7B-v1-GPTQ

Text Generation • 7B • Updated Nov 14, 2023 • 8 • 3

KimJY/wwpp-13B-gptq-4bit

Text Generation • Updated Oct 3, 2023 • 4

TheBloke/TinyLlama-1.1B-Chat-v0.3-GPTQ

Text Generation • 1B • Updated Oct 3, 2023 • 372k • 9

TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 66.9k • 4

TheBloke/TinyLlama-1.1B-python-v0.1-GPTQ

Text Generation • 1B • Updated Oct 3, 2023 • 498 • 2

TheBloke/TinyLlama-1.1B-python-v0.1-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 3 • 2

yschoi/opt-125m-gptq-4bit

Text Generation • Updated Oct 3, 2023 • 1

TheBloke/em_german_mistral_v01-GPTQ

Text Generation • 7B • Updated Oct 3, 2023 • 13 • 5

TheBloke/em_german_mistral_v01-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 13 • 5

TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-GPTQ

Text Generation • 1B • Updated Oct 3, 2023 • 7 • 2

TheBloke/TinyLlama-1.1B-intermediate-step-480k-1T-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 1 • 2

vsarathy/parser-info_structure-30k-no-context-llama2-7b

Text Generation • Updated Oct 3, 2023

vsarathy/parser-info_structure-30k-context-llama2-7b

Text Generation • Updated Oct 5, 2023 • 3 • 1

vsarathy/parser-info_structure-30k-no-context-falcon-7b

Updated Oct 5, 2023

vsarathy/parser-info_structure-30k-context-falcon-7b

Text Generation • Updated Oct 6, 2023

TheBloke/airoboros-mistral2.2-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 14 • 2

TheBloke/airoboros-mistral2.2-7B-GPTQ

Text Generation • 7B • Updated Oct 4, 2023 • 26 • 4

CJ-gyuwonpark/ch-70b-v5

Updated Oct 6, 2023

TheBloke/CodeFuse-13B-GPTQ

Text Generation • 14B • Updated Oct 4, 2023 • 11 • 4