Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,821

Full-text search

Active filters: 4-bit

TheBloke/japanese-stablelm-instruct-gamma-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1 • 1

TheBloke/stockmark-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 2

TheBloke/stockmark-13B-GPTQ

Text Generation • 13B • Updated Oct 28, 2023 • 6 • 3

TheBloke/Mistral-7B-Claude-Chat-GPTQ

Text Generation • 7B • Updated Oct 29, 2023 • 16 • 11

TheBloke/Mistral-7B-Claude-Chat-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 8 • 4

TheBloke/Mistral-ClaudeLimaRP-v3-7B-GPTQ

Text Generation • 7B • Updated Oct 29, 2023 • 3 • 4

TheBloke/Mistral-ClaudeLimaRP-v3-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 4

aystur/FSA-llama-2-7b-finetuned

Text Generation • Updated Oct 29, 2023 • 1

TheBloke/Augmental-13B-v1.50_A-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 3 • 1

TheBloke/Augmental-13B-v1.50_A-GPTQ

Text Generation • 13B • Updated Oct 29, 2023 • 1 • 2

TheBloke/Augmental-13B-v1.50_B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 1

aystur/FSA-mistral-7b-finetuned

Text Generation • Updated Oct 29, 2023 • 1

TheBloke/Athnete-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 1

TheBloke/Augmental-13B-v1.50_B-GPTQ

Text Generation • 13B • Updated Oct 29, 2023 • 1 • 1

TheBloke/Nous-Capybara-7B-v1.9-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 2 • 1

TheBloke/Athnete-13B-GPTQ

Text Generation • 13B • Updated Oct 29, 2023 • 3 • 4

TheBloke/Nous-Capybara-7B-v1.9-GPTQ

Text Generation • 7B • Updated Oct 29, 2023 • 8 • 3

TheBloke/Nous-Capybara-3B-v1.9-GPTQ

Text Generation • 3B • Updated Oct 29, 2023 • 10 • 8

TheBloke/AquilaChat2-34B-GPTQ

Text Generation • 34B • Updated Oct 30, 2023 • 2 • 2

TheBloke/AquilaChat2-34B-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 3 • 1

TheBloke/AquilaChat2-34B-16K-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 4 • 3

TheBloke/AquilaChat2-34B-16K-GPTQ

Text Generation • 34B • Updated Oct 29, 2023 • 11 • 5

jubayerarnob/falconllm7b

Updated Oct 29, 2023

TheBloke/Airoboros-180B-2.2.1-AWQ

Text Generation • 180B • Updated Nov 9, 2023 • 3 • 6

TheBloke/Free_Sydney_V2_13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 1

TheBloke/SciPhi-Mistral-7B-32k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 4

TheBloke/Free_Sydney_V2_13B-GPTQ

Text Generation • 13B • Updated Oct 30, 2023 • 2 • 2

TheBloke/SciPhi-Mistral-7B-32k-GPTQ

Text Generation • 7B • Updated Oct 30, 2023 • 5 • 4

Shivam098/unstructured2structuredformat

Text Generation • Updated Oct 30, 2023 • 3

TheBloke/Akins-3B-GPTQ

Text Generation • 3B • Updated Oct 30, 2023 • 1 • 2