Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,760

Full-text search

Active filters: 4-bit

TheBloke/SynthIA-7B-v1.3-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 1

Silence-mj/OPT-6.7B-AWQ-4-128

Text Generation • Updated Nov 23, 2023 • 3

sharkMeow/results-2

Text Generation • Updated Nov 24, 2023

TheBloke/Noromaid-20B-v0.1.1-AWQ

Text Generation • 20B • Updated Nov 23, 2023 • 33 • 4

TheBloke/Noromaid-20B-v0.1.1-GPTQ

Text Generation • 20B • Updated Nov 23, 2023 • 9 • 8

Mousaicv/selfrag-lora

Text Generation • Updated Nov 23, 2023 • 5 • 1

abc7431/customModel

Text Generation • Updated Nov 23, 2023

TheBloke/digital-socrates-13B-AWQ

Text Generation • 13B • Updated Nov 23, 2023 • 6

TheBloke/digital-socrates-13B-GPTQ

Text Generation • 13B • Updated Nov 23, 2023 • 3

TheBloke/digital-socrates-7B-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/digital-socrates-7B-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/llama-polyglot-13B-GPTQ

Text Generation • 13B • Updated Nov 23, 2023 • 3 • 1

TheBloke/llama-polyglot-13B-AWQ

Text Generation • 13B • Updated Nov 23, 2023 • 1

TheBloke/koOpenChat-sft-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/koOpenChat-sft-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Synatra-7B-v0.3-dpo-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Synatra-7B-v0.3-dpo-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 3

TheBloke/Synatra-RP-Orca-2-7B-v0.1-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Synatra-RP-Orca-2-7B-v0.1-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 2

TheBloke/Yi-34B-Chat-AWQ

Text Generation • 34B • Updated Nov 23, 2023 • 32 • 13

TheBloke/Synatra-V0.1-7B-Instruct-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Synatra-V0.1-7B-Instruct-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Yi-34B-Chat-GPTQ

Text Generation • 34B • Updated Nov 23, 2023 • 20 • 16

Sk4467/axolotl

Text Generation • Updated Nov 25, 2023 • 4

TheBloke/Synatra-7B-v0.3-base-GPTQ

Text Generation • 7B • Updated Nov 23, 2023

TheBloke/Synatra-7B-v0.3-base-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/cockatrice-7B-v0.1-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1

TheBloke/Tess-M-v1.2-AWQ

Text Generation • 34B • Updated Nov 24, 2023 • 1

TheBloke/Tess-M-v1.2-GPTQ

Text Generation • 34B • Updated Nov 24, 2023 • 2

TheBloke/tulu-2-13B-GPTQ

Text Generation • 13B • Updated Nov 24, 2023