Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,753

Full-text search

Active filters: 4-bit

TheBloke/Euryale-1.4-L2-70B-AWQ

Text Generation • 69B • Updated Nov 18, 2023 • 11 • 2

Trelis/Yi-6B-200K-Llamafied-chat-SFT-AWQ

Text Generation • 6B • Updated Nov 20, 2023

patched-codes/patched-coder-34b-AWQ

Text Generation • 34B • Updated Nov 18, 2023 • 2

LoneStriker/Yi-34B-Spicyboros-3.1-3-LoRA

Text Generation • Updated Nov 19, 2023 • 1

TheBloke/opus-v0.5-70B-GPTQ

Text Generation • 69B • Updated Nov 18, 2023 • 1 • 1

TheBloke/opus-v0.5-70B-AWQ

Text Generation • 69B • Updated Nov 18, 2023 • 1 • 1

Trelis/Yi-34B-200K-Llamafied-chat-SFT-AWQ

Text Generation • Updated Nov 26, 2023

TheBloke/Nanbeige-16B-Chat-32K-GPTQ

Text Generation • 16B • Updated Nov 18, 2023 • 3

TheBloke/nsql-llama-2-7B-AWQ

Text Generation • 7B • Updated Nov 18, 2023

TheBloke/nsql-llama-2-7B-GPTQ

Text Generation • 7B • Updated Nov 18, 2023 • 4

TheBloke/nucleus-22B-token-500B-GPTQ

Text Generation • 22B • Updated Nov 18, 2023 • 5 • 2

TheBloke/nucleus-22B-token-500B-AWQ

Text Generation • 22B • Updated Nov 18, 2023 • 1 • 1

TheBloke/tigerbot-70B-chat-v4-GPTQ

Text Generation • 70B • Updated Nov 19, 2023 • 1

TheBloke/tigerbot-70B-chat-v4-AWQ

Text Generation • 70B • Updated Nov 19, 2023 • 1

TheBloke/Kaori-70B-v1-GPTQ

Text Generation • 69B • Updated Nov 19, 2023 • 2

TheBloke/Kaori-70B-v1-AWQ

Text Generation • 69B • Updated Nov 19, 2023 • 1 • 2

TheBloke/Nanbeige-16B-Base-32K-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 9 • 1

TheBloke/Nanbeige-16B-Base-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 3 • 2

TheBloke/Nanbeige-16B-Chat-GPTQ

Text Generation • 16B • Updated Nov 19, 2023 • 1 • 1

TheBloke/Capybara-Tess-Yi-34B-200K-AWQ

Text Generation • 34B • Updated Nov 19, 2023 • 1 • 3

TheBloke/Capybara-Tess-Yi-34B-200K-GPTQ

Text Generation • 34B • Updated Nov 19, 2023 • 2 • 7

TheBloke/X-NoroChronos-13B-AWQ

Text Generation • 13B • Updated Nov 19, 2023 • 1

rajivmehtapy/opt-125m-awq

Text Generation • 0.2B • Updated Dec 16, 2023 • 1

TheBloke/XwinCoder-13B-AWQ

Text Generation • 13B • Updated Nov 19, 2023 • 1

TheBloke/X-NoroChronos-13B-GPTQ

Text Generation • 13B • Updated Nov 19, 2023 • 2 • 4

TheBloke/XwinCoder-34B-AWQ

Text Generation • 34B • Updated Nov 19, 2023 • 1 • 1

Trelis/Yi-34B-200K-Llamafied-chat-SFT-function-calling-v2-AWQ

Text Generation • 34B • Updated Dec 12, 2023 • 1

TheBloke/XwinCoder-13B-GPTQ

Text Generation • 13B • Updated Nov 19, 2023 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-ai-only-low-rank

Text Generation • Updated Nov 20, 2023

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-low-rank

Text Generation • Updated Nov 20, 2023