Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,782

Full-text search

Active filters: 4-bit

TheBloke/Deacon-34B-GPTQ

Text Generation • 34B • Updated Nov 16, 2023 • 1 • 2

TheBloke/Tess-M-Creative-v1.0-AWQ

Text Generation • 34B • Updated Nov 19, 2023 • 1 • 1

hongyin/chat-llama2-70b-4bit

Text Generation • Updated Nov 18, 2023 • 5

TheBloke/Tess-M-Creative-v1.0-GPTQ

Text Generation • 34B • Updated Nov 19, 2023 • 7 • 5

MohamedRashad/AceGPT-7B-chat-AWQ

Text Generation • 7B • Updated Nov 18, 2023 • 3 • 5

TheBloke/merlyn-education-corpus-qa-v2-GPTQ

Text Generation • 13B • Updated Nov 16, 2023 • 10 • 3

TheBloke/merlyn-education-corpus-qa-v2-AWQ

Text Generation • 13B • Updated Nov 16, 2023 • 9 • 1

TheBloke/merlyn-education-safety-AWQ

Text Generation • 12B • Updated Nov 16, 2023 • 5

TheBloke/merlyn-education-safety-GPTQ

Text Generation • 12B • Updated Nov 16, 2023 • 9 • 3

stephen-steckler/gptq_small

Text Generation • Updated Nov 16, 2023 • 1

TheBloke/TimeCrystal-L2-13B-GPTQ

Text Generation • 13B • Updated Nov 16, 2023 • 1 • 6

TheBloke/TimeCrystal-L2-13B-AWQ

Text Generation • 13B • Updated Nov 16, 2023 • 2 • 3

TheBloke/OpenHermes-2.5-Mistral-7B-16k-GPTQ

Text Generation • 7B • Updated Nov 16, 2023 • 7 • 2

TheBloke/OpenHermes-2.5-Mistral-7B-16k-AWQ

Text Generation • 7B • Updated Nov 16, 2023 • 6 • 4

TheBloke/platypus-yi-34b-GPTQ

Text Generation • 34B • Updated Nov 17, 2023 • 5 • 2

TheBloke/platypus-yi-34b-AWQ

Text Generation • 34B • Updated Nov 17, 2023

heka-ai/zephyr-beta-ft-200-GPTQ

Text Generation • 7B • Updated Nov 16, 2023 • 3

LoneStriker/Yi-34B-Spicyboros-3.1-2-LoRA

Text Generation • Updated Nov 18, 2023 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-ai-only

Text Generation • Updated Nov 19, 2023 • 2

heka-ai/zephyr-beta-ft-400-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 1

heka-ai/zephyr-beta-ft-600-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 3

heka-ai/zephyr-beta-ft-800-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 3

TheBloke/sqlcoder-34b-alpha-GPTQ

Text Generation • 34B • Updated Nov 17, 2023 • 28 • 10

TheBloke/sqlcoder-34b-alpha-AWQ

Text Generation • 34B • Updated Nov 17, 2023 • 27 • 5

heka-ai/zephyr-beta-ft-1000-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 3

TheBloke/dragon-yi-6B-v0-GPTQ

Text Generation • 6B • Updated Nov 17, 2023 • 1

TheBloke/dragon-yi-6B-v0-AWQ

Text Generation • 6B • Updated Nov 17, 2023 • 3 • 2

TheBloke/firefly-llama2-13B-chat-AWQ

Text Generation • 13B • Updated Nov 17, 2023 • 4 • 1

TheBloke/firefly-llama2-13B-chat-GPTQ

Text Generation • 13B • Updated Nov 17, 2023 • 9

TheBloke/firefly-llama2-7B-chat-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 1 • 2