Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,767

Full-text search

Active filters: 4-bit

TheBloke/XwinCoder-34B-GPTQ

Text Generation • 34B • Updated Nov 19, 2023 • 1 • 2

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-high-rank

Text Generation • Updated Nov 21, 2023 • 1

Pontonkid/falcon-med

Text Generation • Updated Nov 24, 2023 • 3

Pazuzzu/zephyr-7b-beta_assistant_v0.2_gptq

Text Generation • 7B • Updated Nov 20, 2023

janavikhochare/awq-numds

Text Generation • Updated Nov 19, 2023

janavikhochare/numds-q64

Text Generation • Updated Nov 19, 2023

TheBloke/LLaMA_2_13B_SFT_v1-GPTQ

Text Generation • 13B • Updated Nov 20, 2023 • 1

TheBloke/LLaMA_2_13B_SFT_v1-AWQ

Text Generation • 13B • Updated Nov 20, 2023 • 3

s-natsu/octocoder-awq

Text Generation • 16B • Updated Nov 20, 2023

TheBloke/llama2-7B-layla-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 3

TheBloke/mistral-7B-finetuned-orca-dpo-v2-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 3 • 1

TheBloke/mistral-7B-finetuned-orca-dpo-v2-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 1

heka-ai/zephyr-beta-ft-2000-lr-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 1

TheBloke/blossom-v3-mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 11

TheBloke/blossom-v3-mistral-7B-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 3 • 1

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 4 • 2

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 9 • 3

TheBloke/GOAT-70B-Storytelling-GPTQ

Text Generation • 69B • Updated Nov 20, 2023 • 1 • 4

TheBloke/GOAT-70B-Storytelling-AWQ

Text Generation • 69B • Updated Nov 20, 2023 • 2 • 2

marcchew/TinyLLaMA-1.1B-OrcaLaMini-GPTQ

Text Generation • 1B • Updated Nov 20, 2023 • 38

heka-ai/zephyr-beta-ft-2000-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 3

lebe1/opt-125m-4bit

Text Generation • 0.1B • Updated Nov 21, 2023 • 3

TheBloke/Autolycus-Mistral_7B-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 3 • 1

TheBloke/Autolycus-Mistral_7B-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 3 • 1

TheBloke/Free_Sydney_V2_Mistral_7b-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 6 • 1

TheBloke/Generate_Question_Mistral_7B-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 5 • 2

TheBloke/Free_Sydney_V2_Mistral_7b-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 6 • 1

TheBloke/Writing_Partner_Mistral_7B-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 5 • 1

TheBloke/Generate_Question_Mistral_7B-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 7 • 3

TheBloke/Writing_Partner_Mistral_7B-GPTQ

Text Generation • 7B • Updated Nov 20, 2023 • 3