Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,765

Full-text search

Active filters: 4-bit

TheBloke/MythoMist-7B-GPTQ

Text Generation • 7B • Updated Nov 22, 2023 • 11 • 5

TheBloke/Tess-M-v1.1-GPTQ

Text Generation • 34B • Updated Nov 22, 2023 • 1 • 1

TheBloke/Tess-M-v1.1-AWQ

Text Generation • 34B • Updated Nov 22, 2023 • 3 • 1

01-ai/Yi-34B-Chat-4bits

Text Generation • 34B • Updated Nov 11, 2024 • 39 • 60

01-ai/Yi-6B-Chat-4bits

Text Generation • 6B • Updated Nov 11, 2024 • 684 • 22

sharkMeow/results

Updated Nov 25, 2023

TheBloke/OrionStar-Yi-34B-Chat-Llama-GPTQ

Text Generation • 34B • Updated Nov 22, 2023 • 3 • 4

TheBloke/OrionStar-Yi-34B-Chat-Llama-AWQ

Text Generation • 34B • Updated Nov 22, 2023 • 4 • 3

EnzoVeltri/tableLlama-4bit

Text Generation • 7B • Updated Nov 22, 2023 • 3

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy

Text Generation • Updated Nov 23, 2023

TheBloke/rocket-3B-GPTQ

Text Generation • 3B • Updated Nov 22, 2023 • 86

florentgbelidji/leoLM-13b-sft-lora-oa

Text Generation • Updated Nov 23, 2023 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-low-rank

Text Generation • Updated Nov 22, 2023

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-tiny-rank

Text Generation • Updated Nov 24, 2023

TheBloke/Tess-XS-Creative-v1.0-GPTQ

Text Generation • 7B • Updated Nov 22, 2023 • 1 • 1

TheBloke/Tess-XS-Creative-v1.0-AWQ

Text Generation • 7B • Updated Nov 22, 2023 • 1 • 1

TheBloke/Tess-XS-v1.1-GPTQ

Text Generation • 7B • Updated Nov 22, 2023 • 1 • 1

TheBloke/Tess-XS-v1.1-AWQ

Text Generation • 7B • Updated Nov 22, 2023 • 1 • 1

TheBloke/Chupacabra-7B-v2-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 1

TheBloke/Chupacabra-7B-v2-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 1

TheBloke/Ferret_7B-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 5 • 2

TheBloke/Ferret_7B-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 2 • 1

TheBloke/speechless-mistral-7B-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 2

TheBloke/speechless-mistral-7B-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 3 • 1

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 3

TheBloke/airoboros-m-7B-3.1.2-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 2

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 1

TheBloke/CollectiveCognition-v1.1-Mistral-7B-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 4 • 1

TheBloke/SynthIA-7B-v1.3-dare-0.85-AWQ

Text Generation • 7B • Updated Nov 23, 2023

TheBloke/SynthIA-7B-v1.3-dare-0.85-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 1 • 1