Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,889

Full-text search

Active filters: 4-bit

nalinaksh/opt-125m-gptq

Text Generation • Updated Oct 9, 2023 • 1

Joetib/results

Text Generation • Updated Oct 9, 2023 • 2

prattay/TinyLlama-chat-cpg-abinbev-finetune

Text Generation • Updated Oct 9, 2023 • 3

TheBloke/em_german_leo_mistral-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 3 • 6

TheBloke/em_german_leo_mistral-GPTQ

Text Generation • 7B • Updated Oct 10, 2023 • 140 • 10

TheBloke/sqlcoder2-GPTQ

Text Generation • 16B • Updated Oct 10, 2023 • 36 • 11

aiknight87/llama-2-7b-hf-tuned-200

Updated Oct 10, 2023 • 4

TheBloke/Tinyllama-2-1b-miniguanaco-GPTQ

Text Generation • 1B • Updated Oct 14, 2023 • 9 • 1

TheBloke/Tinyllama-2-1b-miniguanaco-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 34 • 3

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 67 • 18

TheBloke/zephyr-7B-alpha-GPTQ

Text Generation • 7B • Updated Oct 14, 2023 • 32 • 26

TheBloke/TinyLlama-1.1B-1T-OpenOrca-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 3 • 2

TheBloke/TinyLlama-1.1B-1T-OpenOrca-GPTQ

Text Generation • 1B • Updated Oct 11, 2023 • 8 • 2

TheBloke/tinyllama-1.1b-chat-v0.3_platypus-AWQ

Text Generation • 1B • Updated Nov 9, 2023 • 2 • 3

TheBloke/tinyllama-1.1b-chat-v0.3_platypus-GPTQ

Text Generation • 1B • Updated Oct 11, 2023 • 1 • 4

TheBloke/UndiMix-v3-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 3 • 1

TheBloke/UndiMix-v3-13B-GPTQ

Text Generation • 13B • Updated Oct 11, 2023 • 3 • 2

aiknight87/llama-2-7b-hf-200d

Updated Oct 11, 2023 • 2

aiknight87/llama-2-7b-hf-300s

Updated Oct 11, 2023 • 4

DS-Archive/limarpv3-llama2-70b-qlora

Text Generation • Updated Oct 25, 2023 • 5 • 2

TheBloke/dolphin-2.1-mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 11, 2023 • 25 • 35

TheBloke/dolphin-2.1-mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 25 • 21

TheBloke/jackalope-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1 • 1

TheBloke/jackalope-7B-GPTQ

Text Generation • 7B • Updated Oct 11, 2023 • 8

rand0wn/llama2-7b-chat-gptq

Text Generation • Updated Oct 11, 2023 • 1

aiknight87/llama-2-7b-hf-300d

Updated Oct 11, 2023 • 2

daedalus314/Marx-3B-V2-GPTQ

Text Generation • Updated Oct 12, 2023 • 3

Undi95/Mistral-11B-OmniMix-pippa-sharegpt-11b-qlora

Text Generation • Updated Oct 12, 2023

TheBloke/ZephRP-m7b-GPTQ

Text Generation • 7B • Updated Oct 12, 2023 • 5 • 2

TheBloke/ZephRP-m7b-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1