Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,835

Full-text search

Active filters: 4-bit

TheBloke/llemma_34b-GPTQ

Text Generation • 34B • Updated Oct 17, 2023 • 8 • 2

TheBloke/llemma_34b-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 3 • 4

TheArchitectX/SHLa1

Text Generation • 13B • Updated Oct 17, 2023 • 1

TheArchitectX/SHLa2

Text Generation • 13B • Updated Oct 17, 2023 • 2

TheBloke/Dans-AdventurousWinds-Mk2-7B-GPTQ

Text Generation • 7B • Updated Nov 18, 2023 • 3 • 4

TheBloke/Dans-AdventurousWinds-Mk2-7B-AWQ

Text Generation • 7B • Updated Nov 18, 2023 • 4 • 1

TheBloke/Euryale-1.3-L2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 1 • 5

TheBloke/Euryale-1.3-L2-70B-GPTQ

Text Generation • 69B • Updated Oct 18, 2023 • 4 • 6

mluca/llm-13-b-80-emo-finetuned

Text Generation • Updated Oct 18, 2023

TheBloke/rpguild-chatml-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 2 • 1

TheBloke/rpguild-chatml-13B-GPTQ

Text Generation • 13B • Updated Oct 18, 2023 • 4

TheBloke/Airoboros-L2-13B-3.1.1-GPTQ

Text Generation • 13B • Updated Oct 22, 2023 • 5 • 3

TheBloke/Airoboros-L2-13B-3.1.1-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 2 • 2

TheBloke/Xwin-LM-7B-V0.2-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 1 • 1

TheBloke/Xwin-LM-7B-V0.2-GPTQ

Text Generation • 7B • Updated Oct 18, 2023 • 2 • 2

TheBloke/PsyMedRP-v1-13B-GPTQ

Text Generation • 13B • Updated Oct 18, 2023 • 1 • 7

TheBloke/PsyMedRP-v1-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 1 • 4

jeffreykthomas/llama2-7b-ubuntu-GPTQ

Text Generation • Updated Nov 9, 2023

OdiaGenAI/mistral-hindi-qlora-7B

Updated Oct 19, 2023 • 1

TheBloke/SlimOpenOrca-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 18, 2023 • 5 • 1

TheBloke/SlimOpenOrca-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6

skytree/opt-125m-gptq-4bit

Text Generation • Updated Oct 19, 2023 • 3

TheBloke/MistralLite-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 4 • 8

TheBloke/MistralLite-7B-GPTQ

Text Generation • 7B • Updated Oct 19, 2023 • 14 • 3

TheBloke/Mistral-Pygmalion-7B-GPTQ

Text Generation • 7B • Updated Oct 19, 2023 • 9 • 10

TheBloke/Mistral-Pygmalion-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 5

TheBloke/Airoboros-M-7B-3.1.2-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 2

TheBloke/Airoboros-M-7B-3.1.2-GPTQ

Text Generation • 7B • Updated Oct 22, 2023 • 1 • 3

KoboldAI/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • 13B • Updated Oct 19, 2023 • 5 • 14

yuyijiong/atom-7b-chat-16k

Text Generation • Updated Oct 25, 2023 • 5 • 1