Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,703

Full-text search

Active filters: 4-bit

TheBloke/LlamaGuard-7B-GPTQ

Text Generation • 7B • Updated Dec 11, 2023 • 21 • 2

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • 47B • Updated Dec 11, 2023 • 9

HydraIndicLM/mistral-MoQlora-punjabi-expert

Text Generation • Updated Dec 12, 2023

HydraIndicLM/mistral-MoQlora-tamil-expert

Text Generation • Updated Dec 12, 2023

TheBloke/mixtral-8x7b-v0.1-AWQ

Text Generation • 47B • Updated Dec 22, 2023 • 2.72k • 11

TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • 47B • Updated Dec 14, 2023 • 8.52k • 59

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 7B • Updated Dec 11, 2023 • 18.3k • 55

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • 7B • Updated Dec 11, 2023 • 146k • 52

TheBloke/Clover3-17B-GPTQ

Text Generation • 17B • Updated Dec 12, 2023 • 1 • 4

TheBloke/Clover3-17B-AWQ

Text Generation • 17B • Updated Dec 12, 2023 • 3

TheBloke/Rogue-Rose-103b-v0.2-GPTQ

Text Generation • 103B • Updated Dec 16, 2023 • 5 • 1

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • 103B • Updated Dec 16, 2023 • 4 • 5

TheBloke/dopeystableplats-3b-v1-GPTQ

Text Generation • 3B • Updated Dec 12, 2023 • 1

TheBloke/neural-chat-7B-v3-3-AWQ

Text Generation • 7B • Updated Dec 12, 2023 • 5

TheBloke/neural-chat-7B-v3-3-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 6 • 3

TheBloke/AmberChat-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 5 • 1

TheBloke/AmberChat-AWQ

Text Generation • 7B • Updated Dec 12, 2023 • 4 • 1

TheBloke/Amber-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 1 • 1

TheBloke/Amber-AWQ

Text Generation • 7B • Updated Dec 12, 2023 • 1

TheBloke/Seraph-7B-GPTQ

Text Generation • 7B • Updated Dec 12, 2023

TheBloke/Seraph-7B-AWQ

Text Generation • 7B • Updated Dec 12, 2023

iproskurina/opt-13b-GPTQ-4bit-g128

Text Generation • 2B • Updated Mar 29, 2025 • 3

TheBloke/v1olet_marcoroni-go-bruins-merge-7B-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 1

TheBloke/v1olet_marcoroni-go-bruins-merge-7B-AWQ

Text Generation • 7B • Updated Dec 12, 2023

TheBloke/Merged-DPO-7B-GPTQ

Text Generation • 7B • Updated Dec 12, 2023

TheBloke/Merged-DPO-7B-AWQ

Text Generation • 7B • Updated Dec 12, 2023 • 3 • 1

aladaf/zephyr-7b-beta_standard_v0.1_gptq

Text Generation • 7B • Updated Dec 12, 2023

TheBloke/supermario-v2-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 1

TheBloke/supermario-v2-AWQ

Text Generation • 7B • Updated Dec 12, 2023 • 1 • 1

TheBloke/Pallas-0.3-GPTQ

Text Generation • 34B • Updated Dec 12, 2023 • 3 • 1