Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,294

Base only

Active filters: 4-bit

TheBloke/Python-Code-13B-GPTQ

Text Generation • 13B • Updated Nov 14, 2023 • 6 • 1

TheBloke/ShiningValiantXS-AWQ

Text Generation • 13B • Updated Nov 14, 2023 • 5

TheBloke/DaringFortitude-AWQ

Text Generation • 13B • Updated Nov 14, 2023 • 5 • 2

TheBloke/Python-Code-33B-GPTQ

Text Generation • 33B • Updated Nov 14, 2023 • 7 • 4

TheBloke/DaringFortitude-GPTQ

Text Generation • 13B • Updated Nov 14, 2023 • 7 • 2

TheBloke/ShiningValiantXS-GPTQ

Text Generation • 13B • Updated Nov 15, 2023 • 12

habanoz/TinyLlama-1.1B-Chat-v0.3-GPTQ

Text Generation • 1B • Updated Nov 15, 2023 • 863

TheBloke/SynthIA-7B-v2.0-16k-AWQ

Text Generation • 7B • Updated Nov 15, 2023 • 6

TheBloke/SynthIA-7B-v2.0-16k-GPTQ

Text Generation • 7B • Updated Nov 15, 2023 • 8 • 1

TheBloke/zephyr-7B-beta-pl-GPTQ

Text Generation • 7B • Updated Nov 15, 2023 • 9 • 4

TheBloke/zephyr-7B-beta-pl-AWQ

Text Generation • 7B • Updated Nov 15, 2023 • 9 • 2

TheBloke/Tess-XL-v1.0-GPTQ

Text Generation • 118B • Updated Nov 15, 2023 • 7 • 3

TheBloke/Tess-XL-v1.0-AWQ

Text Generation • 118B • Updated Nov 15, 2023 • 9 • 1

gradjitta/Poro-34B-AWQ

Text Generation • 35B • Updated Nov 16, 2023 • 6 • 1

TheBloke/neural-chat-7B-v3-1-AWQ

Text Generation • 7B • Updated Nov 17, 2023 • 9 • 4

Leul78/meet

Text Generation • 7B • Updated Nov 15, 2023 • 7

TheBloke/neural-chat-7B-v3-1-GPTQ

Text Generation • 7B • Updated Nov 17, 2023 • 7 • 7

TheBloke/sqlcoder-7B-GPTQ

Text Generation • 7B • Updated Nov 15, 2023 • 4 • 7

TheBloke/sqlcoder-7B-AWQ

Text Generation • 7B • Updated Nov 15, 2023 • 224 • 3

TheBloke/Thespis-Mistral-7B-v0.6-AWQ

Text Generation • 7B • Updated Nov 15, 2023 • 5 • 2

TheBloke/Thespis-Mistral-7B-v0.6-GPTQ

Text Generation • 7B • Updated Nov 15, 2023 • 5 • 4

TheBloke/Tai-70B-GPTQ

Text Generation • 69B • Updated Nov 16, 2023 • 5 • 3

TheBloke/Tai-70B-AWQ

Text Generation • 69B • Updated Nov 16, 2023 • 5 • 1

ranchlai/CodeLlama-34b-Instruct-gptq-4bit

Text Generation • Updated Nov 16, 2023 • 7

TheBloke/MoMo-70B-V1.1-AWQ

Text Generation • 69B • Updated Nov 16, 2023 • 8 • 1

TheBloke/MoMo-70B-V1.1-GPTQ

Text Generation • 69B • Updated Nov 16, 2023 • 6 • 2

dinhhung1508/hung-7b-v1.0-awq

Text Generation • 7B • Updated Nov 16, 2023 • 6

nick-1234/opt-125m-gptq-4bit

Text Generation • 0.1B • Updated Nov 16, 2023 • 5

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • 13B • Updated Nov 18, 2023 • 10 • 3

TheBloke/Deacon-34B-AWQ

Text Generation • 34B • Updated Nov 16, 2023 • 5 • 2