Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,385

Base only

Active filters: 4-bit

Aayush98/zephyr-7B-alpha-8bit

Text Generation • Updated Oct 17, 2023 • 6

Aayush98/samantha-1.2-mistral-7B-8bit

Text Generation • Updated Oct 17, 2023 • 5

TheBloke/Pandalyst-7B-v1.2-GPTQ

Text Generation • 7B • Updated Oct 17, 2023 • 6 • 1

TheBloke/Pandalyst-7B-v1.2-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6 • 1

TheBloke/Thespis-13B-v0.3-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 1

TheBloke/Thespis-13B-v0.3-GPTQ

Text Generation • 13B • Updated Oct 17, 2023 • 7 • 2

TheBloke/Mistral-7B-Phibrarian-32K-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 4

TheBloke/Mistral-7B-Phibrarian-32K-GPTQ

Text Generation • 7B • Updated Oct 17, 2023 • 8 • 3

TheBloke/llemma_7b-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 3

TheBloke/llemma_7b-GPTQ

Text Generation • 7B • Updated Oct 17, 2023 • 12

TheBloke/llemma_34b-GPTQ

Text Generation • 34B • Updated Oct 17, 2023 • 8 • 2

TheBloke/llemma_34b-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 6 • 4

TheArchitectX/SHLa1

Text Generation • 13B • Updated Oct 17, 2023 • 8

TheArchitectX/SHLa2

Text Generation • 13B • Updated Oct 17, 2023 • 10

TheBloke/Dans-AdventurousWinds-Mk2-7B-GPTQ

Text Generation • 7B • Updated Nov 18, 2023 • 6 • 4

TheBloke/Dans-AdventurousWinds-Mk2-7B-AWQ

Text Generation • 7B • Updated Nov 18, 2023 • 5 • 1

TheBloke/Euryale-1.3-L2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 9 • 5

TheBloke/Euryale-1.3-L2-70B-GPTQ

Text Generation • 69B • Updated Oct 18, 2023 • 8 • 6

mluca/llm-13-b-80-emo-finetuned

Text Generation • 7B • Updated Oct 18, 2023

TheBloke/rpguild-chatml-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/rpguild-chatml-13B-GPTQ

Text Generation • 13B • Updated Oct 18, 2023 • 8 • 4

TheBloke/Airoboros-L2-13B-3.1.1-GPTQ

Text Generation • 13B • Updated Oct 22, 2023 • 9 • 3

TheBloke/Airoboros-L2-13B-3.1.1-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 6 • 2

TheBloke/Xwin-LM-7B-V0.2-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 4 • 1

TheBloke/Xwin-LM-7B-V0.2-GPTQ

Text Generation • 7B • Updated Oct 18, 2023 • 9 • 2

TheBloke/PsyMedRP-v1-13B-GPTQ

Text Generation • 13B • Updated Oct 18, 2023 • 7 • 7

TheBloke/PsyMedRP-v1-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 4

jeffreykthomas/llama2-7b-ubuntu-GPTQ

Text Generation • Updated Nov 9, 2023 • 8

OdiaGenAI/mistral-hindi-qlora-7B

Updated Oct 19, 2023 • 5

TheBloke/SlimOpenOrca-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 18, 2023 • 8 • 1