Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,465

Base only

Active filters: 4-bit

TheBloke/Llama-2-7B-LoRA-Assemble-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 8 • 1

TheBloke/LlongOrca-7B-16K-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Llama-2-70B-LoRA-Assemble-v2-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 12 • 1

TheBloke/OpenOrca-Platypus2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 2

TheBloke/OpenOrcaxOpenChat-Preview2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/CodeLlama-13B-oasst-sft-v10-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 1

TheBloke/Llama2-13B-MegaCode2-OASST-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 2

TheBloke/fiction.live-Kimiko-V2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 7

TheBloke/Llama2-70B-OASST-SFT-v10-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 6 • 2

TheBloke/OpenBuddy-Llama2-13B-v11.1-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 4

TheBloke/openchat_v3.2_super-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 9 • 1

TheBloke/OpenBuddy-Llama2-70b-v10.1-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 10 • 4

TheBloke/OpenAssistant-Llama2-13B-Orca-8K-3319-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Lemur-70B-Chat-v1-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Llama-2-PeanutButter_v19_R8-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 1

TheBloke/Phind-CodeLlama-34B-Python-v1-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 5 • 2

TheBloke/Phind-CodeLlama-34B-v1-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 4 • 1

TheBloke/Phind-CodeLlama-34B-v2-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 48 • 35

TheBloke/Llama2-Chat-AYT-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Sheep-Duck-Llama-2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 5 • 1

TheBloke/LosslessMegaCoder-Llama2-13B-Mini-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/LosslessMegaCoder-Llama2-7B-Mini-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Pygmalion-2-13B-SuperCOT-weighed-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 2

TheBloke/Pygmalion-2-13B-SuperCOT-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 3

TheBloke/Pygmalion-2-13B-SuperCOT2-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 1

TheBloke/Euryale-Inverted-L2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 7 • 1

TheBloke/JanniesBasedLigma-L2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5

TheBloke/Euryale-L2-70B-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Mythical-Destroyer-L2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Mythical-Destroyer-V2-L2-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 1