Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,767

Base only

Active filters: exl2

async0x42/NemoMix-Unleashed-12B-exl2_8bpw

Text Generation • Updated Sep 9, 2024 • 6

async0x42/Pantheon-RP-1.6.1-12b-Nemo-exl2_8bpw

Updated Sep 9, 2024 • 6

async0x42/Mistral-Nemo-12B-ArliAI-RPMax-v1.1-exl2_8bpw

Updated Sep 10, 2024 • 5

FuturisticVibes/Theia-21B-v2-8.0bpw-h8-exl2

Updated Sep 10, 2024 • 6

Statuo/MN-12b-ArliAI-RPMax-EXL2-8bpw

Updated Sep 10, 2024 • 7

Statuo/MN-12b-ArliAI-RPMax-EXL2-6bpw

Updated Sep 10, 2024 • 23

Statuo/MN-12b-ArliAI-RPMax-EXL2-4bpw

Updated Sep 10, 2024 • 5 • 4

schnapper79/lumikabra-123B_v0.1-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 9

schnapper79/lumikabra-195B_v0.3-exl2-4.0bpw

Text Generation • Updated Sep 10, 2024 • 10 • 1

schnapper79/lumikabra-123B_v0.3-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 9

async0x42/L3.1-70B-Hanami-x1-exl2_3.5bpw

Updated Sep 10, 2024 • 6

async0x42/Merged-RP-Stew-V2-34B-exl2_5bpw

Updated Sep 10, 2024 • 4

DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max_rpcal_mk2

Updated Sep 10, 2024 • 5

async0x42/L3.1-70B-Hanami-x1-exl2_3.25bpw

Updated Sep 10, 2024 • 5

drexample/Llama-Guard-3-8B-exl2-bpw6

Updated Sep 10, 2024 • 6

PedroPareja/Nimbus-Miqu-v0.1-70B-4.0bpw-exl2

Text Generation • Updated Sep 11, 2024 • 7 • 1

async0x42/Meta-Llama-3.1-8B-Instruct-exl2_4bpw

Text Generation • Updated Sep 10, 2024 • 9

async0x42/L3.1-70B-Hanami-x1-exl2_3bpw

Updated Sep 11, 2024 • 5

ZeusLabs/Chronos-Divergence-33B-exl2-8.0bpw

Updated Sep 11, 2024 • 10

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-4.0bpw

Updated Sep 11, 2024 • 7 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-6.0bpw

Updated Sep 11, 2024 • 7 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-3.0bpw

Updated Sep 11, 2024 • 7

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-2.65bpw

Updated Sep 11, 2024 • 7

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-3.5bpw

Updated Sep 11, 2024 • 5

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-5.5bpw

Updated Sep 11, 2024 • 5

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-6.5bpw

Updated Sep 11, 2024 • 6

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-4.5bpw

Updated Sep 11, 2024 • 6 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-7.5bpw

Updated Sep 11, 2024 • 7

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-7.0bpw

Updated Sep 11, 2024 • 5

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-5.0bpw

Updated Sep 11, 2024 • 7