Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,767

Base only

Active filters: exl2

SicariusSicariiStuff/2B-ad-EXL2-8.0bpw

Text Generation • Updated Jul 25, 2025 • 9

FuturisticVibes/magnum-v2-72b-8.0bpw-h8-exl2

Text Generation • Updated Aug 26, 2024 • 8

bluuwhale/DonutHole-8x7B-4.5bpw-h8-exl2

Updated Aug 27, 2024 • 7

altomek/magnum-v3-34b-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 9

SicariusSicariiStuff/invisietch_Nimbus-Miqu-v0.1-70B-EXL2-3.0bpw

Text Generation • Updated Aug 27, 2024 • 7

SicariusSicariiStuff/invisietch_Nimbus-Miqu-v0.1-70B-EXL2-5.5bpw

Text Generation • Updated Aug 27, 2024 • 7

altomek/Deedlit_4B-8bpw-EXL2

Text Generation • Updated Aug 30, 2024 • 14

DeusImperator/magnum-v3-34b_exl2_4.6bpw

Updated Aug 27, 2024 • 6

DeusImperator/Big-Tiger-Gemma-27B-v1_exl2_5.6bpw

Updated Aug 27, 2024 • 7

cgus/NemoMix-Unleashed-12B-exl2

Text Generation • Updated Oct 29, 2024 • 13 • 1

bigstorm/Phi-3.5-mini-instruct-6.5bpw-8hb-exl2

Text Generation • Updated Aug 27, 2024 • 8

bigstorm/dolphin-2.9.4-llama3.1-8b-7.0bpw-8hb-exl2

Updated Aug 28, 2024 • 9

FuturisticVibes/magnum-v1-72b-8.0bpw-h8-exl2

Text Generation • Updated Aug 28, 2024 • 11

FuturisticVibes/Lumimaid-Magnum-12B-8.0bpw-h8-exl2

Text Generation • Updated Aug 28, 2024 • 10 • 1

FuturisticVibes/Lumimaid-v0.2-12B-8.0bpw-h8-exl2

Updated Aug 28, 2024 • 5

FluffyKaeloky/Luminum-v0.1-123B-exl2-4.0bpw

Text Generation • Updated Aug 29, 2024 • 18 • 1

Statuo/MN-12b-Lyra-v3-8bpw

Updated Aug 29, 2024 • 5

Statuo/MN-12b-Lyra-v3-6bpw

Updated Aug 29, 2024 • 7 • 1

Statuo/MN-12b-Lyra-v3-4bpw

Updated Aug 29, 2024 • 5

DeusImperator/magnum-v3-34b_exl2_4.6bpw_rpcal_mk2

Updated Aug 30, 2024 • 6

waldie/gemma-2-27b-it-SimPO-37K-5.5bpw-h6-exl2

Text Generation • Updated Aug 29, 2024 • 9

FuturisticVibes/xLAM-7b-r-8.0bpw-h8-exl2

Text Generation • Updated Aug 30, 2024 • 11

denru/Luminum-v0.1-123B-5_5bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 11

Statuo/Lyra-Gutenberg-12b-EXL2-8bpw

Text Generation • Updated Aug 30, 2024 • 9

Statuo/Lyra-Gutenberg-12b-EXL2-6bpw

Text Generation • Updated Aug 30, 2024 • 9

Statuo/Lyra-Gutenberg-12b-EXL2-4bpw

Text Generation • Updated Aug 30, 2024 • 9

pigfoot/Llama-3-Taiwan-8B-Instruct-V1-5bpw-exl2

Text Generation • Updated Aug 30, 2024 • 7

LoneStriker/LongWriter-llama3.1-8b-3.0bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 9

LoneStriker/LongWriter-llama3.1-8b-4.0bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 7

LoneStriker/LongWriter-llama3.1-8b-5.0bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 7