Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,767

Base only

Active filters: exl2

bigstorm/Mistral-Large-Instruct-2407-6.0bpw-8hb-exl2

Updated Sep 4, 2024 • 10

bigstorm/Mistral-Large-Instruct-2407-6.5bpw-8hb-exl2

Updated Sep 4, 2024 • 13

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_5.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 37

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_4.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 7 • 1

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_3.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 8

schnapper79/lumikabra-123B_v0.2-exl2-8.0

Text Generation • Updated Sep 5, 2024 • 8

LoneStriker/Yi-Coder-9B-Chat-3.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 6

LoneStriker/Yi-Coder-9B-Chat-4.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 8

LoneStriker/Yi-Coder-9B-Chat-5.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 6

LoneStriker/Yi-Coder-9B-Chat-6.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 5

LoneStriker/Yi-Coder-9B-Chat-8.0bpw-h8-exl2

Text Generation • Updated Sep 4, 2024 • 5 • 1

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 10

LoneStriker/Yi-Coder-9B-3.0bpw-h6-exl2

Updated Sep 4, 2024 • 4

LoneStriker/Yi-Coder-9B-4.0bpw-h6-exl2

Updated Sep 4, 2024 • 5

LoneStriker/Yi-Coder-9B-5.0bpw-h6-exl2

Updated Sep 4, 2024 • 4

LoneStriker/Yi-Coder-9B-6.0bpw-h6-exl2

Updated Sep 4, 2024 • 6

LoneStriker/Yi-Coder-9B-8.0bpw-h8-exl2

Updated Sep 4, 2024 • 5 • 1

altomek/Yi-Coder-9B-Chat-8bpw-EXL2

Text Generation • Updated Sep 10, 2024 • 7 • 1

Statuo/Stardust-V2-EXL2-8bpw

Text Generation • Updated Sep 5, 2024 • 6

Statuo/Stardust-V2-EXL2-6bpw

Text Generation • Updated Sep 5, 2024 • 9

Statuo/Stardust-V2-EXL2-4bpw

Text Generation • Updated Sep 5, 2024 • 7

cgus/Yi-Coder-1.5B-Chat-exl2

Updated Sep 9, 2024 • 11

schnapper79/lumikabra-123B_v0.3-exl2-8.0bpw

Text Generation • Updated Sep 5, 2024 • 9

Orion-zhen/Reflection-Llama-3.1-70B-4.5bpw-exl2

Text Generation • Updated Sep 7, 2024 • 10

bullerwins/Reflection-70B-exl2_4.0bpw

Text Generation • Updated Sep 6, 2024 • 10

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated Sep 6, 2024 • 9 • 1

bullerwins/Reflection-70B-exl2_6.0bpw

Text Generation • Updated Sep 6, 2024 • 9 • 1

LoneStriker/Reflection-Llama-3.1-70B-2.4bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 9

LoneStriker/Reflection-Llama-3.1-70B-3.5bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 9

bigstorm/Reflections-Llama-3.1-70B-8.0bpw-8hb-exl2

Text Generation • Updated Sep 6, 2024 • 9