Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,767

Base only

Active filters: exl2

bullerwins/Reflection-70B-exl2_8.0bpw

Text Generation • Updated Sep 6, 2024 • 8

LoneStriker/Reflection-Llama-3.1-70B-4.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 7

LoneStriker/Reflection-Llama-3.1-70B-4.65bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 9

LoneStriker/Reflection-Llama-3.1-70B-5.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 9

LoneStriker/Reflection-Llama-3.1-70B-6.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 8 • 1

LoneStriker/Reflection-Llama-3.1-70B-2.25bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 9

bigstorm/Reflections-Llama-3.1-70B-6.0bpw-8hb-exl2

Text Generation • Updated Sep 6, 2024 • 8 • 1

FuturisticVibes/c4ai-command-r-plus-08-2024-8.0bpw-h8-exl2

Text Generation • Updated Sep 7, 2024 • 6

bullerwins/Reflection-70B-exl2_3.0bpw

Text Generation • Updated Sep 7, 2024 • 10

bullerwins/Reflection-70B-exl2_3.5bpw

Text Generation • Updated Sep 7, 2024 • 10

bullerwins/Reflection-70B-exl2_4.5bpw

Text Generation • Updated Sep 7, 2024 • 10

bullerwins/Reflection-70B-exl2_5.5bpw

Text Generation • Updated Sep 7, 2024 • 9

Hydrafig/narrativAI-8BPW-EXL2

Updated Sep 7, 2024 • 7

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.7bpw_h6

Text Generation • Updated Sep 7, 2024 • 11 • 5

FuturisticVibes/c4ai-command-r-plus-08-2024-6.0bpw-h8-exl2

Text Generation • Updated Sep 7, 2024 • 8 • 1

FuturisticVibes/c4ai-command-r-plus-08-2024-4.0bpw-h8-exl2

Text Generation • Updated Sep 7, 2024 • 7

schnapper79/lumikabra-123B_v0.4-exl2-8.0bpw

Text Generation • Updated Sep 8, 2024 • 9

Statuo/Lyra-V4-EXL2-8bpw

Updated Sep 8, 2024 • 5

Statuo/Lyra-V4-EXL2-6bpw

Updated Sep 8, 2024 • 5

Statuo/Lyra-V4-EXL2-4bpw

Updated Sep 8, 2024 • 7

schnapper79/lumikabra-123B_v0.4-exl2-4.0bpw

Text Generation • Updated Sep 8, 2024 • 10 • 1

async0x42/Meta-Llama-3.1-8B-exl2_5bpw

Text Generation • Updated Sep 8, 2024 • 7

schnapper79/lumikabra-123B_v0.4-exl2-5.0bpw

Text Generation • Updated Sep 9, 2024 • 9

DBMe/c4ai-command-r-plus-08-2024-3.2bpw-h6-exl2

Text Generation • Updated Oct 21, 2024 • 8

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated Sep 9, 2024 • 8 • 3

riveRiPH/MN-12B-Lyra-v4-5bpw-h6-exl2

Updated Sep 9, 2024 • 8 • 1

riveRiPH/MN-12B-Lyra-v4-4bpw-h6-exl2

Updated Sep 9, 2024 • 7

DeusImperator/MN-12B-Lyra-v4_exl2_8bpw_max

Updated Sep 9, 2024 • 6

TeeZee/Reflection-Llama-3.1-70B-bpw4.0-h8-exl2

Updated Sep 9, 2024 • 8 • 2

async0x42/MN-12B-Lyra-v4-exl2_8bpw

Updated Sep 9, 2024 • 5