Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,892

Base only

Active filters: 5-bit

async0x42/Qwen2.5.1-Coder-7B-Instruct-exl2_5.0bpw

Text Generation • Updated Nov 8, 2024 • 11

async0x42/Qwen2.5-32B-ArliAI-RPMax-v1.3-exl2_5.0bpw

Updated Nov 9, 2024 • 5

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 301

DrNicefellow/Qwen2.5-Coder-32B-Instruct-5.0bpw-exl2

Updated Nov 12, 2024 • 7

bullerwins/Qwen2.5-Coder-32B-exl2_5.0bpw

Text Generation • Updated Apr 28, 2025 • 12

async0x42/Qwen2.5-Coder-0.5B-Instruct-exl2_5.0bpw

Text Generation • Updated Nov 12, 2024 • 8 • 1

DrNicefellow/Qwen2.5-Coder-14B-Instruct-5.0bpw-exl2

Updated Nov 12, 2024 • 12

async0x42/Qwen2.5-Coder-32B-Instruct-exl2_5.0bpw

Text Generation • Updated Nov 13, 2024 • 10

async0x42/Qwen2.5-Coder-7B-exl2_5.0bpw

Text Generation • Updated Nov 13, 2024 • 8

DrNicefellow/Qwen2.5-7B-O1-Journey-1-5.0bpw-exl2

Updated Nov 17, 2024 • 6

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 15, 2024 • 220 • 7

async0x42/Rombos-Coder-V2.5-Qwen-32b-exl2_5.0bpw

Text Generation • Updated Nov 16, 2024 • 10

bullerwins/Athene-V2-Chat-exl2_5.0bpw

Text Generation • Updated Apr 28, 2025 • 9

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated Nov 18, 2024 • 10 • 1

async0x42/Qwen2.5-Gutenberg-Doppel-14B-exl2_5.0bpw

Text Generation • Updated Nov 18, 2024 • 8

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • 123B • Updated Nov 20, 2024 • 171k • 2

bullerwins/Mistral-Large-Instruct-2411-exl2_5.0bpw

Updated Nov 20, 2024 • 18

BigHuggyD/Mistral-Large-Instruct-2411_exl2_5.0bpw_h6

Updated Nov 20, 2024 • 7

async0x42/Cydonia-22B-v1.3-exl2_5.0bpw

Updated Nov 20, 2024 • 6

BigHuggyD/MarsupialAI_Monstral-123B_exl2_5.0bpw_h6

Text Generation • Updated Nov 22, 2024 • 6

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_5.0bpw_h6

Updated Nov 24, 2024 • 6 • 2

BigHuggyD/TheDrummer_Behemoth-123B-v2.1_exl2_5.0bpw_h6

Updated Nov 26, 2024 • 4

DrNicefellow/Qwen-QwQ-32B-Preview-5.0bpw-exl2

Updated Nov 28, 2024 • 9

async0x42/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Nov 29, 2024 • 8

James2313123/L3.1-RP-Hero-BigTalker-8B_5bpw-h6-exl2

Updated Nov 30, 2024 • 6

Dracones/Qwen2.5-32B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 1, 2024 • 8

Dracones/Qwen2.5-Coder-32B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 1, 2024 • 8

Dracones/Athene-V2-Chat_exl2_5.0bpw

Text Generation • Updated Dec 15, 2024 • 9 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.2-5.0bpw-h6-exl2

Updated Dec 2, 2024 • 5 • 3

NewEden/Theia-21B-V2-EXL2-5BPW

Updated Dec 2, 2024 • 7