Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,563

Base only

Active filters: 6-bit

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 252 • 1

MaziyarPanahi/calme-3.2-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 97

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 166 • 3

MaziyarPanahi/calme-3.1-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 120

MaziyarPanahi/calme-3.2-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 185

MaziyarPanahi/calme-3.3-baguette-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 120

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 181 • 1

MaziyarPanahi/calme-3.2-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 92

MaziyarPanahi/calme-3.3-qwenloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 91

MaziyarPanahi/calme-3.1-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 276

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 310 • 1

Statuo/MiS-Firefly-v0.2-22b-EXL2-6bpw

Text Generation • Updated Nov 9, 2024 • 7

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 301

MarsupialAI/Stellar-Odyssey-12b-adventure-v0.0_EXL2_6bpw_H8

Text Generation • Updated Nov 11, 2024 • 5

DrNicefellow/Qwen2.5-Coder-32B-Instruct-6.0bpw-exl2

Updated Nov 12, 2024 • 12

bullerwins/Qwen2.5-Coder-32B-exl2_6.0bpw

Text Generation • Updated Apr 28, 2025 • 11

Jellon/MSM-MS-Cydrion-22B-exl2-6bpw

Text Generation • Updated Nov 12, 2024 • 7

DrNicefellow/Qwen2.5-Coder-14B-Instruct-6.0bpw-exl2

Updated Nov 12, 2024 • 12

MarsupialAI/UnslopNemo-12B-v3_EXL2_6bpw_H8

Updated Nov 13, 2024 • 7 • 1

DrNicefellow/Qwen2.5-7B-O1-Journey-1-6.0bpw-exl2

Updated Nov 17, 2024 • 11

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • 2B • Updated Nov 15, 2024 • 220 • 7

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated Apr 28, 2025 • 16

MikeRoz/sophosympatheia_Evathene-v1.0-6.0bpw-h6-exl2

Text Generation • Updated Nov 17, 2024 • 8 • 2

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • 123B • Updated Nov 20, 2024 • 171k • 2

schnapper79/mistralai_large_instruct_2411-exl2-6.0bpw

Text Generation • Updated Nov 20, 2024 • 8

Jellon/MS-Meadowlark-22B-exl2-h8-6bpw

Text Generation • Updated Nov 19, 2024 • 7

MikeRoz/mistralai_Mistral-Large-Instruct-2411-6.0bpw-h6-exl2

Updated Nov 20, 2024 • 7

BigHuggyD/Mistral-Large-Instruct-2411_exl2_6.0bpw_h6

Updated Nov 20, 2024 • 9

bullerwins/Mistral-Large-Instruct-2411-exl2_6.0bpw

Updated Nov 20, 2024 • 11

Statuo/MS-Cydonia-v1.3-EXL2-6bpw

Updated Nov 22, 2024 • 5