Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,542

Base only

Active filters: 6-bit

MetaphoricalCode/Star-Command-R-32B-v1-exl3-6bpw-hb6

14B • Updated May 13, 2025 • 9 • 1

MetaphoricalCode/Star-Command-R-Lite-32B-v1-exl3-6bpw-hb6

Text Generation • 14B • Updated May 13, 2025 • 14

ArtusDev/L3.3-Electra-R1-70b_EXL3_6.0bpw_H8

Text Generation • 27B • Updated May 13, 2025 • 17 • 1

isogen/Josiefied-Qwen3-4B-abliterated-v1-exl3-6bpw

2B • Updated May 14, 2025 • 37

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-6bpw-hb6

Text Generation • 9B • Updated May 14, 2025 • 11

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-6bpw-hb6

Text Generation • 8B • Updated May 14, 2025 • 12

DanyDA/Mellum-4b-base-exl3-6.0bpw

Text Generation • 2B • Updated May 14, 2025 • 14

isogen/Qwen3-4B-exl3-6bpw

2B • Updated May 14, 2025 • 18

ArtusDev/TheDrummer_Snowpiercer-15B-v1_EXL2_6.0bpw_H8

Updated May 14, 2025 • 9 • 1

MetaphoricalCode/Big-Alice-28B-v1-exl3-6bpw-hb6

11B • Updated May 16, 2025 • 8

MetaphoricalCode/Harbinger-24B-exl3-6bpw-hb6

9B • Updated May 16, 2025 • 9

ArtusDev/yvvki_Erotophobia-24B-v1.1_EXL2_6.0bpw_H8

Text Generation • Updated May 16, 2025 • 10

NewEden-Forge/32b-dans-6bpw-exl3

Text Generation • 13B • Updated May 17, 2025 • 8

mlx-community/Phi-4-reasoning-plus-6bit

Text Generation • 3B • Updated May 17, 2025 • 27

isogen/gemma-3-12b-it-exl3-6bpw

6B • Updated May 17, 2025 • 12

mlx-community/MN-12B-Mag-Mell-R1-6bit

Text Generation • 3B • Updated May 18, 2025 • 64 • 1

zerofata/L3.3-GeneticLemonade-Unleashed-v3-70B_6bpw-hb8-exl2

Text Generation • Updated May 26, 2025 • 8

Jellon/Big-Alice-28B-v1-exl2-6bpw

Updated May 20, 2025 • 10

ArtusDev/TheDrummer_Valkyrie-49B-v1_EXL3_6.0bpw_H8

19B • Updated May 19, 2025 • 8 • 1

ArtusDev/TheDrummer_Valkyrie-49B-v1_EXL3_6.0bpw_H6

19B • Updated May 19, 2025 • 11

mlx-community/OuteTTS-1.0-0.6B-6bit

Text-to-Speech • 0.1B • Updated May 19, 2025 • 9

lmstudio-community/Devstral-Small-2505-MLX-6bit

Text Generation • 5B • Updated May 19, 2025 • 269 • 7

mlx-community/Seed-Coder-8B-Reasoning-6bit

Text Generation • 2B • Updated May 20, 2025 • 48 • 1

mlx-community/Seed-Coder-8B-Instruct-6bit

Text Generation • 2B • Updated May 20, 2025 • 28 • 1

ArtusDev/Delta-Vector_Archaeo-12B-V2_EXL2_6.0bpw_H6

Text Generation • Updated May 20, 2025 • 8

Eric1227/dolphin-2.5-mixtral-8x7b-MLX-6bit

Text Generation • 10B • Updated May 21, 2025 • 15

Eric1227/dolphin-2.7-mixtral-8x7b-MLX-6bit

Text Generation • 10B • Updated May 21, 2025 • 38

mlx-community/Devstral-Small-2505-6bit

Text Generation • 5B • Updated May 21, 2025 • 35 • 1

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.0bpw_H6

Text Generation • 9B • Updated May 21, 2025 • 14

ArtusDev/mistralai_Devstral-Small-2505_EXL3_6.0bpw_H8

Text Generation • 9B • Updated May 21, 2025 • 14