Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,914

Base only

Active filters: 5-bit

MetaphoricalCode/EVA-Gutenberg3-Qwen2.5-32B-exl3-5bpw-hb6

Text Generation • 11B • Updated May 29, 2025 • 9

matatonic/DeepSeek-R1-0528-Qwen3-8B-5.0bpw-exl2

Text Generation • Updated May 29, 2025 • 11

bullerwins/DeepSeek-R1-0528-Qwen3-8B-exl3-5.0bpw

Text Generation • 3B • Updated May 29, 2025 • 14

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 169k • 11

MetaphoricalCode/Synthia-S1-27b-exl3-5bpw-hb6

Image-Text-to-Text • 10B • Updated Jun 1, 2025 • 10

MetaphoricalCode/gemma-3-27b-it-abliterated-exl3-5bpw-hb6

Image-Text-to-Text • 10B • Updated Jun 2, 2025 • 9

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-5bpw-hb6

Image-Text-to-Text • 10B • Updated Jun 2, 2025 • 9

stellaglow1122/llama3.2-1B-lora-exl2-q5

Updated Jun 4, 2025 • 4

MetaphoricalCode/Q2.5-32B-Slush-exl3-5bpw-hb6

Text Generation • 11B • Updated Jun 4, 2025 • 6

mlx-community-staging/gemma-3-1b-it-mlx-5Bit

Text Generation • 0.2B • Updated Jun 5, 2025 • 19

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-5bpw-hb6

Text Generation • 4B • Updated Jun 6, 2025 • 8

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-5bpw-hb6

Text Generation • 5B • Updated Jun 6, 2025 • 13

MetaphoricalCode/Vitus-Qwen3-14B-exl3-5bpw-hb6

5B • Updated Jun 9, 2025 • 7

Disya/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-exl2-5bpw-h8

Text Generation • Updated Jun 10, 2025 • 9

LibraxisAI/c4ai-command-a-03-2025-q5-mlx

Text Generation • Updated May 12

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-5bpw-hb6

Image-Text-to-Text • 10B • Updated Jun 10, 2025 • 6

matatonic/Magistral-Small-2506-5.0bpw-exl2

Updated Jun 10, 2025 • 9

MetaphoricalCode/Yanfei-v2-Qwen3-32B-exl3-5bpw-hb6

Text Generation • 11B • Updated Jun 11, 2025 • 7

LibraxisAI/Qwen3-235B-A22B-MLX-Q5

Text Generation • 235B • Updated May 11 • 18

MetaphoricalCode/Skyfall-36B-v2-exl3-5bpw-hb6

12B • Updated Jun 12, 2025 • 5

MetaphoricalCode/Dans-DangerousWinds-V1.1.1-24b-exl3-5bpw-hb6

8B • Updated Jun 13, 2025 • 7

MetaphoricalCode/Dans-DangerousWinds-V1.1.0-12b-exl3-5bpw-hb6

4B • Updated Jun 14, 2025 • 7

mlx-community/Falcon-H1-0.5B-Instruct-5bit

Text Generation • 98.1M • Updated Sep 26, 2025 • 13

mlx-community/Falcon-H1-1.5B-Instruct-5bit

Text Generation • 0.3B • Updated Sep 26, 2025 • 14

LibraxisAI/QwQ-32B-MLX-Q5

Text Generation • 33B • Updated May 11 • 29

LibraxisAI/Qwen3-14b-MLX-Q5

Text Generation • 15B • Updated May 11 • 44

MetaphoricalCode/Redemption_Wind_24B-exl3-5bpw-hb6

8B • Updated Jun 20, 2025 • 4

SicariusSicariiStuff/Impish_Magic_24B_EXL2_5.0bpw

Text Generation • Updated Jun 21, 2025 • 5

matatonic/Mistral-Small-3.2-24B-Instruct-2506-5.0bpw-exl2

Image-Text-to-Text • Updated Jun 21, 2025 • 14 • 1

Minthy/Qwen3-235B-A22B-5.0bpw-h6-exl3

Text Generation • 74B • Updated Jun 24, 2025 • 7