Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,540

Base only

Active filters: 6-bit

bullerwins/DeepSeek-R1-0528-Qwen3-8B-exl3-6.0bpw

Text Generation • 3B • Updated May 29, 2025 • 15

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 179k • 11

isogen/Josiefied-Qwen3-4B-abliterated-v2-exl3-6bpw

2B • Updated May 30, 2025 • 8

MetaphoricalCode/Synthia-S1-27b-exl3-6bpw-hb6

Image-Text-to-Text • 12B • Updated Jun 1, 2025 • 7

isogen/Josiefied-Qwen3-14B-abliterated-v3-exl3-6bpw

6B • Updated Jun 1, 2025 • 57

MetaphoricalCode/gemma-3-27b-it-abliterated-exl3-6bpw-hb6

Image-Text-to-Text • 12B • Updated Jun 2, 2025 • 10

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-6bpw-hb6

Image-Text-to-Text • 12B • Updated Jun 2, 2025 • 11

mlx-community/Homunculus-6bit

Text Generation • 12B • Updated Jun 3, 2025 • 12

zerofata/L3.3-GeneticLemonade-Final-v2-70B_6bpw-hb8-exl2

Text Generation • Updated Jun 5, 2025 • 10

stellaglow1122/llama3.2-1B-lora-exl2-q6

Updated Jun 4, 2025 • 5

mlx-community/Josiefied-Qwen3-14B-abliterated-v3-6bit

Text Generation • 15B • Updated Jun 4, 2025 • 69

mlx-community/Cydonia-24B-v3-6bit

Text Generation • 24B • Updated Jun 4, 2025 • 25

MetaphoricalCode/Q2.5-32B-Slush-exl3-6bpw-hb6

Text Generation • 13B • Updated Jun 4, 2025 • 11

mlx-community/DeepSeek-R1-0528-Qwen3-8B-6bit

Text Generation • 8B • Updated Jun 6, 2025 • 23 • 1

mlx-community/Fathom-R1-14B-6bit

Text Generation • 15B • Updated Jun 6, 2025 • 11

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-6bpw-hb6

Text Generation • 5B • Updated Jun 6, 2025 • 5

narpas/Scripturient-V1.3-LLaMa-70B-6.0bpw-h8-exl2

Text Generation • Updated Jun 6, 2025 • 7

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-6bpw-hb6

Text Generation • 6B • Updated Jun 6, 2025 • 7

mlx-community/Rivermind-Lux-12B-v1-6bit

Text Generation • 12B • Updated Jun 6, 2025 • 15

m-i/YiXin-Distill-Qwen-72B-mlx-6Bit

Text Generation • 16B • Updated Jun 7, 2025 • 6

Whth/YuE-s1-7B-anneal-zh-icl-exl2

Updated Jun 7, 2025 • 7

mlx-community/Big-Alice-28B-v1-6bit

Text Generation • 29B • Updated Jun 8, 2025 • 16

brtaydin/KwaiCoder-AutoThink-preview-mlx-6Bit

Text Generation • 9B • Updated Jun 9, 2025 • 8

mlx-community/KwaiCoder-AutoThink-preview-6bit

Text Generation • 41B • Updated Jun 10, 2025 • 8

MetaphoricalCode/Vitus-Qwen3-14B-exl3-6bpw-hb6

6B • Updated Jun 10, 2025 • 6

mlx-community/Falcon3-1B-Instruct-1.58bit-6bit

Text Generation • 0.4B • Updated Jun 10, 2025 • 11

mlx-community/Falcon3-3B-Instruct-1.58bit-6bit

Text Generation • 0.8B • Updated Jun 10, 2025 • 10

mlx-community/Falcon3-7B-Instruct-1.58bit-6bit

Text Generation • 2B • Updated Jun 10, 2025 • 16

mlx-community/bitnet-b1.58-2B-4T-6bit

Text Generation • 0.6B • Updated Jun 10, 2025 • 39

mlx-community/Falcon3-10B-Instruct-1.58bit-6bit

Text Generation • 3B • Updated Jun 10, 2025 • 11