Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

mixed-precision

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

612

Base only

Active filters: mixed-precision

lilcheaty/LFM2.5-230M-MLX-attn8-base6

Text Generation • 51.5M • Updated Jun 25 • 50

avlp12/Krea-2-Turbo-Alis-MLX-mixed-4-8

Text-to-Image • Updated 19 days ago • 226 • 1

sahilchachra/ornith-1.0-9b-optiq-5bpw-mlx

9B • Updated Jun 26 • 1.02k • 3

JasonW2025/Qwen3.6-27B-PrismaQuant-5.2bit-vllm

Text Generation • 19B • Updated 30 days ago • 362

sahilchachra/Tessera-4B-Preview-optiq-5bpw-mlx

0.9B • Updated 23 days ago • 169 • 1

cyburn/Ornith-1.0-35B-4.75Bits

Text Generation • 21B • Updated Jun 28 • 354 • 1

xero0000/Gordon-35B-A3B-mixed-q2k-imat

Text Generation • 35B • Updated Jun 29 • 48 • 1

xero0000/Vortigaunt-35B-mixed-q2k-imat

Text Generation • 35B • Updated Jun 30 • 32

xero0000/Gman-35B-A3B-mixed-q2k-imat

Text Generation • 35B • Updated Jun 30 • 17

xero0000/Kleiner-Coder-35B-mixed-q2k

Text Generation • 36B • Updated Jun 30 • 69

mlx-community/mini-coder-4b-OptiQ-4bit

Text Generation • 0.8B • Updated Jul 1 • 555 • 1

baa-ai/GLM-5.2-RAM-333GB-MLX

96B • Updated 17 days ago • 1.54k

baa-ai/GLM-5.2-RAM-307GB-GGUF

Text Generation • 753B • Updated Jul 3 • 152 • 2

xero0000/Gordon-35B-A3B-mixed-q2k-imat-MTP

Text Generation • 36B • Updated Jul 2 • 46

xero0000/G-Man-35B-A3B-abliterated-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 48

xero0000/Vortigaunt-Ornith-1.0-35B-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 114

xero0000/Alyx-AgentWorld-35B-A3B-mixed-q2k-MTP

Text Generation • 36B • Updated Jul 2 • 81

xero0000/Alyx-AgentWorld-35B-A3B-mixed-q2k

Text Generation • 35B • Updated Jul 2 • 36

rdtand/Ornith-1.0-35B-PrismaAURA-4.75bit-vllm-MTP

Text Generation • 22B • Updated 29 days ago • 13.7k • 7

EigenLabs/Qwen3.6-35B-A3B-MLX-mixed-4bit

Text Generation • 35B • Updated 28 days ago • 132

EigenLabs/Qwen3.6-27B-MLX-mixed-4bit

Text Generation • 27B • Updated 28 days ago • 83

aisamdasu/Algocean-Qwen3.6-35B-A3B-mlx-OptiQ

Text Generation • 35B • Updated 26 days ago • 355 • 1

avlp12/MiniMax-M3-Alis-MLX-Dynamic

Image-Text-to-Text • 427B • Updated 10 days ago • 1.51k

williamliao/Qwen3.6-27B-Unsloth-NVFP4-Experimental-GGUF

Text Generation • 27B • Updated 14 days ago • 4.92k • 1

avlp12/GLM-5.2-Alis-MLX-Dynamic-2.3bpw

Text Generation • 743B • Updated 19 days ago • 1.98k

rdtand/Hy3-295B-A21B-PrismaQuant-2.8bit-gguf-vllm

295B • Updated 23 days ago • 5.7k • 2

tcclaviger/Tess-27B-RFI

Image-Text-to-Text • 20B • Updated 22 days ago • 96 • 1

rdtand/Hy3-295B-A21B-PrismaQuant-5.3bit-2xSpark-vllm

194B • Updated 22 days ago • 1.5k • 1

programmer-666/Ornith-1.0-35B-oQ8e

Text Generation • 10B • Updated 21 days ago • 428

MaliAir/GLM-5.2-MXFP4-MOE-Q8_0-GGUF

754B • Updated 8 days ago • 821 • 2