Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,019

Base only

Active filters: 4bit

AutomatosX/AX-Qwen3-Embedding-8B-MLX-AXQ-4bit

Feature Extraction • 1B • Updated 3 days ago • 72

AutomatosX/AX-Qwen3-Coder-Next-MLX-AXQ-4bit

Text Generation • 14B • Updated 3 days ago • 83

mlx-community/Qwythos-27B-v1-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 6 days ago • 145

mlx-community/Mage-VL-OptiQ-4bit

Image-Text-to-Text • 0.9B • Updated 6 days ago • 60

underlotus/Qwen3.6-27B-Abliterated-Heretic-Uncensored-oQ4

Image-Text-to-Text • 5B • Updated 4 days ago • 231

underlotus/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ4-mtp

Image-Text-to-Text • 5B • Updated 4 days ago • 127

mlx-community/LFM2.5-350M-OptiQ-4bit

Text Generation • 76M • Updated 4 days ago • 48

mlx-community/LFM2.5-230M-OptiQ-4bit

Text Generation • 50.7M • Updated 4 days ago • 63

mlx-community/LFM2.5-1.2B-Instruct-OptiQ-4bit

Text Generation • 0.2B • Updated 4 days ago • 64

AutomatosX/AX-Qwen3-ASR-1.7B-MLX-AXQ-4bit

Automatic Speech Recognition • 0.6B • Updated 3 days ago • 16

AutomatosX/AX-Qwen3-VL-8B-Instruct-MLX-AXQ-4bit

Image-Text-to-Text • 2B • Updated 3 days ago • 23

mlx-community/LFM2.5-1.2B-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated 3 days ago • 13

mlx-community/LFM2.5-1.2B-JP-202606-OptiQ-4bit

Text Generation • 0.2B • Updated 3 days ago • 15

mlx-community/LFM2.5-2.6B-OptiQ-4bit

Text Generation • 0.5B • Updated 3 days ago • 22

mlx-community/Macaw-OptiQ-4bit

Text Generation • 0.5B • Updated 3 days ago • 15

mlx-community/Tiny-Pickle-v3-Coder-4bit

Text Generation • 5B • Updated 3 days ago • 13

mlx-community/BTL-4-OptiQ-4bit

Text Generation • 6B • Updated 2 days ago • 82

mlx-community/LFM2.5-8B-A1B-OptiQ-4bit

Text Generation • 1B • Updated 2 days ago • 21

squarelike/gemma4-writing-judge-half-range-e2-nf4

12B • Updated 2 days ago • 7

antgas/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated 2 days ago

sayhelloproton/Qwen3.5-4B-MLX-4bit-no-think

1.0B • Updated 2 days ago

mlx-community/DeepSeek-V4-Pro-Qwen3.5-4B-4bit

Image-Text-to-Text • 1.0B • Updated 1 day ago

mlx-community/DeepSeek-V4-Pro-Qwen3.5-9B-4bit

Image-Text-to-Text • 2B • Updated 1 day ago

tozp/BigBang-V1-mlx-4bit

Image-Text-to-Text • 5B • Updated 1 day ago

AutomatosX/AX-DeepSeek-V4-Flash-MLX-AXQ-4bit

Text Generation • 46B • Updated about 15 hours ago

AutomatosX/AX-Nemotron-3-Embed-1B-MLX-AXQ-4bit

Feature Extraction • 0.2B • Updated about 8 hours ago

AutomatosX/AX-Nemotron-3-Embed-8B-MLX-AXQ-4bit

Feature Extraction • 1B • Updated about 8 hours ago

AutomatosX/AX-Qwen3-Nemotron-32B-GenRM-Principle-MLX-AXQ-4bit

Text Generation • 6B • Updated about 8 hours ago

sayhelloproton/Qwen3.5-4B-MLX-4bit

1.0B • Updated about 1 hour ago