Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

380

Base only

Active filters: 8bit

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Jan 17 • 4

speakleash/Bielik-Minitron-7B-v3.0-Instruct-FP8-Dynamic

Text Generation • 7B • Updated Mar 30 • 26.5k • 1

SuperPauly/Gemmasutra_LiteRT-LM

Text Generation • Updated Feb 1 • 7

JongYeop/Qwen2.5-14B-Instruct-FP8-W8A8

Text Generation • 15B • Updated Feb 6 • 44

JEILDLWLRMA/Qwen3-VL-4B-Instruct-FP8-Dynamic

Image-to-Text • 5B • Updated Feb 7 • 35

safestack/Bielik-11B-v3.0-Instruct-FP8-Dynamic

Text Generation • 11B • Updated Jan 28 • 309

shieldstackllc/GLM-4.7-Flash-PRISM-mlx-8bit

Text Generation • 30B • Updated Feb 16 • 39

shieldstackllc/MiniMax-M2-5-REAP-39-mlx-8bit

Text Generation • 139B • Updated Feb 16 • 7

shieldstackllc/MiniMax-M2-5-REAP-19-mlx-8bit

Text Generation • 184B • Updated Feb 16 • 17

Al-hin/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated Feb 17 • 125

andrevp/Nanbeige4.1-3B-MLX-8bit

Text Generation • 1B • Updated Feb 17 • 5

ellamind/Voxtral-Mini-4B-Realtime-8bit-mlx

Automatic Speech Recognition • 1B • Updated Feb 20 • 27 • 2

prithivMLmods/FireRed-Image-Edit-1.0-8bit

Image-to-Image • Updated Feb 21 • 67 • 4

illitan/Qwen3-ASR-1.7B-Q8

Automatic Speech Recognition • Updated Feb 22 • 36 • 1

gumush/turkish-finance-llama3.1-8b-mlx-8bit

Text Generation • 8B • Updated Feb 23 • 34

tocchitocchi/Qwen3-Swallow-30B-A3B-SFT-v0.2-MLX-8bit

Text Generation • 31B • Updated Feb 24 • 23

mlx-community/Qwen3.5-27B-heretic-8bit

Image-Text-to-Text • 8B • Updated Feb 26 • 228 • 8

mlx-community/Qwen3.5-0.8B-MLX-8bit

0.3B • Updated Mar 2 • 505 • 4

mlx-community/Qwen3.5-2B-MLX-8bit

0.9B • Updated Mar 2 • 1.58k • 7

mlx-community/Qwen3.5-4B-MLX-8bit

2B • Updated Mar 2 • 1.63k • 13

mlx-community/Qwen3.5-9B-MLX-8bit

3B • Updated Mar 2 • 981 • 12

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated about 16 hours ago • 2.29k • 11

aufklarer/Qwen3-ForcedAligner-0.6B-8bit

Audio Classification • 0.5B • Updated Apr 12 • 44

henrybravo/Qwen3.5-35B-A3B-8bit

Image-Text-to-Text • 10B • Updated Mar 12 • 7

Balta10/fire

Image-to-Image • Updated Mar 11 • 1

machinadeusex/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated Mar 14 • 58 • 1

AITRADER/Amsi-fin-o1.5-mxfp8-MLX

Image-Text-to-Text • 3B • Updated Mar 16 • 7 • 1

vanch007/Huihui-Qwen3.5-9B-abliterated-mlx-8bit

Image-Text-to-Text • 3B • Updated Mar 18 • 154 • 1

TheCluster/Crow-9B-HERETIC-4.6-MLX-8bit

Image-Text-to-Text • 9B • Updated Mar 17 • 17

TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-8bit

Image-Text-to-Text • 9B • Updated Mar 17 • 712 • 3