Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,720

Base only

Active filters: 2-bit

Christ9038/Qwen3.5-4B-unsloth-MLX-oQ2

0.8B • Updated Mar 24 • 88

daslab-testing/Kimi-K2.5-2bit-GSQ

1T • Updated Mar 24 • 12

Hunterx/Qwen3.5-40B-RoughHouse-Claude-4.6-Opus-oQ2BENCHMARKED

Text Generation • 5B • Updated Mar 28 • 32

Brooooooklyn/Qwen3.5-35B-A3B-UD-Q2_K_XL-mlx

Text Generation • 4B • Updated Mar 29 • 52

Brooooooklyn/Qwen3.5-9B-UD-Q2_K_XL-mlx

Text Generation • 2B • Updated Mar 29 • 27

Brooooooklyn/Qwen3.5-27B-UD-Q2_K_XL-mlx

Text Generation • 6B • Updated Mar 29 • 21

mobbitxt/Anubis-Mini-8B-v1-mlx-oQ2

0.9B • Updated Mar 30 • 8

Bo-Jack/Qwen3-8B-mixed-2-6-mlx

Text Generation • 1.0B • Updated Mar 31 • 4

Bo-Jack/Qwen3-8B-2bit-mlx

Text Generation • 0.8B • Updated Mar 31 • 1

e3cola/Qwen3.5-122B-A10B-oQ2

13B • Updated Mar 31 • 45 • 1

inferencerlabs/Bonsai-8B-MLX-Q2.25

Text Generation • 0.6B • Updated Apr 2 • 145 • 4

inferencerlabs/Bonsai-4B-MLX-Q2.25

Text Generation • 0.3B • Updated Apr 2 • 36 • 2

UnstableLlama/Qwen3.5-4B-exl3-2.00bpw

2B • Updated Apr 4 • 1

UnstableLlama/Qwen3.5-27B-exl3-2.00bpw

5B • Updated Apr 4 • 1

wolfofbackstreet/gemma-4-e4b-it-oQ2

0.3B • Updated Apr 8 • 8

avlp12/GLM-5.1-Alis-MLX-Dynamic-2.7bpw

Text Generation • 744B • Updated 1 day ago • 587 • 3

spicyneuron/GLM-5.1-MLX-2.9bit

Text Generation • 744B • Updated Jun 2 • 644 • 2

minion1905/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 9 • 105

avlp12/Qwen3.5-35B-A3B-Alis-MLX-Dynamic-2.6bpw

Text Generation • 35B • Updated 1 day ago • 132 • 1

zecanard/gemma-4-31B-it-uncensored-abliterix-MLX-2bit-int2-affine

Image-Text-to-Text • 8B • Updated Apr 15 • 91 • 1

bearzi/Qwen3-Coder-Next-oQ2

Text Generation • 8B • Updated Apr 15 • 224 • 2

zecanard/gemma-4-31B-it-Claude-Opus-Distilled-MLX-2bit-int2-affine

Image-Text-to-Text • 8B • Updated Apr 15 • 34 • 1

zecanard/Qwen3.5-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-MLX-2bit-int2-affine

Image-Text-to-Text • 5B • Updated Apr 15 • 233 • 3

avlp12/Qwen3.5-35B-A3B-Alis-MLX-Dynamic-2.6bpw-VLM

Image-Text-to-Text • 4B • Updated 1 day ago • 114

kennedyian94/Llama-3.2-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 77 • 1

kennedyian94/Qwen-2.5-3B-AQLM-OA-EM-2Bit-2x8

Text Generation • 1B • Updated 27 days ago • 132 • 1

kennedyian94/Llama-3.1-8B-AQLM-OA-EM-2Bit-2x8

Text Generation • Updated Apr 14 • 61 • 1

majentik/Qwen3.5-27B-TurboQuant-MLX-2bit

Text Generation • 27B • Updated 1 day ago • 172

majentik/Qwen3.5-27B-RotorQuant-MLX-2bit

Text Generation • 27B • Updated 1 day ago • 176

majentik/Mistral-Small-4-119B-TurboQuant-MLX-2bit

Text Generation • 12B • Updated 1 day ago • 296 • 1