Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,211

Base only

Active filters: 3-bit

dangerusslee/FastApply-7B-v1.0-mlx-3Bit

Text Generation • 1.0B • Updated Mar 2 • 7

fifrio/Qwen3-8B-gptq-3bit-calibration-English-128samples

8B • Updated Mar 2 • 3

fifrio/Qwen3-8B-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 2 • 2

fifrio/Qwen3-8B-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 2 • 3

fifrio/Qwen3-8B-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 2 • 2

fifrio/Qwen3-8B-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 2 • 6

mlx-community/Qwen3.5-0.8B-3bit

0.2B • Updated Mar 2 • 16

mlx-community/Qwen3.5-2B-3bit

0.6B • Updated Mar 2 • 28

mlx-community/Qwen3.5-4B-3bit

0.9B • Updated Mar 2 • 52

andrevp/Qwen3.5-35B-A3B-MLX-VLM-3bit

Image-Text-to-Text • 5B • Updated Mar 3 • 215 • 3

MaziyarPanahi/LocoOperator-4B-GGUF

Text Generation • 4B • Updated Mar 3 • 49 • 1

krzonkalla/test-quant-mlx-rio-mini

Image-Text-to-Text • 5B • Updated Mar 4 • 5

fifrio/aya-expanse-8b-gptq-3bit-calibration-English-128samples

8B • Updated Mar 5

fifrio/aya-expanse-8b-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 3

fifrio/aya-expanse-8b-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 1

fifrio/aya-expanse-8b-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 5

fifrio/aya-expanse-8b-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 5

Evrmind/EVR-1-Maano-8b

Text Generation • 5B • Updated Mar 13 • 15

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-English-128samples

8B • Updated Mar 5

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 1

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 5

RepublicOfKorokke/Qwen3.5-27B-mlx-lm-3bit

Text Generation • 27B • Updated Mar 8 • 50 • 1

duolaf/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Mar 9 • 38

mlx-community/Gemma-SEA-LION-v4-4B-VL-mlx-3bit

Image-Text-to-Text • 1.0B • Updated Mar 10 • 22

alankessler/Mistral-Nemo-Instruct-2407-MLX-3bit

2B • Updated Mar 11 • 32

alankessler/Mistral-Small-3.2-24B-Instruct-2506-MLX-3bit

24B • Updated Mar 11 • 33

MetaphoricalCode/Qwen3.5-27B-heretic-v2-exl3-3bpw-hb6

Text Generation • 7B • Updated Mar 12 • 9 • 1

Evrmind/EVR-1-Maano-8b-Instruct

Text Generation • 5B • Updated Mar 13 • 1