Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,470

Base only

Active filters: 3-bit

fifrio/aya-expanse-8b-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 4

fifrio/aya-expanse-8b-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 3

fifrio/aya-expanse-8b-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 4

fifrio/aya-expanse-8b-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 5 • 4

Evrmind/EVR-1-Maano-8b

Text Generation • 5B • Updated Mar 13 • 105

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-English-128samples

8B • Updated Mar 5 • 6

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 5

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 5

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 4

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 5 • 6

RepublicOfKorokke/Qwen3.5-27B-mlx-lm-3bit

Text Generation • 27B • Updated Mar 8 • 24 • 1

duolaf/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Mar 9 • 58

mlx-community/Gemma-SEA-LION-v4-4B-VL-mlx-3bit

Image-Text-to-Text • 1.0B • Updated Mar 10 • 15

alankessler/Mistral-Nemo-Instruct-2407-MLX-3bit

2B • Updated Mar 11 • 29

alankessler/Mistral-Small-3.2-24B-Instruct-2506-MLX-3bit

24B • Updated Mar 11 • 18

MetaphoricalCode/Qwen3.5-27B-heretic-v2-exl3-3bpw-hb6

Text Generation • 7B • Updated Mar 12 • 11 • 1

Evrmind/EVR-1-Maano-8b-Instruct

Text Generation • 5B • Updated Mar 13 • 5

Evrmind/EVR-1-Bafethu-8b-Reasoning

Text Generation • 5B • Updated Mar 13 • 6

telvenes/Qwen-3.5-35B-A3B-3bit-Norsk-1024

33B • Updated Mar 14 • 6

MoringLabs/Qwen3.5-122B-A10B-MLX-3.7bit-VL

Image-Text-to-Text • 16B • Updated Apr 5 • 242

MoringLabs/GPT-OSS-120B-MLX-3.6bit

Text Generation • 117B • Updated Mar 18 • 60

telvenes/Qwen3.5-27B-abliterated-GPTQ-3bit

25B • Updated Mar 16 • 10

MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit

Text Generation • 121B • Updated Mar 18 • 541 • 7

Brooooooklyn/Qwen3.5-9B-unsloth-mlx

Text Generation • 2B • Updated Mar 24 • 409 • 12

crazyartgeneration/RP-Spectrum-24B-mlx-3Bit

Text Generation • 24B • Updated Mar 19 • 25

ykarout/Qwen3.5-27B-exl3-3.0bpw

Image-Text-to-Text • 7B • Updated Mar 20 • 17 • 2

agustim/ALIA-40b-GPTQ-INT4_3b

4B • Updated Mar 20 • 9

agustim/ALIA-40b-AutoRound-INT4_3b

4B • Updated Mar 20 • 6

spicyneuron/Qwen3.5-397B-A17B-MLX-3.5bit

Text Generation • 396B • Updated Apr 10 • 65

matthewdubois/GLM-OCR-3bit-mlx

Image-Text-to-Text • 0.2B • Updated Mar 23 • 21 • 1