Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,655

Base only

Active filters: mlx

mingineer/Qwen2.5-Coder-7B-Instruct-Q4-mlx

Text Generation • 1B • Updated Nov 1, 2024 • 55

mlx-community/SmolLM2-135M-Instruct-8bit

Text Generation • 37.9M • Updated Nov 1, 2024 • 194 • 1

GreenBitAI/Qwen-2.5-72B-Instruct-layer-mix-bpw-4.0-mlx

12B • Updated Nov 4, 2024 • 17

shanginn/Luminum-v0.1-123B-mlx-quantized-2bit

Text Generation • 11B • Updated Nov 4, 2024 • 11

dattaraj/smol-lora-insurance-estimates

Text Generation • 2B • Updated Nov 5, 2024 • 11

apple/aimv2-large-patch14-224-distilled

Image Feature Extraction • 0.3B • Updated Jul 8, 2025 • 23 • 2

rizalhilman/wikisql-4bit-1k

Text Generation • 1B • Updated Nov 5, 2024 • 5

NbAiLab/nb-bert-base-pos

Token Classification • 0.2B • Updated Nov 6, 2024 • 27

mlx-community/Yi-6B-Chat-4bit

Text Generation • 0.9B • Updated Nov 5, 2024 • 11

mlx-community/Yi-6B-Chat-8bit

Text Generation • 2B • Updated Nov 5, 2024 • 9

cnfusion/Rombos-LLM-V2.5-Qwen-32b-Q4-mlx

Text Generation • 5B • Updated Nov 6, 2024 • 11

IntuitIntel/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 13

mlx-community/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 61 • 2

vrglx33/TinyLlama-1.1B-32k-Instruct-mlx

Text Generation • 0.2B • Updated Nov 7, 2024 • 10

RohitPoreddy/Llama-3.1-Nemotron-70B-Instruct-HF-Q4-mlx

Text Generation • 11B • Updated Nov 7, 2024 • 25

mlx-community/Meta-Llama-3.1-8B-Instruct-4bit-fakenews

Text Generation • 1B • Updated Nov 7, 2024 • 20

mlx-community/Qwen2.5.1-Coder-7B-Instruct-4bit

Text Generation • 1B • Updated Nov 9, 2024 • 671 • 9

mlx-community/Qwen2.5.1-Coder-7B-Instruct-8bit

Text Generation • 2B • Updated Nov 9, 2024 • 157 • 3

NewEden-Forge/magnum-v2-4b-Q8-mlx

Text Generation • 1B • Updated Nov 8, 2024 • 27

mlx-community/suzume-llama-3-8B-multilingual

1B • Updated Nov 8, 2024 • 8

stelterlab/SauerkrautLM-v2-14b-SFT-MLX-4bit

2B • Updated Nov 9, 2024 • 14

stelterlab/SauerkrautLM-v2-14b-SFT-MLX-8bit

4B • Updated Nov 9, 2024 • 15

synk/L3-8B-Stheno-v3.2-MLX

1B • Updated Nov 10, 2024 • 234

mlx-community/Meta-Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 10, 2024 • 45 • 1

zachaman/phi35mini_mlx

Text Generation • 0.6B • Updated Nov 10, 2024 • 15 • 1

synk/8B-Stheno-Diverse-v3.2-MLX

1B • Updated Nov 10, 2024 • 54

d4n33l/qwen2.5-coder-1.5b-it-pii

Text Generation • 2B • Updated Nov 11, 2024

TeunS/Geert

Text Generation • 3B • Updated Nov 13, 2024 • 46 •

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.2-4bit

Text Generation • 1B • Updated Nov 11, 2024 • 6

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.2-8bit

Text Generation • 2B • Updated Nov 11, 2024 • 12