Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,177

Base only

Active filters: mlx

atarayosd/RakutenAI-2.0-mini-instruct

2B • Updated Feb 12, 2025 • 11

asjoberg/Qwen2.5-1.5B-Instruct-predli

Text Generation • 0.2B • Updated Feb 12, 2025 • 6

asjoberg/Qwen2.5-1.5B-Instruct-predli-finetuned-fused

Text Generation • 2B • Updated Feb 12, 2025 • 6

ivanfioravanti/Qwen2.5-7B-Instruct-italian-wine-fp16

Text Generation • 8B • Updated Feb 12, 2025 • 7

GreenBitAI/DeepSeek-R1-Distill-Qwen-32B-layer-mix-bpw-4.0-mlx

6B • Updated Feb 18, 2025 • 6

mradermacher/RakutenAI-2.0-mini-instruct-GGUF

2B • Updated Jul 31, 2025 • 51

bestler/Code-Summary-Model-Llama-3.1-8B-Instruct-4bit-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 20

mlx-community/Saka-14B-4bit

Text Generation • 2B • Updated Feb 12, 2025 • 13 • 2

driaforall/Tiny-Agent-a-0.5B-Q8-mlx

0.1B • Updated Feb 12, 2025 • 29 • 3

mlx-community/SmolVLM2-2.2B-Instruct-mlx

Image-Text-to-Text • 2B • Updated Feb 20, 2025 • 318 • 8

AlejandroOlmedo/DeepScaleR-1.5B-Preview-8bit-mlx

Text Generation • 0.5B • Updated Feb 23, 2025 • 17 • 2

isaiahbjork/web-grounding-347M-mlx

Image-Text-to-Text • 0.3B • Updated Feb 12, 2025 • 16

AlejandroOlmedo/DeepScaleR-1.5B-Preview-6bit-mlx

Text Generation • 0.4B • Updated Feb 17, 2025 • 7

AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx

Text Generation • 0.3B • Updated Feb 16, 2025 • 8

mlx-community/simplescaling-s1.1-32B-fp32

Text Generation • 33B • Updated Feb 16, 2025 • 7

mlx-community/SmolVLM2-500M-Video-Instruct-mlx

Video-Text-to-Text • 0.5B • Updated Feb 20, 2025 • 1.98k • 18

moot20/DeepScaleR-1.5B-Preview-MLX-4bits

Text Generation • 0.3B • Updated Feb 12, 2025 • 8

moot20/DeepScaleR-1.5B-Preview-MLX-6bits

Text Generation • 0.4B • Updated Feb 12, 2025 • 5

isaiahbjork/web-grounding-2b-mlx

Image-Text-to-Text • 2B • Updated Feb 12, 2025 • 5

mlx-community/simplescaling-s1.1-32B-fp16

Text Generation • 33B • Updated Feb 16, 2025 • 5

moot20/DeepScaleR-1.5B-Preview-MLX-8bits

Text Generation • 0.5B • Updated Feb 13, 2025 • 6

mlx-community/simplescaling-s1.1-32B-8bit

Text Generation • 9B • Updated Feb 16, 2025 • 5 • 1

mlx-community/simplescaling-s1.1-32B-6bit

Text Generation • 7B • Updated Feb 16, 2025 • 10

mlx-community/simplescaling-s1.1-32B-4bit

Text Generation • 5B • Updated Feb 16, 2025 • 5

TheBlueObserver/HuatuoGPT-o1-7B-MLX

Text Generation • 8B • Updated Feb 12, 2025 • 7

TheBlueObserver/HuatuoGPT-o1-7B-MLX-393a7

Text Generation • 2B • Updated Feb 13, 2025 • 5

mlx-community/bigcode-starcoder2-15b-fp32

Text Generation • 16B • Updated Feb 16, 2025 • 24

mlx-community/bigcode-starcoder2-15b-fp16

Text Generation • 16B • Updated Feb 16, 2025 • 16

mlx-community/bigcode-starcoder2-15b-8bit

Text Generation • 4B • Updated Feb 16, 2025 • 21

mlx-community/bigcode-starcoder2-15b-6bit

Text Generation • 3B • Updated Feb 16, 2025 • 20