Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,869

Base only

Active filters: mlx

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.3-8bit

Text Generation • 2B • Updated Dec 23, 2024 • 9

mlx-community/Llama-3.1-Swallow-8B-Instruct-v0.3-4bit

Text Generation • 1B • Updated Dec 23, 2024 • 343

ljnlonoljpiljm/florence-2-base-test-od-ft-mlx

Image-Text-to-Text • 0.3B • Updated Dec 23, 2024 • 10

TheBlueObserver/Qwen2.5-Coder-32B-Instruct-MLX-8777b

Text Generation • 7B • Updated Dec 23, 2024 • 15

TheBlueObserver/Qwen2.5-Coder-32B-Instruct-MLX-393a7

Text Generation • 9B • Updated Dec 24, 2024 • 11

reach-vb/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • 61.8M • Updated Dec 24, 2024 • 5

mlx-community/QVQ-72B-Preview-4bit

Image-Text-to-Text • Updated Apr 12, 2025 • 25 • 7

mlx-community/QVQ-72B-Preview-3bit

Image-Text-to-Text • Updated Dec 24, 2024 • 9 • 5

mlx-community/QVQ-72B-Preview-6bit

Image-Text-to-Text • Updated Dec 24, 2024 • 15 • 2

mlx-community/QVQ-72B-Preview-8bit

Image-Text-to-Text • Updated Dec 24, 2024 • 10 • 3

mlx-community/QVQ-72B-Preview-bf16

Image-Text-to-Text • Updated Dec 24, 2024 • 9 • 3

BillSYZhang/gte-Qwen2-7B-instruct-Q4-mlx

Sentence Similarity • 1B • Updated Dec 24, 2024 • 45

mradermacher/Mia-1B-GGUF

1B • Updated Dec 24, 2024 • 35

cnfusion/Microsoft_Phi-4-mlx-6bit

Text Generation • 3B • Updated Jan 13, 2025 • 22

qkC8KADS/QWQ-Rombos-ties-TEST2-mlx_4

Text Generation • 5B • Updated Dec 25, 2024 • 7

ubaitur5/Qwen2.5-0.5B-Instruct-Q3-mlx

Text Generation • Updated May 1, 2025 • 26

mlx-community/Qwen2.5-14B-Instruct-3bit

Text Generation • Updated Apr 28, 2025 • 58 • 1

mlx-community/nanoLLaVA-1.5-3bit

Updated Dec 26, 2024 • 7

mlx-community/nanoLLaVA-1.5-6bit

Updated Dec 26, 2024 • 5

ljnlonoljpiljm/florence-2-base-ft-objects-mlx

Image-Text-to-Text • 0.3B • Updated Dec 26, 2024 • 14

CuckmeisterFuller/Hermes-3-Llama-3.2-3B-Q4-mlx

Text Generation • 0.5B • Updated Dec 27, 2024 • 60 • 1

GreenBitAI/Llama-3.2-3B-Instruct-layer-mix-bpw-4.0-mlx

0.8B • Updated Dec 27, 2024 • 3

eamag/f5-tts-mlx-german

Text-to-Speech • Updated Jan 18, 2025 • 114

ubaitur5/Qwen2.5-Coder-7B-Instruct-Q3-mlx

Text Generation • Updated Dec 30, 2024 • 24

ljnlonoljpiljm/florence-2-base-regions-mlx

Image-Text-to-Text • 0.3B • Updated Feb 7, 2025 • 12

alexander583/Falcon3-7B-Instruct-Q4-mlx

Text Generation • 1B • Updated Dec 30, 2024 • 6

alexander583/EXAONE-3.5-7.8B-Instruct-Q4-mlx

Text Generation • 1B • Updated Dec 31, 2024 • 22

alexander583/EXAONE-3.5-32B-Instruct-Q4-mlx

Text Generation • 5B • Updated Dec 31, 2024 • 12

smdesai/paligemma-3b-mix-448-6bit

Image-Text-to-Text • 0.7B • Updated Jan 1, 2025 • 3

smdesai/paligemma2-3b-pt-448-4bit

Image-Text-to-Text • 0.6B • Updated Jan 2, 2025 • 6