Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,962

Base only

Active filters: mlx

Beygo/Marco-o1-Q8-mlx

Text Generation • 2B • Updated Nov 25, 2024 • 6

mlx-community/Llama-3.1-Tulu-3-8B-8bit

Text Generation • 2B • Updated Nov 25, 2024 • 20 • 1

litmudoc/Qwen2.5-Coder-32B-Instruct-Q4-mlx

Text Generation • 5B • Updated Nov 25, 2024 • 28

dwdcth/Homer-v0.5-Qwen2.5-7B-Q4-mlx

1B • Updated Nov 25, 2024 • 17

CuckmeisterFuller/Marco-o1-Q4-mlx

Text Generation • 1B • Updated Nov 25, 2024 • 12

base16/Llama-3.2-1B-Instruct-4bit

Text Generation • 0.2B • Updated Nov 26, 2024 • 18 • 1

HawkonLi/Hunyuan-A52B-Instruct-2bit

Text Generation • 30B • Updated Nov 26, 2024 • 14 • 1

tensorblock/Qwen2.5-Coder-32B-Instruct-bf16-GGUF

Text Generation • 33B • Updated Jan 27 • 81 • 1

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-MLX_4bit

Text Generation • 0.2B • Updated Nov 26, 2024 • 22 • 1

Vikhrmodels/Vikhr-Qwen-2.5-1.5B-Instruct-MLX_8bit

Text Generation • 0.4B • Updated Nov 26, 2024 • 61 • 8

enikeev/Cotype-Nano-MLX

Text Generation • 2B • Updated Nov 26, 2024 • 3 • 1

mlx-community/SmolVLM-Instruct-4bit

Image-Text-to-Text • Updated Nov 29, 2024 • 364 • 5

mlx-community/SmolVLM-Instruct-6bit

Image-Text-to-Text • Updated Nov 29, 2024 • 10

mlx-community/SmolVLM-Instruct-8bit

Image-Text-to-Text • Updated Nov 29, 2024 • 33 • 9

mlx-community/SmolVLM-Instruct-bf16

Image-Text-to-Text • Updated Nov 29, 2024 • 47 • 5

mlx-community/Idefics3-8B-Llama3-bf16

Image-Text-to-Text • 8B • Updated Jan 30, 2025 • 7

mlx-community/numind-NuExtract-1.5-MLX-8bit

Text Generation • Updated Nov 27, 2024 • 52 • 2

mlx-community/numind-NuExtract-1.5-MLX-4bit

Text Generation • Updated Nov 27, 2024 • 43 • 2

mlx-community/AIDC-AI_Marco-o1_MLX-4bit

Text Generation • Updated Nov 27, 2024 • 18 • 1

mlx-community/AIDC-AI_Marco-o1_MLX-8bit

Text Generation • Updated Nov 27, 2024 • 7

HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx

Text Generation • 0.5B • Updated Nov 27, 2024 • 205 • 5

HuggingFaceTB/SmolLM2-360M-Instruct-Q8-mlx

Text Generation • 0.1B • Updated Nov 27, 2024 • 72 • 1

HuggingFaceTB/SmolLM2-135M-Instruct-Q8-mlx

Text Generation • 37.9M • Updated Nov 27, 2024 • 135 • 2

mlx-community/OLMo-2-1124-7B-Instruct-4bit

Text Generation • Updated Nov 27, 2024 • 79

mlx-community/OLMo-2-1124-7B-Instruct-8bit

Text Generation • Updated Nov 27, 2024 • 11

mlx-community/OLMo-2-1124-7B-Instruct-6bit

Text Generation • Updated Nov 27, 2024 • 7

mlx-community/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 38 • 3

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated Nov 28, 2024 • 31 • 5

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated Nov 27, 2024 • 32 • 4

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 47 • 6