Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,289

Base only

Active filters: mlx

mlx-community/calm3-22b-chat-4bit

Updated Jul 9, 2024 • 26 • 2

owen198/3cm

Text Generation • 1B • Updated Jul 29, 2024 • 613

mlx-community/Maxine-34B-stock

Text Generation • 6B • Updated Jul 10, 2024 • 38 • 1

mlx-community/Pearl-7B

Text Generation • Updated Jul 11, 2024 • 16

mlx-community/ArliAI-Llama-3-8B-Formax-v1.0-8bit

Updated Jul 11, 2024 • 8

mlx-community/prometheus-7b-v2.0-8bit

Text Generation • Updated Sep 4, 2024 • 39

shellzero/gemma-7b-it-ft-trismeg

Text Generation • Updated Jul 16, 2024 • 8

mlx-community/NeuralDaredevil-8B-abliterated-4bit

Updated Jul 13, 2024 • 78 • 1

cmcmaster/Qwen2-1.5B-Instruct-rheum-pretrain-mlx-4bit

0.2B • Updated Jul 14, 2024 • 5

mlx-community/Gemma-2-9B-It-SPPO-Iter3-4bit

Text Generation • 1B • Updated Jul 16, 2024 • 47 • 1

RiTA-nlp/llama3-tweety-8b-italian-mlx-4bit

Text Generation • 1B • Updated Jul 16, 2024 • 16

mlx-community/DeepSeek-V2-Lite-Chat-4bit-mlx

2B • Updated Jul 16, 2024 • 599 • 1

mlx-community/mathstral-7B-v0.1-4bit

Updated Jul 16, 2024 • 27

mlx-community/mathstral-7B-v0.1-8bit

Updated Jul 16, 2024 • 15

mlx-community/mathstral-7B-v0.1-fp16

Updated Jul 16, 2024 • 32 • 1

mlx-community/SmolLM-135M-4bit

Text Generation • Updated Jul 16, 2024 • 163 • 2

mlx-community/SmolLM-135M-8bit

Text Generation • Updated Jul 16, 2024 • 27

mlx-community/SmolLM-135M-fp16

Text Generation • Updated Jul 16, 2024 • 35 • 1

mlx-community/SmolLM-360M-4bit

Text Generation • Updated Jul 16, 2024 • 38

mlx-community/SmolLM-360M-8bit

Text Generation • Updated Jul 16, 2024 • 24

mlx-community/SmolLM-360M-fp16

Text Generation • Updated Jul 16, 2024 • 30

mlx-community/SmolLM-1.7B-4bit

Text Generation • Updated Jul 16, 2024 • 28 • 1

mlx-community/SmolLM-1.7B-8bit

Text Generation • Updated Jul 16, 2024 • 27

mlx-community/SmolLM-1.7B-fp16

Text Generation • Updated Jul 16, 2024 • 24 • 1

mlx-community/SmolLM-1.7B-Instruct-fp16

Text Generation • Updated Jul 16, 2024 • 24 • 1

mlx-community/SmolLM-1.7B-Instruct-4bit

Text Generation • Updated Jul 16, 2024 • 96 • 2

mlx-community/SmolLM-1.7B-Instruct-8bit

Text Generation • Updated Jul 16, 2024 • 23 • 1

mlx-community/SmolLM-360M-Instruct-8bit

Text Generation • Updated Jul 16, 2024 • 51 • 2

mlx-community/SmolLM-360M-Instruct-4bit

Text Generation • Updated Jul 16, 2024 • 81

mlx-community/SmolLM-360M-Instruct-fp16

Text Generation • Updated Jul 16, 2024 • 38 • 1