Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,236

Base only

Active filters: mlx

mlx-community/SakanaAI-EvoLLM-JP-v1-7B-4bit

Text Generation • Updated Oct 31, 2024 • 34

andito/mlx_summarization

Text Generation • 2B • Updated Oct 31, 2024 • 25 • 1

cchance27/CalmeRys-78B-Orpo-v0.1-Q4-mlx

Text Generation • 12B • Updated Oct 31, 2024 • 7

mlx-community/SmolLM2-1.7B-Instruct

Text Generation • Updated Oct 31, 2024 • 208 • 4

mlx-community/SmolLM2-360M-Instruct

Text Generation • Updated Oct 31, 2024 • 153 • 1

mlx-community/SmolLM2-135M-Instruct

Text Generation • Updated Oct 31, 2024 • 989

mingineer/Qwen2.5-Coder-7B-Instruct-Q4-mlx

Text Generation • 1B • Updated Nov 1, 2024 • 58

mlx-community/SmolLM2-135M-Instruct-8bit

Text Generation • Updated Nov 1, 2024 • 64 • 1

GreenBitAI/Qwen-2.5-72B-Instruct-layer-mix-bpw-4.0-mlx

12B • Updated Nov 4, 2024 • 15

shanginn/Luminum-v0.1-123B-mlx-quantized-2bit

Text Generation • 11B • Updated Nov 4, 2024 • 10

dattaraj/smol-lora-insurance-estimates

Text Generation • 2B • Updated Nov 5, 2024 • 15

apple/aimv2-large-patch14-224-distilled

Image Feature Extraction • 0.3B • Updated Jul 8, 2025 • 55 • 2

rizalhilman/wikisql-4bit-1k

Text Generation • 1B • Updated Nov 5, 2024 • 4

NbAiLab/nb-bert-base-pos

Token Classification • 0.2B • Updated Nov 6, 2024 • 44

mlx-community/Yi-6B-Chat-4bit

Text Generation • Updated Nov 5, 2024 • 19

mlx-community/Yi-6B-Chat-8bit

Text Generation • Updated Nov 5, 2024 • 14

cnfusion/Rombos-LLM-V2.5-Qwen-32b-Q4-mlx

Text Generation • 5B • Updated Nov 6, 2024 • 13

IntuitIntel/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 30

mlx-community/Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 6, 2024 • 78 • 2

vrglx33/TinyLlama-1.1B-32k-Instruct-mlx

Text Generation • 0.2B • Updated Nov 7, 2024 • 10

RohitPoreddy/Llama-3.1-Nemotron-70B-Instruct-HF-Q4-mlx

Text Generation • 11B • Updated Nov 7, 2024 • 15

mlx-community/Meta-Llama-3.1-8B-Instruct-4bit-fakenews

Text Generation • Updated Nov 7, 2024 • 41

mlx-community/Qwen2.5.1-Coder-7B-Instruct-8bit

Text Generation • Updated Nov 9, 2024 • 307 • 3

NewEden-Forge/magnum-v2-4b-Q8-mlx

Text Generation • 1B • Updated Nov 8, 2024 • 43

mlx-community/suzume-llama-3-8B-multilingual

Updated Nov 8, 2024 • 12

stelterlab/SauerkrautLM-v2-14b-SFT-MLX-4bit

2B • Updated Nov 9, 2024 • 16

stelterlab/SauerkrautLM-v2-14b-SFT-MLX-8bit

4B • Updated Nov 9, 2024 • 18

synk/L3-8B-Stheno-v3.2-MLX

1B • Updated Nov 10, 2024 • 169

mlx-community/Meta-Llama-3.1-405B-Instruct-8bit

Text Generation • 114B • Updated Nov 10, 2024 • 57 • 1

zachaman/phi35mini_mlx

Text Generation • 0.6B • Updated Nov 10, 2024 • 9 • 1