Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

15,978

Base only

Active filters: mlx

mlx-community/Virtuoso-Small-8bit

Updated Dec 11, 2024 • 6

mlx-community/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-4-bit

Text Generation • 2B • Updated Dec 11, 2024 • 81 • 1

mlx-community/Virtuoso-Small-4bit

Updated Dec 11, 2024 • 9

mlx-community/QwQ-32B-Coder-Fusion-9010-4bit

Text Generation • Updated Dec 11, 2024 • 22 • 1

mlx-community/DeepSeek-V2.5-1210-3bit

Text Generation • 30B • Updated Dec 11, 2024 • 40 • 2

rudrankriyam/hermes-3-llama-3.2-3b

Text Generation • 0.5B • Updated Dec 11, 2024 • 40 • 1

mlx-community/Hermes-3-Llama-3.2-3B-4bit

Text Generation • 0.5B • Updated Dec 11, 2024 • 272 • 1

mlx-community/Hermes-3-Llama-3.2-3B-8bit

Text Generation • 0.9B • Updated Dec 11, 2024 • 89 • 1

mlx-community/Hermes-3-Llama-3.2-3B-bf16

Text Generation • 3B • Updated Dec 11, 2024 • 38

testmoto/gemma-2-9b-lora-aozora

Text Generation • 9B • Updated Dec 12, 2024 • 8

testmoto/gemma-2-9b-platypus-02

Text Generation • 9B • Updated Dec 13, 2024 • 5

TheBlueObserver/Qwen2.5-1.5B-Instruct-4bit-128-GPTQ-MLX-LinearOnly

Text Generation • 0.4B • Updated Dec 13, 2024 • 36

TheBlueObserver/Qwen2.5-1.5B-Instruct

Text Generation • 0.4B • Updated Dec 13, 2024 • 5

casale-xyz/codestral-vit-mlx

Updated Dec 13, 2024

mlx-community/Hermes-3-Llama-3.1-8B-3bit

1B • Updated Dec 13, 2024 • 43

mlx-community/Hermes-2-Pro-Mistral-7B-3bit

0.9B • Updated Dec 14, 2024 • 55 • 1

mlx-community/Qwen2.5-7B-Instruct-3bit

Text Generation • Updated Dec 14, 2024 • 26

testmoto/gemma-2-9b-tengentoppa-02

Text Generation • 9B • Updated Dec 14, 2024 • 5

mlx-community/CausalLM-35b-beta-long-4bit

Updated Dec 14, 2024 • 14

mlx-community/Qwen2.5-Coder-7B-Instruct-3bit

Text Generation • Updated Dec 14, 2024 • 69

mlx-community/CausalLM-34b-beta-4bit

Updated Dec 14, 2024 • 25 • 1

shanginn/EVA-UNIT-01-EVA-LLaMA-3.33-70B-v0.0-q4

Text Generation • 11B • Updated Dec 14, 2024 • 27

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX

Text Generation • 2B • Updated Dec 14, 2024 • 2

TheBlueObserver/Qwen2.5-1.5B-Instruct-MLX-7dd7f

Text Generation • 0.4B • Updated Dec 15, 2024 • 4

testmoto/gemma-2-9b-jglue_jssts

Text Generation • 9B • Updated Dec 14, 2024 • 8

TobDeBer/Everyone-Coder-4x7b-Base-Q4-mlx

4B • Updated Dec 14, 2024 • 31 • 1

TobDeBer/arco-Q4-mlx

80.3M • Updated Dec 14, 2024 • 4

mlx-community/magnum-v3-34b-4bit

Text Generation • Updated Dec 14, 2024 • 54

mlx-community/magnum-v4-72b-4bit

Text Generation • Updated Dec 14, 2024 • 498 • 1

testmoto/gemma-2-9b-synthetic_coding

Text Generation • 9B • Updated Dec 15, 2024 • 289 •