Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,895

Base only

Active filters: mlx

mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-8bit

13B • Updated Apr 27, 2024 • 67

alpsagility/wikisql-4bit-1k

Text Generation • 1B • Updated Apr 27, 2024 • 4

mlx-community/dolphin-2.9-llama3-8b-256-4bit

1B • Updated Apr 28, 2024 • 10 • 1

mlx-community/dolphin-2.9-llama3-8b-256-8bit

2B • Updated Apr 28, 2024 • 15 • 2

GreenBitAI/Llama-3-8B-layer-mix-bpw-4.0-mlx

2B • Updated Apr 29, 2024 • 8

GreenBitAI/Llama-3-8B-instruct-layer-mix-bpw-4.0-mlx

2B • Updated Apr 29, 2024 • 5

mlx-community/Llama-3-8B-Instruct-1048k-4bit

Text Generation • 1B • Updated Apr 29, 2024 • 504 • 25

mlx-community/Llama-3-8B-Instruct-1048k-8bit

Text Generation • 2B • Updated Apr 29, 2024 • 175 • 17

mlx-community/starcoder2-15b-instruct-v0.1-4bit

Text Generation • 2B • Updated Apr 29, 2024 • 92

mlx-community/starcoder2-15b-instruct-v0.1-8bit

Text Generation • 4B • Updated Apr 30, 2024 • 21

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • 14B • Updated Apr 30, 2024 • 20

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • 14B • Updated Apr 30, 2024 • 11

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • 14B • Updated Apr 30, 2024 • 9

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • 4B • Updated Apr 30, 2024 • 12

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • 4B • Updated Apr 30, 2024 • 5

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • 4B • Updated Apr 30, 2024 • 7

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • 2B • Updated Apr 30, 2024 • 16

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • 2B • Updated Apr 30, 2024 • 8

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • 2B • Updated Apr 30, 2024 • 11

mlx-community/starcoder2-15b-instruct-v0.1

Text Generation • 16B • Updated Apr 30, 2024 • 25

mlx-community/Meta-Llama-3-70B-Instruct-mlx-unquantized

Text Generation • 71B • Updated Apr 30, 2024 • 12

batmac/Phi-3-mini-128k-instruct-mlx-8bit

Text Generation • 1B • Updated Apr 30, 2024 • 9

mlx-community/llava-phi-3-mini-4bit

0.7B • Updated Apr 30, 2024 • 112 • 9

batmac/Phi-3-mini-4k-instruct-mlx-8bit

Text Generation • 1B • Updated Apr 30, 2024 • 11

mlx-community/llava-phi-3-mini-8bit

1B • Updated Apr 30, 2024 • 5 • 1

mlx-community/llava-llama-3-8b-v1_1-4bit

Image-Text-to-Text • 2B • Updated Apr 30, 2024 • 46 • 4

mlx-community/dolphin-2.9-llama3-8b-1m-4bit

1B • Updated Apr 30, 2024 • 10

mlx-community/dolphin-2.9-llama3-8b-1m-8bit

2B • Updated Apr 30, 2024 • 12 • 1

mlx-community/llava-llama-3-8b-v1_1-8bit

Image-Text-to-Text • 3B • Updated May 14, 2024 • 22 • 4

GreenBitAI/01-Yi-9B-layer-mix-bpw-3.0-mlx

1B • Updated May 1, 2024 • 9