Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,276

Base only

Active filters: mlx

GreenBitAI/Llama-3-8B-layer-mix-bpw-4.0-mlx

2B • Updated Apr 29, 2024 • 6

GreenBitAI/Llama-3-8B-instruct-layer-mix-bpw-4.0-mlx

2B • Updated Apr 29, 2024 • 10

mlx-community/Llama-3-8B-Instruct-1048k-4bit

Text Generation • 1B • Updated Apr 29, 2024 • 564 • 25

mlx-community/Llama-3-8B-Instruct-1048k-8bit

Text Generation • 2B • Updated Apr 29, 2024 • 243 • 17

mlx-community/starcoder2-15b-instruct-v0.1-4bit

Text Generation • Updated Apr 29, 2024 • 49

mlx-community/starcoder2-15b-instruct-v0.1-8bit

Text Generation • Updated Apr 30, 2024 • 37

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • Updated Apr 30, 2024 • 29

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • Updated Apr 30, 2024 • 19

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0

Text Generation • Updated Apr 30, 2024 • 16

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • Updated Apr 30, 2024 • 22

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • Updated Apr 30, 2024 • 17

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

Text Generation • Updated Apr 30, 2024 • 14

mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • Updated Apr 30, 2024 • 23

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • Updated Apr 30, 2024 • 24

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

Text Generation • Updated Apr 30, 2024 • 18

mlx-community/starcoder2-15b-instruct-v0.1

Text Generation • Updated Apr 30, 2024 • 31

mlx-community/Meta-Llama-3-70B-Instruct-mlx-unquantized

Text Generation • 71B • Updated Apr 30, 2024 • 25

batmac/Phi-3-mini-128k-instruct-mlx-8bit

Text Generation • Updated Apr 30, 2024 • 9

mlx-community/llava-phi-3-mini-4bit

Updated Apr 30, 2024 • 271 • 9

batmac/Phi-3-mini-4k-instruct-mlx-8bit

Text Generation • Updated Apr 30, 2024 • 18

mlx-community/llava-phi-3-mini-8bit

Updated Apr 30, 2024 • 21 • 1

mlx-community/llava-llama-3-8b-v1_1-4bit

Image-Text-to-Text • Updated Apr 30, 2024 • 50 • 4

mlx-community/dolphin-2.9-llama3-8b-1m-4bit

Updated Apr 30, 2024 • 15

mlx-community/dolphin-2.9-llama3-8b-1m-8bit

Updated Apr 30, 2024 • 14 • 1

mlx-community/llava-llama-3-8b-v1_1-8bit

Image-Text-to-Text • Updated May 14, 2024 • 37 • 4

GreenBitAI/01-Yi-9B-layer-mix-bpw-3.0-mlx

1B • Updated May 1, 2024 • 8

mlx-community/llama-3-youko-8b-8bit

Updated May 1, 2024 • 14 • 1

ahmetkca/Phi-3-mini-4k-instruct-mlx

Text Generation • 4B • Updated May 1, 2024 • 27 • 1

ahmetkca/Phi-3-mini-128k-instruct-mlx

Text Generation • 4B • Updated May 1, 2024 • 12 • 1

mlx-community/Hermes-2-Pro-Llama-3-8B-4bit

1B • Updated May 2, 2024 • 83 • 1