Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,559

Base only

Active filters: 6-bit

Jellon/Qwen2.5-14B-Infermatic-Crea-v2-exl2-6bpw-h8

Text Generation • Updated Dec 20, 2024 • 8

MaziyarPanahi/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 135 • 6

TheBlueObserver/OpenHermes-2.5-Mistral-7B-MLX-8777b

2B • Updated Dec 20, 2024 • 5

MaziyarPanahi/fratricide-12B-Unslop-Mell-DARKNESS-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 10

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.5v-GGUF

Text Generation • 12B • Updated Dec 20, 2024 • 52

MaziyarPanahi/moxin-llm-7b-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 42 • 1

Float16-cloud/llama3.1-typhoon2-8b-instruct-mlx-6bit

Text Generation • 2B • Updated Dec 21, 2024 • 11

Float16-cloud/llama3.2-typhoon2-1b-instruct-mlx-6bit

Text Generation • 0.3B • Updated Dec 21, 2024 • 13

Float16-cloud/llama3.2-typhoon2-3b-instruct-mlx-6bit

Text Generation • 0.7B • Updated Dec 21, 2024 • 85 • 1

Float16-cloud/typhoon2-qwen2.5-7b-instruct-mlx-6bit

Text Generation • 2B • Updated Dec 21, 2024 • 11

TheBlueObserver/gemma-2-9b-it-MLX-8777b

Text Generation • 2B • Updated Dec 21, 2024 • 9

Zenabius/Qwen2.5-72B-Instruct-abliterated-exl2-6.5bpw

Updated Dec 21, 2024 • 10

TheBlueObserver/gemma-2-2b-it-MLX-8777b

Text Generation • 0.6B • Updated Dec 22, 2024 • 8

Jellon/Qwen2.5-14b-Kunou-v1-exl2-6bpw-h8

Text Generation • Updated Dec 22, 2024 • 10

TheBlueObserver/Falcon3-7B-Instruct-MLX-8777b

Text Generation • 2B • Updated Dec 22, 2024 • 8

TheBlueObserver/gemma-2-27b-it-MLX-8777b

Text Generation • 6B • Updated Dec 23, 2024 • 7

TheBlueObserver/Llama-3.2-3B-Instruct-MLX-8777b

Text Generation • 0.7B • Updated Dec 23, 2024 • 8

MaziyarPanahi/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 70

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 106 • 2

TheBlueObserver/Qwen2.5-Coder-32B-Instruct-MLX-8777b

Text Generation • 7B • Updated Dec 23, 2024 • 19

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.4v-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 129 • 1

MaziyarPanahi/MN-Chinofun-12B-3-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 122 • 2

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • 12B • Updated Dec 23, 2024 • 61

Statuo/Aletheia-14b-EXL2-6bpw

Text Generation • Updated Dec 24, 2024 • 6

Dracones/Anubis-70B-v1_exl2_6.0bpw

Text Generation • Updated Dec 25, 2024 • 9

cnfusion/Microsoft_Phi-4-mlx-6bit

Text Generation • 3B • Updated Jan 13, 2025 • 30

Dracones/QVQ-72B-Preview_exl2_6.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 9

Jellon/Tissint-14B-v1.2-128k-RP-exl2-6bpw-h8

Text Generation • Updated Dec 26, 2024 • 8

mlx-community/Phi-3.5-mini-instruct-6bit

0.8B • Updated Dec 26, 2024 • 8

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • 12B • Updated Dec 26, 2024 • 17