Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,558

Base only

Active filters: 6-bit

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • 7B • Updated Jan 24, 2025 • 24

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • 1B • Updated Jan 24, 2025 • 66

mlx-community/Evathene-v1.3-MLX-6Bit

Text Generation • 16B • Updated Jan 25, 2025 • 11

Felprot75/DeepSeek-R1-Distill-Llama-8B-Q6-mlx

Text Generation • 2B • Updated Jan 25, 2025 • 13 • 1

riveRiPH/Wayfarer_Eris_Noctis-12B-6bpw-h8-exl2

Text Generation • Updated Jan 25, 2025 • 6 • 1

mlx-community/Nova-Tempus-70B-v0.1-MLX-6Bit

Text Generation • 15B • Updated Jan 27, 2025 • 10

mlx-community/Qwen2.5-7B-Instruct-1M-6bit

Text Generation • 2B • Updated Jan 26, 2025 • 34 • 2

mlx-community/Qwen2.5-14B-Instruct-1M-6bit

Text Generation • 3B • Updated Jan 26, 2025 • 56 • 2

roleplaiapp/Llama-3.2-3B-Instruct-uncensored-Q6_K-GGUF

Text Generation • 4B • Updated Jan 27, 2025 • 98 • 1

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q6_K-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 85

MikeRoz/sophosympatheia_Nova-Tempus-70B-v0.2-6.0bpw-h6-exl2

Text Generation • Updated Feb 3, 2025 • 6 • 1

SicariusSicariiStuff/Impish_QWEN_14B-1M-6.0bpw

Text Generation • Updated Jul 26, 2025 • 8

djphoenix/saiga_nemo_12b-Q6-mlx

3B • Updated Jan 27, 2025 • 10 • 1

djphoenix/Qwen2.5-Coder-14B-Instruct-Q6-mlx

Text Generation • 3B • Updated Jan 27, 2025 • 105 • 1

beezu/Nova-Tempus-70B-v0.2-MLX-6Bit

Text Generation • 15B • Updated Feb 3, 2025 • 8

roleplaiapp/MN-12B-Mag-Mell-R1-Q6_K-GGUF

Text Generation • 12B • Updated Jan 27, 2025 • 7

beezu/Anubis-70B-v1-MLX-6Bit

15B • Updated Jan 27, 2025 • 27

roleplaiapp/Midnight-Miqu-70B-v1.5-i1-Q6_K-GGUF

Text Generation • Updated Jan 28, 2025

isv2lf/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q6-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 51

isv2lf/DeepSeek-R1-Distill-Qwen-14B-Uncensored-Q6-mlx

3B • Updated Jan 28, 2025 • 1

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q6_K-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 9

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q6_K-GGUF

Text Generation • 33B • Updated Jan 28, 2025 • 72 • 1

isv2lf/magnum-v4-12b-Q6-mlx

Text Generation • 3B • Updated Jan 28, 2025 • 36

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q6_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 32

djphoenix/Qwen2.5-Coder-3B-Instruct-Q6-mlx

Text Generation • 0.7B • Updated Jan 29, 2025 • 14

roleplaiapp/14B-Qwen2.5-Kunou-v1-Q6_K-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 7

roleplaiapp/q-2.5-deepseek-r1-veltha-v0.3-Q6_K-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 9

roleplaiapp/DS-Distilled-Hermes-Llama-3.1_TIES-i1-Q6_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 4

roleplaiapp/Phi-4-ReasoningRP-Q6_K-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 3

roleplaiapp/Virtuoso-Lite-Q6_K-GGUF

Text Generation • 10B • Updated Jan 29, 2025 • 7