Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

146

Base only

Active filters: MoE

mradermacher/ELYZA-japanese-Llama-2-fast-MoE-2x7B-v0.1-GGUF

11B • Updated Nov 22, 2024 • 55

llama-moe/LLaMA-MoE-v2-3_8B-2_8-sft

8B • Updated Dec 3, 2024 • 10 • 6

llama-moe/LLaMA-MoE-v2-3_8B-residual-sft

8B • Updated Dec 3, 2024 • 12 • 2

mradermacher/megatron_1.1_MoE_2x7B-GGUF

13B • Updated Dec 9, 2024 • 81 • 1

mradermacher/megatron_1.1_MoE_2x7B-i1-GGUF

13B • Updated Dec 9, 2024 • 69 • 1

tensorblock/megatron_1.1_MoE_2x7B-GGUF

13B • Updated Jan 27 • 23

mradermacher/MoECPM-Untrained-4x2b-GGUF

8B • Updated Aug 1, 2025 • 40

tensorblock/OpenMistral-MoE-GGUF

24B • Updated Jan 27 • 78

tensorblock/SOLARC-MOE-10.7Bx6-GGUF

Text Generation • 53B • Updated Jan 27 • 19

lianghsun/Marble-3B

Text Generation • 3B • Updated May 4 • 5

lianghsun/Marble-3B-Instruct

Text Generation • 3B • Updated May 4 • 2

mradermacher/Nemotron-Religionfighter-12x4B-GGUF

39B • Updated Jul 31, 2025 • 43

ykarout/Mixtral-8x7B-DeepSeek-R1-Distill

Text Generation • 47B • Updated May 31, 2025 • 4 • 2

ykarout/Mixtral-8x7B-DeepSeek-R1-Distill-Q4_K_M-GGUF

Text Generation • 47B • Updated May 31, 2025 • 12

ykarout/Mixtral-8x7B-DeepSeek-R1-Distill-Q5_K_M-GGUF

Text Generation • 47B • Updated May 31, 2025 • 27 • 1

Bochkov/bvv241-abs

Feature Extraction • Updated Oct 20, 2025 • 6

nagoshidayo/MORTM

Updated Jun 16, 2025

FreedomIntelligence/openPangu-Ultra-MoE-718B

734B • Updated Nov 4, 2025 • 22 • 3

SandLogicTechnologies/IndicPhi-mini

Text Generation • 8B • Updated Sep 11, 2025 • 7 • 2

HIT-TMG/UniMoE-Audio-Preview

7B • Updated Oct 16, 2025 • 6 • 10

mradermacher/Mixtral-8x7B-DeepSeek-R1-Distill-GGUF

47B • Updated Sep 12, 2025 • 112 • 1

mradermacher/Mixtral-8x7B-DeepSeek-R1-Distill-i1-GGUF

47B • Updated Dec 7, 2025 • 258 • 1

LibraxisAI/Qwen3-Next-80B-A3B-Instruct-MLX-MXFP4

Text Generation • 80B • Updated May 11 • 125 • 2

mlx-community/granite-4.0-h-tiny-3bit-MLX

Text Generation • 0.9B • Updated Oct 3, 2025 • 75 • 2

mlx-community/granite-4.0-h-tiny-6bit-MLX

Text Generation • 7B • Updated Oct 3, 2025 • 44 • 1

mlx-community/granite-4.0-h-tiny-5bit-MLX

Text Generation • 1B • Updated Oct 3, 2025 • 29 • 2

FreedomIntelligence/openPangu-Ultra-MoE-718B-V1.1-Int8

Updated Nov 4, 2025 • 5 • 1

HIT-TMG/Uni-MoE-2.0-Omni

Any-to-Any • 33B • Updated Nov 24, 2025 • 25 • 36

HIT-TMG/Uni-MoE-2.0-Base

Any-to-Any • 28B • Updated Nov 23, 2025 • 24 • 3

HIT-TMG/Uni-MoE-2.0-Thinking

Reinforcement Learning • 28B • Updated Nov 23, 2025 • 18 • 2