Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

145

Base only

Active filters: MoE

llama-moe/LLaMA-MoE-v1-3_5B-4_16-sft

Text Generation • 7B • Updated Jun 25, 2024 • 11 • 1

Aratako/ELYZA-japanese-Llama-2-MoE-2x13B-v0.1

Text Generation • 22B • Updated Mar 19, 2024 • 9

Aratako/Swallow-MoE-2x13B-v0.1

Text Generation • 22B • Updated Mar 19, 2024 • 14

Aratako/ELYZA-japanese-Llama-2-MoE-2x7B-v0.1

Text Generation • 11B • Updated Mar 19, 2024 • 11

Aratako/ELYZA-japanese-Llama-2-fast-MoE-2x7B-v0.1

Text Generation • 11B • Updated Mar 19, 2024 • 6

JuncaiL/llama-8x265m-moe

Text Generation • Updated Mar 25, 2024 • 8 • 3

mradermacher/UNAversal-8x7B-v1beta-GGUF

47B • Updated May 6, 2024 • 49

mradermacher/UNAversal-8x7B-v1beta-i1-GGUF

47B • Updated May 6, 2024 • 193 • 1

maciek-pioro/Mixtral-8x7B-v0.1-pl

Feature Extraction • 47B • Updated Apr 29, 2024 • 1.37k • 5

Skylaude/WizardLM-2-4x7B-MoE

Text Generation • 24B • Updated Apr 17, 2024 • 12

Skylaude/WizardLM-2-4x7B-MoE-exl2-6_0bpw

Text Generation • Updated Apr 16, 2024 • 5

Skylaude/WizardLM-2-4x7B-MoE-exl2-3_0bpw

Text Generation • Updated Apr 17, 2024 • 4 • 1

mradermacher/WizardLM-2-4x7B-MoE-GGUF

24B • Updated May 6, 2024 • 232 • 2

Skylaude/WizardLM-2-4x7B-MoE-exl2-4_25bpw

Text Generation • Updated Apr 17, 2024 • 4

Skylaude/WizardLM-2-4x7B-MoE-exl2-3_5bpw

Text Generation • Updated Apr 18, 2024 • 6

Skylaude/WizardLM-2-4x7B-MoE-exl2-8_0bpw

Text Generation • Updated Apr 18, 2024 • 8

Skylaude/WizardLM-2-4x7B-MoE-exl2-5_0bpw

Text Generation • Updated Apr 18, 2024 • 4

OpenDFM/SciDFM-MoE-A5.6B-v1.0

Text Generation • 19B • Updated Nov 5, 2024 • 9 • 2

mradermacher/SOLARC-MOE-10.7Bx6-GGUF

53B • Updated Aug 1, 2025 • 80

mradermacher/SOLARC-MOE-10.7Bx6-i1-GGUF

53B • Updated Nov 3, 2024 • 237

mradermacher/Bioxtral-4x7B-v0.1-GGUF

24B • Updated Nov 8, 2024 • 60

mradermacher/Bioxtral-4x7B-v0.1-i1-GGUF

24B • Updated Nov 8, 2024 • 79

mradermacher/ELYZA-japanese-Llama-2-MoE-2x13B-v0.1-GGUF

22B • Updated Nov 19, 2024 • 92

mradermacher/Swallow-MoE-2x13B-v0.1-GGUF

22B • Updated Nov 21, 2024 • 36

mradermacher/Swallow-MoE-2x13B-v0.1-i1-GGUF

22B • Updated Nov 22, 2024 • 144

mradermacher/ELYZA-japanese-Llama-2-MoE-2x7B-v0.1-GGUF

11B • Updated Nov 22, 2024 • 47

mradermacher/ELYZA-japanese-Llama-2-fast-MoE-2x7B-v0.1-GGUF

11B • Updated Nov 22, 2024 • 67

llama-moe/LLaMA-MoE-v2-3_8B-2_8-sft

8B • Updated Dec 3, 2024 • 11 • 6

llama-moe/LLaMA-MoE-v2-3_8B-residual-sft

8B • Updated Dec 3, 2024 • 15 • 2

mradermacher/megatron_1.1_MoE_2x7B-GGUF

13B • Updated Dec 9, 2024 • 87 • 1