Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,220

Base only

Active filters: mixtral

TheBloke/8x7B-MoE-test-NOT-MIXTRAL-GGUF

38B • Updated Dec 17, 2023 • 153 • 6

MergeFuel/Plap-8x13B

Text Generation • 72B • Updated Dec 17, 2023 • 6 • 2

chargoddard/SmolLlamix-8x101M-take2

Text Generation • 0.4B • Updated Jan 5, 2024 • 51

TheBloke/Starling-LM-alpha-8x7B-MoE-GPTQ

Text Generation • 47B • Updated Dec 17, 2023 • 9 • 2

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 10 • 2

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 10

LoneStriker/openbuddy-mixtral-8x7b-v15.1-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 6

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 6 • 1

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8

LoneStriker/Mixtral-8x7B-MoE-Undi95-RP-Story-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 6

LoneStriker/openbuddy-mixtral-8x7b-v15.1-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

LoneStriker/openbuddy-mixtral-8x7b-v15.1-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 11

LoneStriker/openbuddy-mixtral-8x7b-v15.1-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5

LoneStriker/Synthia-MoE-v3-Mixtral-8x7B-2.4bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5

TheBloke/8x7B-MoE-test-NOT-MIXTRAL-GPTQ

Text Generation • 38B • Updated Dec 17, 2023 • 12 • 2

LoneStriker/Synthia-MoE-v3-Mixtral-8x7B-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 6

LoneStriker/openbuddy-mixtral-8x7b-v15.1-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 12

LoneStriker/Synthia-MoE-v3-Mixtral-8x7B-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-3.5bpw-h6-exl2-rpcal

Text Generation • Updated Dec 18, 2023 • 12 • 2

LoneStriker/Synthia-MoE-v3-Mixtral-8x7B-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5

TheBloke/Chupacabra-8x7B-MoE-GPTQ

Text Generation • 47B • Updated Dec 17, 2023 • 6 • 1

LoneStriker/Synthia-MoE-v3-Mixtral-8x7B-6.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 5

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-3.75bpw-h6-exl2-rpcal

Text Generation • Updated Dec 18, 2023 • 6 • 1

TheBloke/Falkor-8x7B-MoE-GPTQ

Text Generation • 47B • Updated Dec 17, 2023 • 6 • 1

lavawolfiee/Mixtral-8x7B-Instruct-v0.1-offloading-demo

Text Generation • 18B • Updated Dec 30, 2023 • 42 • 27

LoneStriker/openbuddy-mixtral-8x7b-v15.1-3.5bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8 • 1

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-5.5bpw-h6-exl2-rpcal

Text Generation • Updated Dec 18, 2023 • 8 • 1

LoneStriker/Mixtral-4x7B-DPO-RPChat-3.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 9 • 3

LoneStriker/Mixtral-4x7B-DPO-RPChat-4.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8

LoneStriker/Mixtral-4x7B-DPO-RPChat-5.0bpw-h6-exl2-2

Text Generation • Updated Dec 17, 2023 • 8