Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

zaq-hack/ChaoticSoliloquy-4x8B-bpw600-h6-exl2-rpcal

Text Generation • Updated Apr 25, 2024 • 6 • 2

zaq-hack/ChaoticSoliloquy-4x8B-bpw500-h6-exl2-rpcal

Text Generation • Updated Apr 25, 2024 • 9 • 1

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • 47B • Updated Jul 18, 2024 • 38 • 3

cloudyu/Llama-3-8Bx2-MOE-DPO

Text Generation • 14B • Updated Apr 26, 2024 • 6 • 1

mlx-community/Llama-3-Aplite-Instruct-4x8B-MoE-4bit

Text Generation • 4B • Updated Apr 26, 2024 • 24

InferenceIllusionist/miqu-evil-dpo-iMat-GGUF

69B • Updated Apr 28, 2024 • 253 • 2

FriendliAI/Mixtral-8x7B-v0.1-fp8

Text Generation • 47B • Updated Apr 26, 2024 • 8

xinping/Mixtral-instruction-v0.1_zh-nf4

Text Generation • 48B • Updated May 7, 2024 • 5

saucam/Skyro-4X8B

Text Generation • 25B • Updated May 9, 2024 • 12 • 2

PhilipMay/Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw

Text Generation • 21B • Updated Jun 2, 2024 • 8 • 1

botbotrobotics/CabraMixtral-8x7b

Text Generation • 47B • Updated May 20, 2024 • 12 • 3

RyotaKadoya1993/MoE_Test_V3

Text Generation • 20B • Updated Apr 27, 2024 • 5

JacobAndersson/slimed-mixtral-1

Text Generation • 2B • Updated Apr 27, 2024 • 8

mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-8bit

13B • Updated Apr 27, 2024 • 67

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-SFT-4bits

Text Generation • 47B • Updated Apr 28, 2024 • 7

anyisalin/Mixtral-8x7B-Instruct-v0.1-FP8-D

Text Generation • 47B • Updated Apr 28, 2024 • 7

RichardErkhov/NousResearch_-_Nous-Hermes-2-Mixtral-8x7B-DPO-4bits

Text Generation • 47B • Updated Apr 28, 2024 • 8

aipib/TinyMoE-DopeykarasuMoe-xdareties2

Text Generation • 2B • Updated Apr 28, 2024 • 8

Nanner-kins/Umbra-v3-MoE-4x11b-3.5bpw-h6-exl2

Text Generation • Updated Apr 28, 2024 • 6

RaphaelMourad/Mistral-DNA-v1-138M-yeast

Text Generation • 0.1B • Updated Aug 4, 2024 • 13 • 1

Nhoodie/llama-3-sqrt-crocodile-v0.0A

Text Generation • 14B • Updated Apr 29, 2024 • 10

HassanStar/Phi3Mix

Text Generation • Updated Apr 28, 2024 • 17

RyotaKadoya1993/PEFT-MoE2

Text Generation • 6B • Updated Apr 29, 2024 • 6

sanchit-gandhi/mixtral-8x1.5B-Instruct-v0.1

Text Generation • 9B • Updated Apr 29, 2024 • 9

dphn/dolphin-2.9-mixtral-8x22b

Text Generation • 141B • Updated May 20, 2024 • 88 • 25

rjamorizIAtest/MedPaxTral-2x7b

Text Generation • 10B • Updated Apr 29, 2024 • 7

solidrust/Lorge-2x7B-AWQ

Text Generation • 13B • Updated Sep 3, 2024 • 10

solidrust/Lorge-2x7B-UAMM-AWQ

Text Generation • 19B • Updated Sep 3, 2024 • 6

kloodia/llama3-8x8-no-train

Text Generation • 59B • Updated Apr 30, 2024 • 6

kloodia/6x8b-wFT_llama3

Text Generation • 36B • Updated Apr 30, 2024 • 6