Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

LoneStriker/openbuddy-mixtral-7bx8-v16.3-32k-3.5bpw-h6-exl2

Text Generation • Updated Jan 2, 2024 • 6

srinivasbilla/tinymix-8x1b

Text Generation • 6B • Updated Jan 2, 2024 • 8 • 1

LoneStriker/openbuddy-mixtral-7bx8-v16.3-32k-3.75bpw-h6-exl2

Text Generation • Updated Jan 2, 2024 • 6

LoneStriker/openbuddy-mixtral-7bx8-v16.3-32k-4.0bpw-h6-exl2

Text Generation • Updated Jan 2, 2024 • 6

LoneStriker/openbuddy-mixtral-7bx8-v16.3-32k-5.0bpw-h6-exl2

Text Generation • Updated Jan 2, 2024 • 7

LoneStriker/openbuddy-mixtral-7bx8-v16.3-32k-6.0bpw-h6-exl2

Text Generation • Updated Jan 2, 2024 • 6

TheBloke/openbuddy-mixtral-7bx8-v16.3-32k-GGUF

Text Generation • 47B • Updated Jan 3, 2024 • 234 • 12

TheBloke/openbuddy-mixtral-7bx8-v16.3-32k-AWQ

Text Generation • 47B • Updated Jan 3, 2024 • 7 • 3

Undi95/FlatDolphinMaid-8x7B

Text Generation • 47B • Updated Jan 3, 2024 • 11 • 12

Kquant03/CognitiveFusion-4x7B-bf16-MoE

Text Generation • 24B • Updated Jan 17, 2024 • 48 • 6

TheBloke/openbuddy-mixtral-7bx8-v16.3-32k-GPTQ

Text Generation • 47B • Updated Jan 3, 2024 • 15 • 2

ibndias/NeuralHermes-MoE-2x7B

Text Generation • 13B • Updated Mar 5, 2024 • 56 • 1

AIChenKai/TinyLlama-1.1B-Chat-v1.0-x2-MoE

Text Generation • 2B • Updated Jan 3, 2024 • 2.64k • 1

Weyaxi/Nous-Hermes-2-SUS-Chat-2x34B

Text Generation • 61B • Updated Jan 21, 2024 • 45 • 3

Kquant03/MistralTrix8x9B

Text Generation • 58B • Updated Jan 5, 2024 • 46

Envoid/Dendrite-8x7Bv1

Text Generation • 47B • Updated Jan 3, 2024 • 9

ura-hcmut/MixSUra-AWQ

Text Generation • 47B • Updated Mar 27, 2024

Kooten/FlatDolphinMaid-8x7B-3.5bpw-exl2

Text Generation • Updated Jan 3, 2024 • 10 • 2

Kooten/FlatDolphinMaid-8x7B-3bpw-exl2

Text Generation • Updated Jan 3, 2024 • 6

Kooten/FlatDolphinMaid-8x7B-4bpw-exl2

Text Generation • Updated Jan 3, 2024 • 12

DS-Archive/limarp-zloss-mixtral-8x7b-qlora

Updated Jan 5, 2024 • 10 • 2

TheBloke/FlatDolphinMaid-8x7B-AWQ

Text Generation • 47B • Updated Jan 4, 2024 • 7 • 3

TheBloke/FlatDolphinMaid-8x7B-GPTQ

Text Generation • 47B • Updated Jan 4, 2024 • 6 • 6

TheBloke/FlatDolphinMaid-8x7B-GGUF

47B • Updated Jan 3, 2024 • 66 • 18

chargoddard/average-dolphin-8x7B

Text Generation • 47B • Updated Jan 5, 2024 • 48 • 1

Kquant03/EarthRender-32x7B-bf16

Text Generation • 182B • Updated Jan 5, 2024 • 48 • 5

DS-Archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss

Text Generation • 47B • Updated Jan 7, 2024 • 23 • 18

LoneStriker/FlatDolphinMaid-8x7B-3.0bpw-h6-exl2

Text Generation • Updated Jan 4, 2024 • 5 • 1

LoneStriker/FlatDolphinMaid-8x7B-3.5bpw-h6-exl2

Text Generation • Updated Jan 4, 2024 • 5 • 1

chargoddard/mixtralmerge-8x7B-rebalanced-test

Text Generation • 47B • Updated May 30, 2025 • 48