Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,143

Base only

Active filters: mixtral

Zoyd/maldv_badger-zeta-l3-4x8b-8_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 3

OmnicromsBrain/NeuralStar_FusionWriter_4x7b

Text Generation • 24B • Updated Jun 13, 2024 • 106 • 9

FuturisticVibes/WizardLM-2-8x22B-8.0bpw-h8-exl2

Text Generation • Updated Jun 9, 2024 • 2

weblab-GENIAC/team_kumagai_submit

Text Generation • Updated Jun 7, 2024 • 4

MrezaPRZ/CodeLlama-4x7B-experts-base

Text Generation • 20B • Updated Jun 7, 2024 • 21

MrezaPRZ/CodeLlama-4x7B-experts-it

Text Generation • 20B • Updated Jun 7, 2024 • 22

mradermacher/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GGUF

47B • Updated Dec 9, 2025 • 127 • 2

mradermacher/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-i1-GGUF

47B • Updated Dec 18, 2025 • 1.59k • 3

keitokei1994/Llama-3-Umievo-Shizuko-sqlcoder-2x8B

Text Generation • 14B • Updated Jun 11, 2024 • 8 • 2

R136a1/Ayam-2x8B

Text Generation • 14B • Updated Jun 9, 2024 • 29 • 4

kalomaze/Mistral-7b-MoEified-8x

Text Generation • 7B • Updated Jun 10, 2024 • 512 • 6

aws-neuron/mixtral-instruct-seqlen-4096-bs-4-optimum-0-0-23

Text Generation • Updated Jun 10, 2024 • 6 • 1

comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v3

Text Generation • 47B • Updated Jun 10, 2024 • 5

comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v2

Text Generation • 141B • Updated Jun 10, 2024 • 3

InferenceIllusionist/TeTO-MS-8x7b

Text Generation • 47B • Updated Jun 13, 2024 • 8 • 4

fxmeng/PiSSA-Mixtral-8x7B-4bit-r64-5iter

Text Generation • 47B • Updated Jun 11, 2024 • 4

Quant-Cartel/TeTO-MS-8x7b-iMat-GGUF

47B • Updated Jun 13, 2024 • 119 • 1

FuturisticVibes/Mixtral-8x22B-Instruct-v0.1-8.0bpw-h8-exl2

Text Generation • Updated Jun 12, 2024 • 2 • 1

solidrust/Ayam-2x8B-AWQ

Text Generation • 14B • Updated Sep 3, 2024

Souvik3333/Llama-3-3x8B-multilingual

Text Generation • 19B • Updated Jun 21, 2024 • 4

RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8

Text Generation • 141B • Updated Aug 12, 2024 • 36 • 3

Quant-Cartel/TeTO-MS-8x7b-exl2-rpcal

Updated Jun 18, 2024 • 3

solidrust/Inixion-2x8B-AWQ

Text Generation • 14B • Updated Sep 3, 2024 • 1

minchyeom/MemGPT-experiment-2

Text Generation • 13B • Updated Jun 12, 2024 • 4

gghfez/WizardLM-2-8x22B-Beige

Text Generation • 141B • Updated Jun 15, 2024 • 27 • 4

aws-neuron/hermes-mixtral-instruct-seqlen-4096-bs-4-optimum-0-0-23

Text Generation • Updated Jun 14, 2024 • 9

RaphaelMourad/Mistral-DNA-v1-417M-Athaliana

Text Generation • 0.4B • Updated Dec 13, 2024 • 14 • 1

Kaoeiri/PantheraMax-L3-RP-TestProbe-4-4x8B

Text Generation • 25B • Updated Dec 31, 2024 • 19

opake/IbuMedTrial-2x7B

Text Generation • 10B • Updated Jun 15, 2024 • 7

gghfez/WizardLM-2-8x22B-Beige-exl2_5.0bpw

Text Generation • Updated Jun 18, 2024 • 5