Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,221

Base only

Active filters: mixtral

FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-8.0bpw-h8-exl2

Text Generation • Updated Jun 6, 2024 • 10 • 2

mradermacher/openbuddy-yi1.5-34b-v21.3-32k-i1-GGUF

34B • Updated Aug 2, 2024 • 1.69k • 1

XuYipei/Mixtral-4x7B-Chat-Chinese

Text Generation • 24B • Updated Jul 3, 2024 • 12

MrezaPRZ/CodeLlama-3x7B-it

Text Generation • 15B • Updated Jun 6, 2024 • 6

0dAI/0dAI-8x7b-0761

Text Generation • Updated Jun 6, 2024 • 16

MrezaPRZ/CodeLlama-3x7B-dialect-experts-random-gate-base

Text Generation • 15B • Updated Jun 6, 2024 • 4

MrezaPRZ/CodeLlama-3x7B-dialect-experts-random-gate-trained-gate

Text Generation • 15B • Updated Jun 6, 2024 • 6

Zoyd/maldv_badger-zeta-l3-4x8b-2_2bpw_exl2

Text Generation • Updated Jun 7, 2024 • 5

Zoyd/maldv_badger-zeta-l3-4x8b-2_5bpw_exl2

Text Generation • Updated Jun 7, 2024 • 6

Zoyd/maldv_badger-zeta-l3-4x8b-3_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 5

Zoyd/maldv_badger-zeta-l3-4x8b-3_5bpw_exl2

Text Generation • Updated Jun 7, 2024 • 5

MrezaPRZ/CodeLlama-3x7B-dialect-experts-random-gate-it

Text Generation • 15B • Updated Jun 6, 2024 • 7

Zoyd/maldv_badger-zeta-l3-4x8b-4_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 4

Zoyd/maldv_badger-zeta-l3-4x8b-3_75bpw_exl2

Text Generation • Updated Jun 7, 2024 • 3

Zoyd/maldv_badger-zeta-l3-4x8b-4_25bpw_exl2

Text Generation • Updated Jun 7, 2024 • 6

Zoyd/maldv_badger-zeta-l3-4x8b-5_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 4

Zoyd/maldv_badger-zeta-l3-4x8b-6_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 6

Zoyd/maldv_badger-zeta-l3-4x8b-6_5bpw_exl2

Text Generation • Updated Jun 7, 2024 • 4

Zoyd/maldv_badger-zeta-l3-4x8b-8_0bpw_exl2

Text Generation • Updated Jun 7, 2024 • 9

OmnicromsBrain/NeuralStar_FusionWriter_4x7b

Text Generation • 24B • Updated Jun 13, 2024 • 83 • 10

FuturisticVibes/WizardLM-2-8x22B-8.0bpw-h8-exl2

Text Generation • Updated Jun 9, 2024 • 5

weblab-GENIAC/team_kumagai_submit

Text Generation • Updated Jun 7, 2024 • 10

MrezaPRZ/CodeLlama-4x7B-experts-base

Text Generation • 20B • Updated Jun 7, 2024 • 5

MrezaPRZ/CodeLlama-4x7B-experts-it

Text Generation • 20B • Updated Jun 7, 2024 • 3

mradermacher/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GGUF

47B • Updated Dec 9, 2025 • 184 • 2

mradermacher/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-i1-GGUF

47B • Updated Dec 18, 2025 • 1.45k • 3

keitokei1994/Llama-3-Umievo-Shizuko-sqlcoder-2x8B

Text Generation • 14B • Updated Jun 11, 2024 • 9 • 2

R136a1/Ayam-2x8B

Text Generation • 14B • Updated Jun 9, 2024 • 9 • 4

kalomaze/Mistral-7b-MoEified-8x

Text Generation • 7B • Updated Jun 10, 2024 • 327 • 6

aws-neuron/mixtral-instruct-seqlen-4096-bs-4-optimum-0-0-23

Text Generation • Updated Jun 10, 2024 • 13 • 1