Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 11 • 1

maciek-pioro/Mixtral-8x7B-v0.1-pl

Feature Extraction • 47B • Updated Apr 29, 2024 • 1.37k • 5

RaphaelMourad/Mistral-DNA-v1-138M-bacteria

Text Generation • 0.1B • Updated Aug 4, 2024 • 73 • 4

ibivibiv/orthorus_125b_v3

Text Generation • 125B • Updated Apr 15, 2024 • 7 • 1

Ankurbash/expert-llama1B

Text Generation • 2B • Updated Apr 15, 2024

ff670/openbuddy-mixtral-22bx8-preview0-65k

Text Generation • 141B • Updated Apr 16, 2024 • 12 • 4

R136a1/BeyondInfinity-4x7B

Text Generation • 24B • Updated May 16, 2024 • 11 • 2

mlx-community/WizardLM-2-8x22B-4bit

22B • Updated Apr 16, 2024 • 58 • 9

TroyDoesAI/Mermaid-Dolphin-MoE-2x7b_code

Text Generation • 13B • Updated Apr 15, 2024 • 7

TroyDoesAI/Mermaid-Dolphin-MoE-2x7b_Story_Flow

Text Generation • 13B • Updated Apr 15, 2024 • 7

Dracones/WizardLM-2-8x22B_exl2_2.5bpw

Text Generation • Updated Apr 16, 2024 • 17 • 6

Dracones/WizardLM-2-8x22B_exl2_4.5bpw

Text Generation • Updated Apr 16, 2024 • 13

Dracones/WizardLM-2-8x22B_exl2_5.0bpw

Text Generation • Updated Apr 16, 2024 • 7

sosoai/hansoldeco-mixtral-8x22b-4bit-v0.1

Text Generation • 145B • Updated Apr 15, 2024 • 5

WesPro/State-of-the-MoE_RP-2x7B

Text Generation • 13B • Updated Apr 16, 2024 • 9 • 1

bdambrosio/WizardLM-2-8x22B-6.0bpw-h8-exl2

Text Generation • Updated Apr 16, 2024 • 5

Dracones/WizardLM-2-8x22B_exl2_4.0bpw

Text Generation • Updated Apr 16, 2024 • 13 • 2

Dracones/WizardLM-2-8x22B_exl2_3.5bpw

Text Generation • Updated Apr 16, 2024 • 7

alpindale/WizardLM-2-8x22B

Text Generation • 141B • Updated Sep 14, 2024 • 9.8k • • 415

Dracones/WizardLM-2-8x22B_exl2_3.0bpw

Text Generation • Updated Apr 16, 2024 • 9 • 2

abeja/Mixtral-8x7B-v0.1-japanese

Text Generation • 47B • Updated Apr 20, 2024 • 16 • 1

KnutJaegersberg/WizardLM-2-8x22B

Text Generation • 141B • Updated Apr 16, 2024 • 4 • 2

Dracones/WizardLM-2-8x22B_exl2_2.75bpw

Text Generation • Updated Apr 16, 2024 • 8 • 2

prince-canuma/WizardLM-2-8x22B

Text Generation • 141B • Updated Apr 16, 2024 • 5 • 5

Dracones/WizardLM-2-8x22B_exl2_2.25bpw

Text Generation • Updated Apr 16, 2024 • 17 • 6

dreamgen/WizardLM-2-8x22B

Text Generation • 141B • Updated Apr 16, 2024 • 11 • 31

Dracones/WizardLM-2-8x22B_exl2_7.0bpw

Text Generation • Updated Apr 16, 2024 • 10

abeja/Mixtral-8x7B-Instruct-v0.1-japanese-alpha

Text Generation • 47B • Updated Apr 20, 2024 • 13

abeja/Mixtral-8x7B-Instruct-v0.1-japanese-alpha-merged

Text Generation • 47B • Updated Apr 20, 2024 • 20

Gokuldaskumar/wizardlm_2

Text Generation • 141B • Updated Apr 16, 2024 • 6