Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,221

Base only

Active filters: mixtral

leptonai/dolphin-2.9.2-mixtral-8x22b-awq

Text Generation • 141B • Updated Jun 16, 2024 • 55

JoPmt/TinyEnsemble-3x1.1B-TinyMoE

Text Generation • 3B • Updated Jun 16, 2024 • 11

ENERGY-DRINK-LOVE/llama3_2X8b

Text Generation • 14B • Updated Jun 17, 2024 • 5

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_5.0bpw_h8

Text Generation • Updated Jun 18, 2024 • 4

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_4.0bpw_h8

Text Generation • Updated Jun 18, 2024 • 4

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_4.5bpw_h8

Text Generation • Updated Jun 19, 2024 • 5

TitanML/tiny-mixtral-AWQ-4bit

Text Generation • 0.2B • Updated Jun 17, 2024 • 38

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_5.5bpw_h8

Text Generation • Updated Jun 19, 2024 • 4

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_6.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 5

gghfez/WizardLM-2-8x22B-Beige-exl2_3.75bpw

Text Generation • Updated Jun 18, 2024 • 4

karakuri-ai/karakuri-lm-8x7b-instruct-v0.1

Text Generation • 47B • Updated Jun 19, 2024 • 13 • 19

cminja/mixtral-8x7b-instruct-sft-en-sr

Text Generation • 47B • Updated Jun 17, 2024 • 4

cminja/mixtral-8x22b-v0.1-instruct-sft-en-sr

Text Generation • 141B • Updated Jun 18, 2024 • 5

xi0v/MoEJudge-118B

Text Generation • 118B • Updated Dec 22, 2024

S-miguel/Moe_llama3_8bx2_Rag

Text Generation • 14B • Updated Jun 18, 2024 • 5

xi0v/Exp-200B

Text Generation • 203B • Updated Dec 22, 2024

jsfs11/L3-8B-Stheno-2x8B-MoE

Text Generation • 14B • Updated Jun 18, 2024 • 6 • 3

gghfez/WizardLM-2-8x22B-Beige-exl2_2.5bpw

Text Generation • Updated Jun 18, 2024 • 7

Txoka/GLEAM-Mixtral-8x7B-Instruct-v2.0

Text Generation • 47B • Updated Jun 19, 2024 • 7

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_6.5bpw_h8

Text Generation • Updated Jun 19, 2024 • 6

OpenBuddy/openbuddy-yi1.5-34b-v21.6-32k-fp16

Text Generation • 34B • Updated Jun 23, 2024 • 8.13k • 1

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 8

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.5bpw_h8

Text Generation • Updated Jun 19, 2024 • 4

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8

Text Generation • Updated Jun 19, 2024 • 6

ReadyON/karakuri-lm-8x7b-instruct-v0.1-gguf

Text Generation • 47B • Updated Jun 21, 2024 • 24 • 3

akthegr8/excelstory

Text Generation • Updated Jun 20, 2024 • 11

akthegr8/excelpdf

Question Answering • 13B • Updated May 25, 2025 • 187

bullerwins/WizardLM-2-8x22-exl2_5.0bpw

Text Generation • Updated Jun 21, 2024 • 5

bullerwins/WizardLM-2-8x22-exl2_4.0bpw

Text Generation • Updated Jun 21, 2024 • 7 • 1

bullerwins/WizardLM-2-8x22-exl2_4.5bpw

Text Generation • Updated Jun 21, 2024 • 9