Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

second-state/Yi-34Bx2-MoE-60B-GGUF

Text Generation • 61B • Updated May 6, 2024 • 775 • 2

Gokuldaskumar/mistral-8x7b-instruct

Text Generation • 47B • Updated Jan 19, 2024 • 7

LoneStriker/TenyxChat-8x7B-v1-2.4bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 7

LoneStriker/TenyxChat-8x7B-v1-3.0bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 4

LoneStriker/TenyxChat-8x7B-v1-3.5bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 9

LoneStriker/TenyxChat-8x7B-v1-3.75bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 6

ConvexAI/Seraphim-8x10.7B-bf16

Text Generation • 70B • Updated Jan 20, 2024 • 51 • 4

LoneStriker/TenyxChat-8x7B-v1-4.0bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 9 • 1

ConvexAI/BurningBruce-003

Text Generation • 24B • Updated Oct 29, 2024 • 72 • 5

ondevicellm/tinyllama_moe_dpo_ultrachat_v2_epochs5

Text Generation • 6B • Updated Jan 22, 2024 • 12

lodrick-the-lafted/Grafted-Llama2-2x70B

Text Generation • 125B • Updated Jan 29, 2024 • 47 • 3

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • 6B • Updated Jan 19, 2024 • 9 • 1

LoneStriker/TenyxChat-8x7B-v1-5.0bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 6

LoneStriker/TenyxChat-8x7B-v1-6.0bpw-h6-exl2

Text Generation • Updated Jan 19, 2024 • 6

LHC88/SauerkrautLM-Mixtral-8x7B-Instruct-AWQ

Text Generation • 47B • Updated Jan 20, 2024 • 6

yunconglong/7Bx4_DPO

Text Generation • 24B • Updated Jan 21, 2024 • 48 • 2

Kquant03/BurningBruce-SOLAR-8x10.7B-bf16

Text Generation • 70B • Updated Jan 22, 2024 • 45 • 4

yunconglong/7Bx4_DPO_2e

Text Generation • 24B • Updated Jan 20, 2024 • 48 • 1

Andrewwwwww/Nous-Hermes-2-Mixtral-8x7B-DPO

Text Generation • 47B • Updated Jan 20, 2024 • 11 • 1

Nan-Do/FusionNet_7Bx2_MoE_14B-GGUF

13B • Updated Jan 21, 2024 • 168 • 10

wuxiangdan9978/project1

Text Generation • 47B • Updated Jan 20, 2024 • 9

ondevicellm/tinyllama_moe_sft_ultrachat_v2_ep3

Text Generation • 6B • Updated Jan 21, 2024 • 13

h2m/BurningBruce-004-4x7b

Text Generation • 24B • Updated Jan 23, 2024 • 4 • 1

mixtao/MixTAO-7Bx2-MoE-Instruct-v2.0

Text Generation • 13B • Updated Jan 20, 2024 • 11

ConvexAI/BurningBruce-004

Text Generation • 24B • Updated Mar 4, 2024 • 51 • 5

LHC88/SauerkrautLM-Mixtral-8x7B-AWQ

Text Generation • 47B • Updated Jan 20, 2024 • 6 • 1

ConvexAI/BurningBruce-005

Text Generation • 24B • Updated Mar 4, 2024 • 53 • 4

CultriX/CultriX-MoE-Model

Text Generation • 13B • Updated Jan 20, 2024 • 50 • 3

lodrick-the-lafted/Grafted-Titanic-Dolphin-2x120B

Text Generation • 214B • Updated Jan 29, 2024 • 69 • 7

SteelStorage/Umbra-MoE-4x10.7

Text Generation • 36B • Updated Apr 23, 2024 • 11 • 3