Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

ibivibiv/giant-hydra-moe-240b

Text Generation • 238B • Updated Feb 11, 2024 • 11 • 18

jtatman/TinyDolphin-3x-MoE

Text Generation • 3B • Updated Apr 23 • 33 • 1

jsfs11/MixtureofMerges-MoE-v2

Text Generation • 24B • Updated Mar 4, 2024 • 53 • 1

if001/tiny_mixtral_ja_instruction

Text Generation • 0.3B • Updated Feb 2, 2024 • 11

kataresearch/mixtral-id-merged

Text Generation • 48B • Updated Jan 31, 2024 • 4

hflog/jsfs11-MixtureofMerges-MoE-v2

Text Generation • 24B • Updated Jan 31, 2024 • 9

hflog/mzbac-Kunpeng-4x7B-mistral

Text Generation • Updated Jan 31, 2024 • 5

rhplus0831/maid-yuzu-v1

Text Generation • 47B • Updated Jan 31, 2024 • 10

rhplus0831/maid-yuzu-v1-alter

Text Generation • 47B • Updated Jan 31, 2024 • 6

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-2.4bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 7

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-3.0bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 5

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-3.5bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 4

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-3.75bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 7

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-4.0bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 5

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-5.0bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 7

LoneStriker/openbuddy-mixtral-7bx8-v17.1-32k-6.0bpw-h6-exl2

Text Generation • Updated Jan 31, 2024 • 5 • 1

rhplus0831/maid-yuzu-v1-exl2-6.0bpw-rpcal

Text Generation • Updated Jan 31, 2024 • 11

minchyeom/MemGPT-DPO-MoE-test

Text Generation • 13B • Updated Feb 2, 2024 • 9 • 5

rhplus0831/maid-yuzu-v2

Text Generation • 47B • Updated Feb 1, 2024 • 6

rhplus0831/maid-yuzu-v2-alter

Text Generation • 47B • Updated Feb 1, 2024 • 8

M4-ai/TinyMistral-6x248M-Instruct

Text Generation • 1B • Updated Feb 1, 2024 • 10 • 11

rhplus0831/maid-yuzu-v2-alter-exl2-6.0bpw-rpcal

Text Generation • Updated Feb 1, 2024 • 5

ConvexAI/Harmony-4x7B-bf16

Text Generation • 24B • Updated Feb 4, 2024 • 62 • 3

sam-ezai/Breezeblossom-v4-mistral-2x7B

Text Generation • 13B • Updated Feb 1, 2024 • 7

rhplus0831/maid-yuzu-v2-exl2-6.0bpw-rpcal

Text Generation • Updated Feb 1, 2024 • 6

MarkrAI/RAG-KO-Mixtral-7Bx2-v1.15

Text Generation • 13B • Updated Feb 1, 2024 • 15

dev137/cognitivecomputations_dolphin-2.7-mixtral-8x7b-exl2-8bpw

Text Generation • Updated Feb 1, 2024 • 8

dev137/cognitivecomputations_dolphin-2.7-mixtral-8x7b-exl2-6bpw

Text Generation • Updated Feb 1, 2024 • 7 • 1

LoneStriker/Blue-Orchid-2x7b-3.0bpw-h6-exl2

Text Generation • Updated Feb 3, 2024 • 6

LoneStriker/Blue-Orchid-2x7b-3.5bpw-h6-exl2

Text Generation • Updated Feb 3, 2024 • 5