Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

RichardErkhov/skuma307_-_MedPaxTral-2x7b-8bits

Text Generation • 10B • Updated May 16, 2024 • 6

RDson/Llama-3-Peach-Instruct-4x8B-MoE

Text Generation • 25B • Updated May 21, 2024 • 9 • 1

hamxea/Mixtral-8x7B-Instruct-v0.1-activity-fine-tuned-v1

Text Generation • 47B • Updated May 16, 2024 • 6

OpenBuddy/openbuddy-mistral-22b-v21.1-32k

Text Generation • 22B • Updated May 17, 2024 • 8.22k • 4

giannisan/penny-llama3-2x8b

Text Generation • 14B • Updated May 30, 2024 • 7 • 1

Equall/SaulLM-141-Base

Text Generation • 141B • Updated Jul 31, 2024 • 19

Equall/SaulLM-141B-Instruct

Text Generation • 141B • Updated Jul 31, 2024 • 119 • 12

giannisan/penny-llama3-2x8b-v2

Text Generation • 14B • Updated May 17, 2024 • 9

maldv/badger-zeta-l3-4x8b

Text Generation • 25B • Updated Jun 2, 2024 • 7

empower-dev/empower-functions-medium

Text Generation • Updated Sep 11, 2024 • 30 • 1

impossibleexchange/smol_dip-220m

Text Generation • 0.6B • Updated May 17, 2024 • 7

IntellectusAI/mistral_finetune8x7bcompanylaw

Text Generation • Updated May 18, 2024 • 8

RichardErkhov/Undi95_-_Mixtral-8x7B-MoE-RP-Story-4bits

Text Generation • 47B • Updated May 18, 2024 • 9

geniacllm/dMoE_8B_iter1934999

Text Generation • 9B • Updated May 18, 2024 • 7

Cran-May/openbuddy-mistral-22b-v21.1-32k-Q4_K_M-GGUF

Text Generation • 22B • Updated Aug 14, 2024 • 18

RichardErkhov/macadeliccc_-_laser-dolphin-mixtral-2x7b-dpo-4bits

Text Generation • 13B • Updated May 18, 2024 • 7

RichardErkhov/macadeliccc_-_laser-dolphin-mixtral-2x7b-dpo-8bits

Text Generation • 13B • Updated May 18, 2024 • 6

Cran-May/openbuddy-mistral-22b-v21.1-32k-Q4_K_S-GGUF

Text Generation • 22B • Updated May 18, 2024 • 7

RichardErkhov/RubielLabarta_-_LogoS-7Bx2-MoE-13B-v0.2-4bits

Text Generation • 13B • Updated May 18, 2024 • 5

RichardErkhov/RubielLabarta_-_LogoS-7Bx2-MoE-13B-v0.2-8bits

Text Generation • 13B • Updated May 18, 2024 • 5

madgrizzle/starsnatched-MemGPT-DPO-MoE-test-exl2

Text Generation • Updated May 19, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-3_0bpw_exl2

Text Generation • Updated May 19, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-3_5bpw_exl2

Text Generation • Updated May 19, 2024 • 7

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-3_75bpw_exl2

Text Generation • Updated May 19, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-4_0bpw_exl2

Text Generation • Updated May 19, 2024 • 6

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-4_25bpw_exl2

Text Generation • Updated May 19, 2024 • 6

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-5_0bpw_exl2

Text Generation • Updated May 19, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-6_0bpw_exl2

Text Generation • Updated May 19, 2024 • 7

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-6_5bpw_exl2

Text Generation • Updated May 20, 2024 • 6

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-Plus-8_0bpw_exl2

Text Generation • Updated May 19, 2024 • 6