Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

shisa-ai/shisa-v1-swallowmx-13a47b

Text Generation • 47B • Updated May 19, 2024 • 11

RichardErkhov/lodrick-the-lafted_-_Grafted-Hermetic-Platypus-C-2x7B-4bits

Text Generation • 13B • Updated May 20, 2024 • 6

Elizezen/Wolfsschanze-2x7B

Text Generation • 13B • Updated May 20, 2024 • 8

GenTrendGPT/MoEy-2

Text Generation • 4B • Updated May 20, 2024 • 8

Alsebay/FinalFintetuning-XVIII-2x8B

Text Generation • 14B • Updated May 21, 2024 • 9 • 4

xxx777xxxASD/L3_SnowStorm_4x8B

Text Generation • 25B • Updated May 28, 2024 • 8 • 11

kalo-team/llama3-4x8b-pythonT2_step_final

Text Generation • 25B • Updated May 22, 2024 • 8 • 13

jerryyun/kicon_mixtral87_merged_torch212

Text Generation • 47B • Updated May 20, 2024 • 4

GenTrendGPT/Moey

Text Generation • 0.9B • Updated May 20, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-2_2bpw_exl2

Text Generation • Updated May 21, 2024 • 4

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-2_5bpw_exl2

Text Generation • Updated May 21, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-3_0bpw_exl2

Text Generation • Updated May 21, 2024 • 4

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-3_5bpw_exl2

Text Generation • Updated May 21, 2024 • 5

nvidia/NeKo-v0-post-correction

Text Generation • 47B • Updated Aug 28, 2025 • 98 • 2

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-3_75bpw_exl2

Text Generation • Updated May 21, 2024 • 6

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-4_0bpw_exl2

Text Generation • Updated May 21, 2024 • 6

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-4_25bpw_exl2

Text Generation • Updated May 21, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-5_0bpw_exl2

Text Generation • Updated May 21, 2024 • 5

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-6_0bpw_exl2

Text Generation • Updated May 21, 2024 • 8

Zoyd/TIGER-Lab_MAmmoTH2-8x7B-6_5bpw_exl2

Text Generation • Updated May 21, 2024 • 5

SthanikamSanthosh/MedPaxTral-2x7b_0.1

Text Generation • 10B • Updated May 21, 2024 • 7

VictorDCh/Llama-3-8B-Instruct-MoE-2-spider-3

25B • Updated May 28, 2024 • 3

VictorDCh/Llama-3-8B-Instruct-MoE-2-spider-3.2

25B • Updated May 21, 2024 • 3

dengpanyin/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • 47B • Updated May 21, 2024 • 8

RichardErkhov/yunconglong_-_DARE_TIES_13B-4bits

Text Generation • 13B • Updated May 21, 2024 • 6

Undi95/Llama-3-Chatty-2x8B

Text Generation • 14B • Updated May 22, 2024 • 8 • 11

OpenBuddy/openbuddy-yi1.5-9b-v21.1-32k

Text Generation • 9B • Updated May 22, 2024 • 8.25k • 1

FredrikBL/MoEnsterBeagle

Text Generation • 24B • Updated May 22, 2024 • 12

HaikuEU/mixtral-fine-tuned-vanilla

Text Generation • 47B • Updated May 22, 2024 • 5

andrewrreed/Mixtral-8x7B-Instruct-v0.1-neuron-bs1-sl8k

Text Generation • Updated May 22, 2024 • 7