Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,221

Base only

Active filters: mixtral

comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v3

Text Generation • 47B • Updated Jun 10, 2024 • 5

comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v2

Text Generation • 141B • Updated Jun 10, 2024 • 6

InferenceIllusionist/TeTO-MS-8x7b

Text Generation • 47B • Updated Jun 13, 2024 • 10 • 4

fxmeng/PiSSA-Mixtral-8x7B-4bit-r64-5iter

Text Generation • 47B • Updated Jun 11, 2024 • 4

Quant-Cartel/TeTO-MS-8x7b-iMat-GGUF

47B • Updated Jun 13, 2024 • 344 • 1

FuturisticVibes/Mixtral-8x22B-Instruct-v0.1-8.0bpw-h8-exl2

Text Generation • Updated Jun 12, 2024 • 3 • 1

solidrust/Ayam-2x8B-AWQ

Text Generation • 14B • Updated Sep 3, 2024 • 8

Souvik3333/Llama-3-3x8B-multilingual

Text Generation • 19B • Updated Jun 21, 2024 • 7

RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8

Text Generation • 141B • Updated Aug 12, 2024 • 18 • 3

Quant-Cartel/TeTO-MS-8x7b-exl2-rpcal

Updated Jun 18, 2024 • 3

solidrust/Inixion-2x8B-AWQ

Text Generation • 14B • Updated Sep 3, 2024 • 5

minchyeom/MemGPT-experiment-2

Text Generation • 13B • Updated Jun 12, 2024 • 8

gghfez/WizardLM-2-8x22B-Beige

Text Generation • 141B • Updated Jun 15, 2024 • 7 • 4

aws-neuron/hermes-mixtral-instruct-seqlen-4096-bs-4-optimum-0-0-23

Text Generation • Updated Jun 14, 2024 • 14

RaphaelMourad/Mistral-DNA-v1-417M-Athaliana

Text Generation • 0.4B • Updated Dec 13, 2024 • 7 • 1

Kaoeiri/PantheraMax-L3-RP-TestProbe-4-4x8B

Text Generation • 25B • Updated Dec 31, 2024 • 8

opake/IbuMedTrial-2x7B

Text Generation • 10B • Updated Jun 15, 2024 • 7

gghfez/WizardLM-2-8x22B-Beige-exl2_5.0bpw

Text Generation • Updated Jun 18, 2024 • 11

gagandwaz/MedPaxTral-2x7b

Text Generation • Updated Jun 15, 2024 • 7

gagandwaz/MedPaxTral-2

Text Generation • Updated Jun 15, 2024 • 8

gagandwaz/MedPaxTral-2-fin

Text Generation • Updated Jun 15, 2024 • 10

LoneStriker/WizardLM-2-8x22B-Beige-2.4bpw-h6-exl2

Text Generation • Updated Jun 15, 2024 • 7

LoneStriker/WizardLM-2-8x22B-Beige-3.0bpw-h6-exl2

Text Generation • Updated Jun 15, 2024 • 7

LoneStriker/WizardLM-2-8x22B-Beige-4.0bpw-h6-exl2

Text Generation • Updated Jun 15, 2024 • 9

LoneStriker/WizardLM-2-8x22B-Beige-5.0bpw-h6-exl2

Text Generation • Updated Jun 15, 2024 • 9

LoneStriker/WizardLM-2-8x22B-Beige-6.0bpw-h6-exl2

Text Generation • Updated Jun 15, 2024 • 7

xi0v/Mixtral-test

Text Generation • 19B • Updated Jun 16, 2024

MrezaPRZ/experts_3x7B

Text Generation • 15B • Updated Jun 16, 2024 • 7

aspirina765/Beyonder-4x7B-v3

Text Generation • 24B • Updated Jun 16, 2024 • 7 • 1

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B

Text Generation • 141B • Updated Jun 17, 2024 • 13 • 4