Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

LoneStriker/Norobara-ZLoss-8x7B-4.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 7

LoneStriker/Norobara-ZLoss-8x7B-5.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 8

LoneStriker/Norobara-ZLoss-8x7B-6.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 8

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-3.7bpw-h6-exl2-rpcal

Text Generation • Updated Jan 6, 2024 • 7

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-6.0bpw-h6-exl2-rpcal

Text Generation • Updated Jan 7, 2024 • 6 • 1

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-3.5bpw-h6-exl2-rpcal

Text Generation • Updated Jan 7, 2024 • 6

TheBloke/Beyonder-4x7B-v2-GPTQ

Text Generation • 24B • Updated Jan 5, 2024 • 10 • 6

TheBloke/Beyonder-4x7B-v2-GGUF

24B • Updated Jan 5, 2024 • 168 • 38

TheBloke/Beyonder-4x7B-v2-AWQ

Text Generation • 24B • Updated Jan 5, 2024 • 7 • 3

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GGUF

Text Generation • 47B • Updated Jan 5, 2024 • 545 • 12

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-AWQ

Text Generation • 47B • Updated Jan 5, 2024 • 7 • 1

TheBloke/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-GPTQ

Text Generation • 47B • Updated Jan 5, 2024 • 8 • 3

LoneStriker/bagel-8x7b-v0.2-3.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 10

LoneStriker/bagel-8x7b-v0.2-3.5bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 10 • 2

LoneStriker/bagel-8x7b-v0.2-6.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 8

LoneStriker/bagel-8x7b-v0.2-3.75bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 7

LoneStriker/bagel-8x7b-v0.2-4.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 10

LoneStriker/bagel-8x7b-v0.2-5.0bpw-h6-exl2

Text Generation • Updated Jan 5, 2024 • 15

gagan3012/MetaModel_moe_small

Updated Jan 5, 2024

Kquant03/MistralTrix-4x9B-MoE-ERP

Text Generation • 30B • Updated Jan 6, 2024 • 5 • 2

TheBloke/Open_Gpt4_8x7B-AWQ

Text Generation • 47B • Updated Jan 5, 2024 • 9 • 2

TheBloke/Open_Gpt4_8x7B-GGUF

47B • Updated Jan 5, 2024 • 4.45k • 23

TheBloke/Open_Gpt4_8x7B-GPTQ

Text Generation • 47B • Updated Jan 6, 2024 • 20 • 9

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-5.0bpw-h6-exl2-rpcal

Text Generation • Updated Jan 7, 2024 • 6

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-3.75bpw-h6-exl2-rpcal

Text Generation • Updated Jan 7, 2024 • 7

MoEMoEKKung/Frankenstein-MoE-en-10.7Bx4

Text Generation • 36B • Updated Jan 6, 2024 • 47

MoEMoEKKung/Frankenstein-MoE-en-10.7Bx6

Text Generation • 53B • Updated Jan 6, 2024 • 45 • 1

MoEMoEKKung/Frankenstein-MoE-ko-10.7Bx4

Text Generation • 36B • Updated Jan 6, 2024 • 5

intervitens-archive/Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-4.5bpw-h6-exl2-rpcal

Text Generation • Updated Jan 7, 2024 • 7

Danielbrdz/Barcenas-Mixtral-8x7b-4bit

Text Generation • 47B • Updated Jan 6, 2024 • 3