Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,223

Base only

Active filters: mixtral

raincandy-u/Llama-3-Aplite-Instruct-4x8B-MoE

Text Generation • 25B • Updated May 12, 2024 • 21 • 39

lodrick-the-lafted/Copus-2x8B

Text Generation • 14B • Updated Apr 20, 2024 • 11 • 1

jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit

Text Generation • 141B • Updated May 5, 2024 • 35 • 1

JSpergel/test_tiny_mixtral_only_router_2

Text Generation • 0.7B • Updated Apr 20, 2024 • 9

jieunhan/solar-merge-v1.0

Text Generation • 19B • Updated Apr 20, 2024 • 7 • 1

blockblockblock/Copus-2x8B-bpw2.25

Text Generation • Updated Apr 20, 2024 • 6

blockblockblock/Copus-2x8B-bpw2.5

Text Generation • Updated Apr 20, 2024 • 5

RyotaKadoya1993/MoE_Test

Text Generation • 22B • Updated Apr 20, 2024 • 4

blockblockblock/Copus-2x8B-bpw3

Text Generation • Updated Apr 20, 2024 • 6

aipib/Tinyllama-moe3

Text Generation • 2B • Updated May 3, 2024 • 68

blockblockblock/Copus-2x8B-bpw3.5

Text Generation • Updated Apr 20, 2024 • 5

MaziyarPanahi/Llama-3-Smaug-8B-GGUF

Text Generation • 8B • Updated Apr 20, 2024 • 1.07k • 5

blockblockblock/Copus-2x8B-bpw3.7

Text Generation • Updated Apr 20, 2024 • 4

jieunhan/solar_merge_test_1

Text Generation • 19B • Updated Apr 21, 2024 • 6

blockblockblock/Copus-2x8B-bpw4

Text Generation • Updated Apr 20, 2024 • 5

jieunhan/solar_merge_test_2

Text Generation • 36B • Updated Apr 21, 2024 • 7

blockblockblock/Copus-2x8B-bpw4.2

Text Generation • Updated Apr 20, 2024 • 5

blockblockblock/Copus-2x8B-bpw4.4

Text Generation • Updated Apr 20, 2024 • 5

blockblockblock/Copus-2x8B-bpw4.6

Text Generation • Updated Apr 20, 2024 • 4

blockblockblock/Copus-2x8B-bpw4.8

Text Generation • Updated Apr 20, 2024 • 5

blockblockblock/Copus-2x8B-bpw5

Text Generation • Updated Apr 20, 2024 • 9

blockblockblock/Copus-2x8B-bpw5.5

Text Generation • Updated Apr 20, 2024 • 6

blockblockblock/Copus-2x8B-bpw6

Text Generation • Updated Apr 20, 2024 • 6

InferenceIllusionist/WizardLM-2-8x22B-iMat-GGUF

141B • Updated Jun 15, 2024 • 81 • 1

FelixChao/llama-3-4x8B

Text Generation • 25B • Updated Apr 26, 2024 • 10

AIFS/Llama3-8x8B-Time-Agents

Question Answering • 47B • Updated May 24, 2024 • 14

inventbot/Mixtral-8x7B-Instruct-v0.1

Text Generation • Updated May 26, 2024 • 8

AIFS/Llama3-4x8B-Time-Agents

Question Answering • 25B • Updated May 24, 2024 • 4

jarrelscy/Mixtral-8x22B-Instruct-v0.1-GPTQ-8bit

Text Generation • 141B • Updated Apr 21, 2024 • 7

yam-peleg/Hebrew-Mixtral-8x22B

Text Generation • 141B • Updated Apr 21, 2024 • 9 • 24