Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

tensor-parallel

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: tensor-parallel

dealignai/DeepSeek-V4-Flash-0731-CRACK-NVFP4

Text Generation • 304B • Updated 16 days ago • 1.77k • 19

0xSero/Ornith-1.5-35B-A3B-EXL3-2.75bpw

Text Generation • 9B • Updated 1 day ago • 2

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP1

0.7B • Updated May 4 • 7

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP2

0.7B • Updated May 4 • 6

ekovshilovsky/Qwen2.5-0.5B-TQ8-TP4

0.7B • Updated May 4 • 4

dominant-strategies/quai-deepseek-v4-flash-igemm-fp4fp8

Text Generation • Updated Jun 19 • 13

dominant-strategies/quai-deepseek-v4-flash-igemm-w8a8

Text Generation • Updated Jun 19 • 75

Cadododoom/Qwen3.6-35B-A3B-TextOnly-FP4

18B • Updated Jul 4 • 195

Cadododoom/Agents-A1-TextOnly-FP4

18B • Updated Jul 9 • 20 • 2

mitomtuna/MiMo-V2.5-NVFP4-TP3

200B • Updated Jul 10 • 15 • 1

mitomtuna/MiMo-V2.5-DFlash-TP3

2B • Updated Jul 8 • 19 • 1

mitomtuna/MiMo-V2.5-0703-NVFP4-TP3

200B • Updated Jul 13 • 36 • 6

xbill9/gemma-4-E4B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-12B-it-inferentia2

Text Generation • Updated Jul 12 • 1

xbill9/gemma-4-31B-it-inferentia2

Text Generation • Updated Jul 16

xbill9/gemma-4-26B-A4B-it-inferentia2

Text Generation • Updated Jul 16

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated Jul 21 • 142 • 2

marianbusoi/Hy3-NVFP4-FP8-TP3

Text Generation • 300B • Updated about 1 month ago • 24

Cadododoom/agents-a1-modelopt-nvfp4

18B • Updated about 1 month ago • 75

Cadododoom/qwen3.6-35b-a3b-modelopt-nvfp4

18B • Updated about 1 month ago • 33

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8

Text Generation • Updated 23 days ago • 4

bertholomus/DeepSeek-V4-Flash-0731-DSpark-Graph8-4xGB10

Text Generation • Updated 14 days ago • 1

leoncca/Qwen3.5-122B-A10B-Heretic-Selective-AWQ

Image-Text-to-Text • 125B • Updated 3 days ago • 107

guruswami-ai/deepseek-v4-pro-0813-mlx-tp4-recipe

Text Generation • Updated 14 days ago • 1

pottokao/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated 9 days ago • 770 • 2

eemin/Qwen3.8-27B-NVFP4-MTP-2x16GB

Text Generation • 19B • Updated 8 days ago • 142

waqasm86/kaggle-vllm-models

Text Generation • Updated 3 days ago • 115

leoncca/Qwen3.8-27B-Huihui-AWQ

Image-Text-to-Text • 28B • Updated 2 days ago • 59

0xSero/Ornith-1.5-35B-A3B-EXL3-3bpw

Text Generation • 9B • Updated 1 day ago

0xSero/Ornith-1.5-35B-A3B-EXL3-3.5bpw

Text Generation • 10B • Updated 1 day ago