Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

distributed-inference

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

131

Base only

Active filters: distributed-inference

meshllm/Qwen3-VL-235B-A22B-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated about 22 hours ago • 1.51k

meshllm/MiniMax-M2.1-UD-Q4_K_XL-layers

Text Generation • 4B • Updated about 22 hours ago • 1.29k

meshllm/GLM-4.7-REAP-218B-A32B-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated about 22 hours ago • 828

meshllm/Mistral-Medium-3.5-128B-UD-Q4_K_XL-layers

Text Generation • 1B • Updated about 22 hours ago • 6.8k

meshllm/gpt-oss-120b-UD-Q4_K_XL-layers

Text Generation • 3B • Updated about 22 hours ago • 1.17k

meshllm/Qwen3-0.6B-Q4_K_M-layers

Text Generation • 15.7M • Updated about 22 hours ago • 1.78k

meshllm/Llama-3.3-70B-Instruct-Q3_K_M-draft-layers

Text Generation • 0.9B • Updated about 22 hours ago • 2.01k

meshllm/MiniMax-M2.5-UD-Q4_K_XL-layers

Text Generation • 4B • Updated about 22 hours ago • 2.3k

meshllm/Qwen3.5-122B-A10B-UD-Q4_K_XL-layers

Text Generation • 3B • Updated about 22 hours ago • 870

meshllm/Mistral-Small-4-119B-2603-UD-Q4_K_XL-layers

Text Generation • 3B • Updated about 22 hours ago • 489

meshllm/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated about 22 hours ago • 1.21k

meshllm/Qwen3-Coder-Next-UD-Q4_K_XL-layers

Text Generation • 2B • Updated about 22 hours ago • 736

meshllm/DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL-layers

Text Generation • 0.9B • Updated about 22 hours ago • 6.19k

meshllm/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated about 22 hours ago • 940

meshllm/gemma-4-31B-it-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated about 22 hours ago • 909

meshllm/Step-3.7-Flash-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated about 22 hours ago • 785

meshllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated about 22 hours ago • 915

meshllm/Nemotron-3-Nano-30B-A3B-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated about 22 hours ago • 964

meshllm/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-layers

Text Generation • 0.5B • Updated about 22 hours ago • 2.34k

meshllm/Qwen3-Next-80B-A3B-Thinking-UD-Q4_K_XL-layers

Text Generation • 2B • Updated about 22 hours ago • 792

meshllm/granite-4.1-30b-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated about 22 hours ago • 959

meshllm/GLM-4.7-Flash-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated about 22 hours ago • 940

meshllm/gemma-3-27b-it-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated about 22 hours ago • 879

meshllm/Mistral-Small-3.2-24B-Instruct-2506-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated about 22 hours ago • 664

meshllm/Qwen3.6-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated about 22 hours ago • 1.73k

meshllm/Devstral-Small-2505-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated about 22 hours ago • 1.16k

meshllm/GLM-4.7-Flash-REAP-23B-A3B-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated about 22 hours ago • 1.13k

meshllm/ERNIE-4.5-21B-A3B-PT-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated about 22 hours ago • 503

meshllm/Qwen3.5-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated about 22 hours ago • 2.06k

meshllm/Devstral-Small-2-24B-Instruct-2512-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated about 22 hours ago • 1.82k