Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

103

Base only

Active filters: layer-package

meshllm/gpt-oss-120b-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 456

meshllm/Qwen3-0.6B-Q4_K_M-layers

Text Generation • 15.7M • Updated Jul 1 • 1.11k

meshllm/Llama-3.3-70B-Instruct-Q3_K_M-draft-layers

Text Generation • 0.9B • Updated Jul 1 • 2.26k

meshllm/MiniMax-M2.5-UD-Q4_K_XL-layers

Text Generation • 4B • Updated Jul 1 • 2.89k • 1

meshllm/Qwen3.5-122B-A10B-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 380

meshllm/Mistral-Small-4-119B-2603-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 333 • 1

meshllm/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 3.31k

meshllm/Qwen3-Coder-Next-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 646

meshllm/DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL-layers

Text Generation • 0.9B • Updated Jul 1 • 1.14k • 1

meshllm/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated Jul 1 • 3.41k

meshllm/gemma-4-31B-it-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 3.29k

meshllm/Step-3.7-Flash-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated Jul 1 • 187

meshllm/Qwen3-Next-80B-A3B-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 130

meshllm/Nemotron-3-Nano-30B-A3B-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated Jul 1 • 68

meshllm/DeepSeek-R1-Distill-Qwen-32B-Q4_K_M-layers

Text Generation • 0.5B • Updated Jul 1 • 1.32k

meshllm/Qwen3-Next-80B-A3B-Thinking-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 933

meshllm/granite-4.1-30b-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 614

meshllm/GLM-4.7-Flash-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated Jul 1 • 524

meshllm/gemma-3-27b-it-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 474

meshllm/Mistral-Small-3.2-24B-Instruct-2506-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 42

meshllm/Qwen3.6-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated Jul 1 • 1.6k

meshllm/Devstral-Small-2505-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 960

meshllm/GLM-4.7-Flash-REAP-23B-A3B-UD-Q4_K_XL-layers

Text Generation • 84.7M • Updated Jul 1 • 1.01k • 3

meshllm/ERNIE-4.5-21B-A3B-PT-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated Jul 1 • 560

meshllm/Qwen3.5-35B-A3B-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated Jul 1 • 1.08k

meshllm/Devstral-Small-2-24B-Instruct-2512-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 308

meshllm/ERNIE-4.5-21B-A3B-Thinking-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated Jul 1 • 149

meshllm/gpt-oss-20b-UD-Q4_K_XL-layers

Text Generation • 0.8B • Updated Jul 1 • 2.53k

meshllm/Qwen3-VL-32B-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 1.54k

meshllm/DeepSeek-R1-Distill-Qwen-14B-Q4_K_M-layers

Text Generation • 0.3B • Updated Jul 1 • 1.31k