Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

local-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

270

Base only

Active filters: local-inference

MiCkSoftware/laria-rp-0.3

Text Generation • Updated May 24

opensynapselabs/arche3.5-codium-3b

Text Generation • Updated May 25 • 1

meshllm/MiMo-V2.5-Pro-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated Jul 1 • 704

meshllm/Kimi-K2-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 243

ShahzebKhoso/Qwen3-8B-GGUF

Text Generation • 8B • Updated May 25 • 11

ShahzebKhoso/gemma-3-4b-it

Text Generation • 4B • Updated May 25 • 78

ShahzebKhoso/Qwen2.5-Coder-7B-Instruct

Text Generation • 8B • Updated May 25 • 19

meshllm/Kimi-K2.6-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 2.52k

meshllm/GLM-5-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 525

meshllm/MiniMax-M2.7-UD-Q4_K_XL-layers

Text Generation • 4B • Updated Jul 1 • 309

meshllm/Qwen3-VL-235B-A22B-Thinking-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 381

meshllm/NVIDIA-Nemotron-3-Super-120B-A12B-UD-Q4_K_XL-layers

Text Generation • 0.1B • Updated Jul 1 • 184

MiCkSoftware/laria-rp-0.4

Text Generation • Updated May 26

myeongjun77/Qwen3.6-35B-A3B-G-Rotary

Text Generation • Updated May 26

myeongjun77/Qwen3.6-35B-A3B-G-Rotary-X2

Text Generation • Updated May 26

meshllm/Qwen3-VL-235B-A22B-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 206

meshllm/MiniMax-M2.1-UD-Q4_K_XL-layers

Text Generation • 4B • Updated Jul 1 • 223

meshllm/GLM-4.7-REAP-218B-A32B-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jul 1 • 701

meshllm/Mistral-Medium-3.5-128B-UD-Q4_K_XL-layers

Text Generation • 1B • Updated Jul 1 • 2.48k

meshllm/gpt-oss-120b-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 491

meshllm/Qwen3-0.6B-Q4_K_M-layers

Text Generation • 15.7M • Updated Jul 1 • 1.06k

meshllm/Llama-3.3-70B-Instruct-Q3_K_M-draft-layers

Text Generation • 0.9B • Updated Jul 1 • 2.25k

OpenMachineAI/Lulu750M-Instruct-LOCALNOQANT

Text Generation • Updated May 28 • 7 • 2

meshllm/MiniMax-M2.5-UD-Q4_K_XL-layers

Text Generation • 4B • Updated Jul 1 • 2.86k • 1

meshllm/Qwen3.5-122B-A10B-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 380

meshllm/Mistral-Small-4-119B-2603-UD-Q4_K_XL-layers

Text Generation • 3B • Updated Jul 1 • 333 • 1

meshllm/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 3.29k

meshllm/Qwen3-Coder-Next-UD-Q4_K_XL-layers

Text Generation • 2B • Updated Jul 1 • 649

meshllm/DeepSeek-R1-Distill-Llama-70B-UD-Q4_K_XL-layers

Text Generation • 0.9B • Updated Jul 1 • 1.2k • 1

meshllm/NVIDIA-Nemotron-3-Nano-Omni-30B-A3B-Reasoning-UD-Q4_K_XL-layers

Text Generation • 38.7M • Updated Jul 1 • 3.4k