Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

local-inference

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

270

Base only

Active filters: local-inference

meshllm/Qwen3-235B-A22B-UD-Q4_K_XL-layers

Text Generation • 2B • Updated May 9 • 965

Kaniskten/Kail_F2

Text Generation • Updated Jun 10 • 9 • 1

meshllm/Qwen3-Coder-480B-A35B-Instruct-UD-Q4_K_XL-layers

Text Generation • 8B • Updated May 9 • 24

meshllm/DeepSeek-V3.2-UD-Q4_K_XL-layers

Text Generation • 0.6B • Updated May 9 • 518

OusiaResearch/AurethV2-4B-GGUF

Text Generation • 4B • Updated May 5 • 80 • 1

meshllm/Qwen3-32B-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 1.19k

meshllm/Qwen3-8B-Q4_K_M-layers

Text Generation • 0.2B • Updated May 9 • 8.25k

MiCkSoftware/laria-rp-0.1

Text Generation • Updated May 7 • 12

meshllm/Kimi-K2-Thinking-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated May 9 • 78

meshllm/gemma-4-26B-A4B-it-UD-Q4_K_M-layers

Text Generation • 0.8B • Updated May 9 • 17.5k • 1

meshllm/Kimi-K2.5-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 1.33k

meshllm/GLM-5.1-UD-Q4_K_XL-layers

Text Generation • 0.4B • Updated Jul 1 • 1.64k

meshllm/DeepSeek-R1-Q4_K_M-layers

Text Generation • 0.6B • Updated Jul 1 • 1.87k

MiCkSoftware/laria-rp-0.2

Text Generation • Updated May 8 • 6

meshllm/Mistral-Large-3-675B-Instruct-2512-UD-Q4_K_XL-layers

Text Generation • 0.5B • Updated Jul 1 • 193

OusiaResearch/Aureth-9B-Qwen3.5

Text Generation • Updated May 9

auro-rirum/LogSage-Qwen2.5-7B-QLoRA-v0

Text Generation • Updated May 19 • 13

meshllm/Trinity-Large-Preview-UD-Q4_K_XL-layers

Text Generation • 0.2B • Updated Jul 1 • 180

meshllm/Qwen3.5-397B-A17B-UD-Q4_K_XL-layers

Text Generation • 7B • Updated Jul 1 • 546 • 1

meshllm/Llama-4-Maverick-17B-128E-Instruct-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jul 1 • 495

meshllm/GLM-4.7-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jul 1 • 2.07k

meshllm/MiMo-V2.5-UD-Q4_K_XL-layers

Text Generation • 0.3B • Updated Jul 1 • 145

stamsam/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MLX-oQ4-MTP

Text Generation • 35B • Updated May 12 • 3.22k • 25

elizaos/eliza-1

2B • Updated Jul 4 • 64.7k • 5

robertolofaro/books-model

Text Generation • 4B • Updated May 17 • 4

robertolofaro/aiethics-model

Text Generation • 4B • Updated May 23 • 2

mesklintech/mesko-llm-7b

Updated May 19 • 1

robertolofaro/articles-model

Text Generation • 4B • Updated May 22 • 23

zelk12/MedusaGemma-E4B-Q6_K-GGUF

Text Generation • 8B • Updated May 21 • 20

prokopsafranek/gemma-4-26B-A4B-it-GGUF

Text Generation • 25B • Updated Jun 4 • 82 • 1