description: Layer package for unsloth/Kimi-K2-Thinking-GGUF:UD-Q4_K_XL

runtime: multi-machine

size: 61 layers

source_revision: main


description: Draft for Qwen2.5 and DeepSeek-R1-Distill models

runtime: single-machine


description: Small & fast general chat


description: Top-tier code gen, matches GPT-4o on code


description: Code generation & completion


description: Qwen3 Coder Next ~85B dense, frontier coding model

revision: main


description: Goose default, strong tool calling for agents


description: Draft for Llama 3.x and Llama 4 models


description: Meta Llama 3.2, goose default, good tool calling


description: Solid general chat


description: Proven general chat


description: Strong code gen, fills gap between 7B and 32B


description: Draft for Gemma 3 models


description: Google Gemma 3 27B, strong reasoning


description: MoE 109B/17B active, 16 experts top-1, Meta latest, tool calling


description: DeepSeek R1 reasoning distilled into Qwen 14B


description: DeepSeek R1 reasoning distilled into Qwen 32B


description: DeepSeek V3.2 MoE 671B, frontier general model, requires multi-node


description: Mistral agentic coding, tool use


description: Strong 32B, good tool calling


description: MoE 30B/3B active, 64 experts top-4, fast inference, tool calling


description: MiniMax-M2.5 MoE 456B/46B active, 256 experts top-8, Q4_K_M


description: Mistral general chat, good tool calling


description: Draft for Qwen3 models


description: Qwen3 strong chat, thinking modes


description: Qwen3 235B MoE, proven at 16 tok/s across 2 nodes


description: MoE general chat, 128 experts top-8, thinking/non-thinking


description: Best Qwen3 dense, thinking/non-thinking modes


description: Qwen3 32B dense, layer package available


description: Qwen3 starter, thinking/non-thinking modes


description: Qwen3 mid-tier, strong for its size


description: MoE agentic coding, tool use, 128 experts top-8


description: Qwen3 Coder 480B MoE, largest coding model, requires multi-node


description: Tiny vision model, OCR, screenshots, runs anywhere


description: Small vision model, good quality/size balance


description: Vision + text, replaces Qwen3-8B with image understanding


description: Google Gemma 3 12B, punches above weight


description: Layer package for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_M

size: 30 layers