gguf-org/desktop-server

desktop server

support: 🐧linux/ubuntu, 🖥️ macOS (metal), 💻 windows (cpu/gpu)

• get it here

features

• 💫 super fast server 🐷
• 👁️ vision clip supported
• 🔨 tool sets supported (depends on model selected)

examples

• interact the desktop server with durian (see setup below)

• computer use agent (see here)
• agent with vision and tool use capabilities (see here)

• inspect a picture (see above - vision); vibe code a tic tac toe game (see below - tool)

• note: for gemma-4-12b-it-gguf+mmproj, please upgrade to the latest version of gguf-desktop

• new feature - diffusion panel (example here)
• city advanture (see below)

• 3d mode

• serve it as backend of https://game.gguf.org

World Cup 2026 ⚽ San Francisco Bay Area