---
title: POCKET-26B vs Bonsai · CPU (Gemma4-based)
emoji: ⚔️
colorFrom: green
colorTo: yellow
sdk: docker
app_port: 7860
pinned: true
license: apache-2.0
models:
- google/gemma-4-26B-A4B-it
- FINAL-Bench/POCKET-26B-GGUF
- prism-ml/Bonsai-27B-gguf
short_description: BONSAI vs POCKET — 26B Gemma4 MoE out-runs a 27B on CPU
---

# BONSAI vs POCKET-26B · live A/B on a CPU

A live demo of **POCKET-26B** (Q4_K_M, 17 GB) answering on an **upgraded CPU** Space — **no GPU** —
with a second tab that races it **head-to-head against Bonsai-27B** (the most-downloaded 1-bit
on-device model) on the same box, same stock `llama.cpp`. Bonsai answers first, then POCKET —
watch the tok/s.

POCKET-26B is the **Gemma4 sibling** of the POCKET family: built from Google's
[Gemma4-26B-A4B](https://huggingface.co/google/gemma-4-26B-A4B-it) (Apache-2.0), a sparse
Mixture-of-Experts model (25.2B total, ~4B active/token). It is **unpruned** and keeps
**GPQA-Diamond 67%** — on par with the full base — via Korean-imatrix calibration and
mixed-precision quantization. Runs on stock `llama.cpp`: on a 12 GB phone, and on a PC with no graphics card.

- 🧠 [Gemma4-26B-A4B (base)](https://huggingface.co/google/gemma-4-26B-A4B-it)
- 📦 [POCKET-26B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-26B-GGUF) · [POCKET-35B (Qwen sibling)](https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF)
- 📚 [POCKET collection](https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6)

Built with FastAPI + prebuilt `llama.cpp`. Apache-2.0 · a VIDRAFT model family. This Space runs on CPU hardware only.

<!-- POCKET-FAMILY -->

---

## 🧩 The POCKET Family — On-device AI by VIDRAFT

*Big models, small hardware. No GPU, no cloud.*

**Models**
- 📦 [POCKET-35B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF) — flagship, PC / server, no GPU
- 📦 [POCKET-26B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-26B-GGUF) — compact 26B
- 🇰🇷 [POCKET-KR-GGUF](https://huggingface.co/FINAL-Bench/POCKET-KR-GGUF) — Korean, Android
- 🍎 [POCKET-KR-MLX](https://huggingface.co/FINAL-Bench/POCKET-KR-MLX) — Korean, iPhone / Mac
- 🌍 [POCKET-EN-GGUF](https://huggingface.co/FINAL-Bench/POCKET-EN-GGUF) — English, phone / PC
- 🖼️ [POCKET-Image-Zimage](https://huggingface.co/FINAL-Bench/POCKET-Image-Zimage) — character-perfect text in any image

**Demos & tools (Spaces)**
- 🎨 [POCKET-Image Studio](https://huggingface.co/spaces/FINAL-Bench/POCKET-Image-Studio) — text-in-image, generate in-page
- 🖥️ [POCKET-35B-CPU](https://huggingface.co/spaces/FINAL-Bench/POCKET-35B-CPU) — 35B answering on a CPU
- 🖥️ [POCKET-26B-CPU](https://huggingface.co/spaces/FINAL-Bench/POCKET-26B-CPU) — 26B on a CPU

📚 [Full POCKET collection](https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6)

<!-- /POCKET-FAMILY -->