Spaces:
Running on CPU Upgrade
Running on CPU Upgrade
File size: 2,598 Bytes
fef847f e77d0bf 9b4c19e fef847f 9b4c19e bb234a8 e77d0bf fef847f e77d0bf 9b4c19e e77d0bf 9b4c19e a0bac4b 0b3b76f a0bac4b 0b3b76f a0bac4b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 | ---
title: POCKET vs Bonsai · CPU
emoji: ⚔️
colorFrom: yellow
colorTo: green
sdk: docker
app_port: 7860
pinned: true
license: apache-2.0
models:
- FINAL-Bench/POCKET-35B-GGUF
- FINAL-Bench/Darwin-36B-Opus
- prism-ml/Bonsai-27B-gguf
short_description: BONSAI vs POCKET — 35B MoE out-runs the top 1-bit 27B on CPU
---
# BONSAI vs POCKET · live A/B on a CPU
A live demo of **POCKET-35B** (Q2_K, 13 GB) answering on an **upgraded CPU** Space — **no GPU** —
with a second tab that races it **head-to-head against Bonsai-27B** (the most-downloaded 1-bit
on-device model) on the same box, same stock `llama.cpp`. Bonsai answers first, then POCKET —
watch the tok/s.
POCKET is a sparse Mixture-of-Experts model (34.66B total, ~3B active/token) quantized from
[Darwin-36B-Opus](https://huggingface.co/FINAL-Bench/Darwin-36B-Opus). It runs on stock
`llama.cpp` — on a phone, and on a PC with no graphics card.
- 📚 [POCKET collection](https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6)
- 📦 [POCKET-35B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF) · [POCKET-KR-MLX (iPhone)](https://huggingface.co/FINAL-Bench/POCKET-KR-MLX) · [POCKET-EN-GGUF](https://huggingface.co/FINAL-Bench/POCKET-EN-GGUF)
Built with FastAPI + llama-cpp-python. Apache-2.0.
<!-- POCKET-FAMILY -->
---
## 🧩 The POCKET Family — On-device AI by VIDRAFT
*Big models, small hardware. No GPU, no cloud.*
**Models**
- 📦 [POCKET-35B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-35B-GGUF) — flagship, PC / server, no GPU
- 📦 [POCKET-26B-GGUF](https://huggingface.co/FINAL-Bench/POCKET-26B-GGUF) — compact 26B
- 🇰🇷 [POCKET-KR-GGUF](https://huggingface.co/FINAL-Bench/POCKET-KR-GGUF) — Korean, Android
- 🍎 [POCKET-KR-MLX](https://huggingface.co/FINAL-Bench/POCKET-KR-MLX) — Korean, iPhone / Mac
- 🌍 [POCKET-EN-GGUF](https://huggingface.co/FINAL-Bench/POCKET-EN-GGUF) — English, phone / PC
- 🖼️ [POCKET-Image-Zimage](https://huggingface.co/FINAL-Bench/POCKET-Image-Zimage) — character-perfect text in any image
**Demos & tools (Spaces)**
- 🎨 [POCKET-Image Studio](https://huggingface.co/spaces/FINAL-Bench/POCKET-Image-Studio) — text-in-image, generate in-page
- 🖥️ [POCKET-35B-CPU](https://huggingface.co/spaces/FINAL-Bench/POCKET-35B-CPU) — 35B answering on a CPU
- 🖥️ [POCKET-26B-CPU](https://huggingface.co/spaces/FINAL-Bench/POCKET-26B-CPU) — 26B on a CPU
📚 [Full POCKET collection](https://huggingface.co/collections/FINAL-Bench/pocket-models-6a618ee5d23eafb7e185a5c6)
<!-- /POCKET-FAMILY -->
|