---
title: One for All — Soul Transfer
emoji: 🧬
colorFrom: indigo
colorTo: purple
sdk: gradio
sdk_version: "5.33.2"
app_file: app.py
pinned: false
license: mit
---

![One for All demo](one_for_all.gif)

**One for All** distills 5 heterogeneous teacher LLMs (Qwen2.5-1.5B, SmolLM2-1.7B, Phi-3.5-mini, gemma-2-2b-it, MiniCPM-2B) into a single Qwen2.5-0.5B student via gated CKA geometry distillation (Path B — geometry-only, tokenizer-agnostic).

### Tabs

- **∀ Almas** — 3D UMAP soul space of all 6 models over 24 probe texts. Type a prompt to run the student live on ZeroGPU and see where it lands in the embedding space.
- **⬡ Geometria** — CKA alignment heatmap across all model pairs.
- **↗ Treino** — Loss curves and gate evolution over training steps.