A newer version of the Gradio SDK is available: 6.17.3
metadata
title: One for All — Soul Transfer
emoji: 🧬
colorFrom: indigo
colorTo: purple
sdk: gradio
sdk_version: 5.33.2
app_file: app.py
pinned: false
license: mit
One for All distills 5 heterogeneous teacher LLMs (Qwen2.5-1.5B, SmolLM2-1.7B, Phi-3.5-mini, gemma-2-2b-it, MiniCPM-2B) into a single Qwen2.5-0.5B student via gated CKA geometry distillation (Path B — geometry-only, tokenizer-agnostic).
Tabs
- ∀ Almas — 3D UMAP soul space of all 6 models over 24 probe texts. Type a prompt to run the student live on ZeroGPU and see where it lands in the embedding space.
- ⬡ Geometria — CKA alignment heatmap across all model pairs.
- ↗ Treino — Loss curves and gate evolution over training steps.