| --- |
| language: |
| - en |
| - vi |
| tags: |
| - mamba |
| - hypernetwork |
| - persona |
| - grpo |
| - personalization |
| license: mit |
| --- |
| |
| # Mamba Hypernetwork Personalization v2 |
|
|
| Mamba-based hypernetwork trained with GRPO to inject persona-conditioned deltas into LLM attention layers. |
|
|
| ## Architecture |
| - **Hypernetwork:** Mamba SSM encoder + delta heads (LoRA-style) |
| - **Target LLM:** Injected via forward hooks on q_proj / v_proj (8 layers) |
| - **Training:** GRPO with combined reward (RM + CR + PL + DIV) |
|
|
| ## Training Config |
| - LR: 1e-5 (cosine schedule) |
| - LAMBDA_GRPO: 0.2 |
| - LAMBDA_KL: 0.08 |
| - DELTA_SCALE: 0.003 |
| - Epochs: 5 | Steps: 350 |
| |
| ## Reward Weights |
| | Metric | Weight | Description | |
| |--------|--------|-------------| |
| | RM | +0.55 | Persona grounding | |
| | CR | +0.25 | Context relevance | |
| | PL | -0.30 | Persona leakage penalty | |
| | DIV | +0.10 | Response diversity | |
| |
| ## Checkpoint Info |
| - Saved at: epoch 5, step 400 |
| - Date: 2026-05-13 |
| |
| ## Files |
| - `mamba_weights_only.pt` — model weights only (for inference) |
| - `ckpt_e5_s350.pt` — full checkpoint (for resume training) |
| |
