File size: 5,031 Bytes
77da5ce
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
# Mentor Meeting Playbook — LifeStack Engine

## The Core Framing
**Research Question:** "Can a small model (1.5B) learn to navigate multi-domain, causally-coupled crises better than a base LLM, using GRPO with a 7-day horizon reward?"

---

## Slide Deck Structure (8 Slides Max)

### Slide 1 — The Gap (30 sec)
*   **Current AI:** Single-turn advice, no state, no consequence modeling.
*   **LifeStack:** Life as a Markov Decision Process — 23 metrics, 6 domains, 40 causal edges.
*   **Hook:** "We built the environment that lets you train models on the 'ripple effects' of human decisions."

### Slide 2 — The Environment (1 min)
*   **Standards-Based:** LifeStackEnv extends `openenv.Environment`.
*   **Causal Foundation:** 40 edges from Starcke & Brand (2012) — research-grounded, not arbitrary.
*   **Deterministic World:** `DependencyGraph.propagate()` uses matrix math, not LLM hallucination.
*   **State Vector:** 26-dim observation space across 23 tracked metrics.

### Slide 3 — The Cascade (The Visual Hook)
*   **Visual:** Screenshot/GIF of the 4-frame cascade animation (STABLE → DISRUPTION → 1ST CASCADE → 2ND CASCADE).
*   **Narrative:** "A $350 flight rebooking cascades into stress (day 1) → sleep loss (day 2) → relationship strain (day 4). Our graph engine computes this propagation."

### Slide 4 — Training Setup (45 sec)
*   **Model:** Qwen2.5-1.5B-Instruct, fine-tuned with GRPO via HuggingFace TRL.
*   **Reward:** 7-signal orchestrator (Milestone, Outcome, Preservation, Replan, Efficiency, Reasoning Coherence).
*   **Innovation:** **$\gamma=0.9$ discounted 7-day rollout.** Decisions are penalized today if they cause system collapse on day 4.

### Slide 5 — The Research Result (Comparison)
| Feature | Untrained LLM (Base) | GRPO-Trained LifeStack |
| :--- | :--- | :--- |
| **Logic** | Treats each action independently | Reasons across all 6 domains |
| **Budgeting** | Maximizes single metric | Preserves global resource budget |
| **Strategy** | Generic advice | Reward-shaped justification |
| **Memory** | None | RAG memory flywheel (+116% efficiency) |

### Slide 6 — Memory Flywheel
*   **The Numbers:** Cold start 42% success rate → Warm (RAG) 88% success rate.
*   **The Edge:** ChromaDB retrieval lets the agent reason from past successful precedents.

### Slide 7 — Current Progress (Status)
*   **Live:** Flask demo on HuggingFace Spaces.
*   **Functionality:** 6 working tabs including Comparison, Personality Lab, and What-If Lab.
*   **Pipeline:** GRPO training backbone complete; model lazy-loads for instant demo reliability.

### Slide 8 — Next Steps
*   **Full Multi-Step Evaluation:** Running 30-day episodes (beyond single-action).
*   **Real Data Ingestion:** OAuth for Gmail/Calendar signals (currently stubbed).
*   **Quantitative Scaling:** Benchmarking 1000+ synthetic scenarios.

---

## Demo Script (The 4-Step Sequence)

1.  **Stage the Crisis:** Open the "Situational Portal". Select Alex (Executive) + Career crisis.
2.  **The Cascade:** Hit "Start Simulation". Let the 4-frame animation play. **Silence for 5 seconds.** Then: "Every color change was computed by the graph, zero LLM involvement yet."
3.  **The Heatmap:** Point at the Red cells. "Red means crisis. Notice how a work deadline dragged Physical Health into the red. The agent must now resolve this composite state."
4.  **The Comparison:** Switch to "Trained vs Untrained". Hit "Run Comparison". "On the left is the raw model. On the right is the model after RL feedback on our 7-day reward signal."

---

## Counter-Questions & Defensive Positioning (QA)

| Question | Winning Answer |
| :--- | :--- |
| **"Is this just prompt engineering?"** | "No. We modified model weights via GRPO. The reward comes from the environment simulator, not a system prompt." |
| **"Your environment is hand-coded?"** | "The environment physics are expert-coded (research-based); the policy navigating them is learned. Chess rules are coded, but AlphaZero is a research breakthrough." |
| **"How do you prevent reward hacking?"** | "Triple-check: Reasoning audit, resource preservation costs, and discounted 7-day rollouts penalize short-sighted wins." |
| **"Why 1.5B parameters?"** | "Intentional. It allows consumer-local deployment (privacy) and makes the RL training signal highly measurable." |

---

## The Perfect Hook

### Opening (30 Seconds)
> "Most AI tools give you advice. LifeStack gives you consequences. We built a 6-domain, 23-metric RL environment where a career crisis cascades into sleep loss, relationship strain, and financial pressure—all causally linked. Then we trained a model to navigate that using GRPO. The question we're answering is: can a 1.5B model, trained on life-state rewards, make better long-term decisions than an untrained LLM? We can show you the delta right now."

### Closing (The Final Word)
> "The real contribution isn't the UI—its the environment + training loop. Everything you see in the demo is an artifact of that system working."