widgettdc-api / docs /PHASE_2_PLAN.md
Kraft102's picture
fix: sql.js Docker/Alpine compatibility layer for PatternMemory and FailureMemory
5a81b95

πŸš€ PHASE 2 PLAN – ADVANCED INTELLIGENCE

Duration: 4-5 weeks (Dec 2025)
Owner: Autonomous MCP Team
Status: 🟑 In Progress


🎯 Objectives

  1. Unified GraphRAG – multi-hop reasoning across CMA + SRAG + PAL + ProjectMemory.
  2. Role-Based Agent Teams – specialized agents coordinating via AutonomousTaskEngine.
  3. StateGraphRouter – LangGraph-inspired orchestration of decision states.
  4. PatternEvolutionEngine – evolutionary strategy engine with creative exploration.

πŸ—‚οΈ Work Breakdown

Week 5-6 – GraphRAG + Agent Teams

Task Description Owner
Schema Design Define graph schema (entities, relations, embeddings) Memory Team
Graph Indexer Build ingestion pipeline β†’ GraphIndexer service Memory Team
Reasoning Engine Implement UnifiedGraphRAG.ts (multi-hop search, beam width config) Intelligence Team
Agent Roles Define Strategist, Researcher, Guardian, Synthesizer roles Task Engine Team
Task Routing Extend AutonomousTaskEngine to assign roles per task intent Task Engine Team

Week 7-8 – State Router + Pattern Evolution

Task Description Owner
StateGraphRouter Represent decision flow as nodes/edges with guard conditions Orchestration
Memory Hooks Each node can read/write UnifiedMemory snapshots Memory Team
PatternEvolutionEngine Genetic-like mutation of strategies, fitness via KPIs Intelligence Team
Feedback Loop Integrate PAL emotional signals into evolution fitness PAL Team

πŸ”§ Technical Plan

  • Graph Storage: Reuse SQLite (FTS + adjacency tables) for dev, abstract interface for Neo4j/Postgres later.
  • Embeddings: Use existing SRAG embeddings; add relationship embeddings via averaged vectors.
  • Multi-Hop Search: BFS + heuristic scoring, plus optional maxDepth, beamWidth config.
  • Agent Roles: YAML definition in config/agentRoles.yml + runtime loader.
  • StateGraphRouter: JSON/TS definition of nodes, each node points to handler + success/fail transitions.
  • Pattern Evolution: Maintain population of strategies; evaluation uses telemetry + PAL signals; store in pattern_strategies table.

βœ… Deliverables

  1. apps/backend/src/mcp/cognitive/UnifiedGraphRAG.ts
  2. apps/backend/src/mcp/cognitive/StateGraphRouter.ts
  3. apps/backend/src/mcp/cognitive/PatternEvolutionEngine.ts
  4. Updates to AutonomousTaskEngine.ts for role assignments
  5. Config docs: docs/PHASE_2_GUIDE.md

πŸ“… Milestones

Date Milestone
Week 5 end Graph schema + GraphRAG prototype
Week 6 end Role-based agents live in TaskEngine
Week 7 end StateGraphRouter orchestrating decisions
Week 8 end PatternEvolutionEngine generating new strategies

🚨 Risks & Mitigations

  • Graph Complexity – enforce depth/beam limits; fallback to classical SRAG if query too broad.
  • Agent Conflicts – Guardian role monitors conflicting outputs.
  • Performance – nightly batch evaluations for PatternEvolution to avoid runtime spikes.

πŸ“’ Next Actions

  1. Build graph schema + ingestion helpers.
  2. Scaffold UnifiedGraphRAG.ts.
  3. Define role templates + update TaskEngine.
  4. Design StateGraphRouter JSON schema.