================================================================================ TOKENGUARD INTEGRATION GUIDE
Nexus OS v3.0 - Token Monitoring Layer
================================================================================ QUICK START
Import TokenGuard: from src.nexus_os.monitoring.token_guard import TokenGuard
Initialize with budgets: guard = TokenGuard(budgets={ 'agent': 50000, 'skill': 10000, 'swarm': 200000, 'session': 500000 })
Track token usage: guard.track('foreman-1', 1250, operation='inference')
Check budget before operation: if guard.check('foreman-1', 5000): # Proceed with operation pass
Atomic reserve: result = guard.check_and_reserve('foreman-1', 5000) if result['allowed']: # Execute operation
================================================================================ INTEGRATION POINTS
BRIDGE (bridge/server.py):
- Add X-Nexus-Input-Tokens header to responses
- Track tokens per agent call
GOVERNOR (governor/):
- Check budget before task delegation
- Enforce hard stops at 95% threshold
- Log to VAP audit trail
ENGINE (engine/executor.py):
- Track tokens per task execution
- Route to fallback model when budget low
- Update Mem0 with usage patterns
VAULT (vault/):
- Store token events in memory layer
- Query historical usage for SkillSmith
- Semantic cache for repeated queries
SKILLS (skills/):
- Track tokens per skill execution
- Optimize skill manifest based on usage
================================================================================ HOT PATH (Non-Blocking)
Foreman track() call:
~1ms latency
guard.track(agent_id, tokens)
Bridge response header:
No blocking
X-Nexus-Input-Tokens: 1250 X-Nexus-Output-Tokens: 890
================================================================================ WARM PATH (Async)
Model routing: model = guard.route(task_type='code', complexity='low')
Semantic cache check: result = guard.semantic_cache_get(query_hash) if result: return cached_result
================================================================================ COLD PATH (Background)
Trend analysis: python -c " from src.nexus_os.monitoring.token_guard import TokenGuard guard = TokenGuard() print(guard.analyze_trends('foreman-1', '24h')) "
Budget optimization:
SkillSmith reads trends and proposes optimization
8-18% savings per cycle
================================================================================ COUNTERS
Local (ai-tokenizer): from src.nexus_os.monitoring.counters import LocalCounter counter = LocalCounter() count = counter.count("text to count")
Cloud (tokscale): from src.nexus_os.monitoring.counters import TokscaleCounter counter = TokscaleCounter() count = counter.count("text to count")
Native (Ollama/OpenAI): from src.nexus_os.monitoring.counters import NativeCounter counter = NativeCounter('qwen3:4b-thinking') count = counter.count("text to count")
================================================================================ STRATEGIES
Semantic Cache: from src.nexus_os.monitoring.strategies import SemanticCache cache = SemanticCache(threshold=0.85) cache.set(query_hash, response) result = cache.get(query_hash) print(cache.stats()) # hit rate
Model Router: from src.nexus_os.monitoring.strategies import ModelRouter router = ModelRouter() model = router.route('code', 'low') fallback = router.get_fallback('gpt-5.4')
Budget Manager: from src.nexus_os.monitoring.strategies import BudgetManager manager = BudgetManager(total_budget=500000) manager.allocate('agent', 50000)
================================================================================
Xet Storage Details
- Size:
- 4.58 kB
- Xet hash:
- b42c1c02efcb8f4e3cc958c3108266621ccd78553dfb118cbe1dd5550818cefc
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.