rugmuncher-backend / app /databus /__init__.py
cryptorugmunch
merge: chore/cleanup-remove-bloat-and-secrets into main
bde2f3a
Raw
History Blame Contribute Delete
2.89 kB
"""
RMI DataBus β€” The Single Source of Truth for ALL Data
=====================================================
Every API call, MCP tool, x402 tool, scanner, and frontend hook routes through here.
No raw HTTP calls to external APIs anywhere else. Period.
Architecture (request flow):
Request β†’ SecurityGate β†’ CreditGate β†’ CacheLayer β†’ ProviderChain β†’ Result
↓ ↓ ↓ ↓ ↓
admin check free-first logic L1β†’L2β†’L3 local-first! RAG index
vault keys auto-rotate Redis+R2 OUR data 1st WS broadcast
What it REPLACES (do NOT use these anymore):
- app/cache_manager.py (RMICache) β†’ databus.cache
- app/caching_shield/unified_layer.py β†’ databus.fetch()
- app/caching_shield/data_fallback.py β†’ databus.fetch()
- app/caching_shield/api_registry.py β†’ databus.key_pool
- app/caching_shield/rate_limiter.py β†’ databus.rate_limiter
- app/arkham_connector.py β†’ databus.providers.arkham
- app/coingecko_connector.py β†’ databus.providers.coingecko
- Direct .env reads for API keys β†’ databus.vault (encrypted in-memory)
OWN DATA FIRST:
Our crown jewels β€” Wallet Memory Bank, RAG (17K docs), SENTINEL scanner,
Consensus RPC, Funding Tracer, ClickHouse, Price Consensus, News Network,
Bundle Detection, Label Import (169K+) β€” these are FAST, FREE, and OURS.
They go FIRST in every fallback chain. External APIs only augment or fill gaps.
Usage:
from app.databus import databus
# Simple fetch β€” auto-selects best provider chain
result = await databus.fetch("token_price", mint="So11111111111111111111111111111111111111111")
# Explicit chain override
result = await databus.fetch("wallet_labels", address="7EcD...",
chain="local_first")
# Admin-only data (requires admin key in request)
result = await databus.fetch("arkham_entity", address="0x...",
admin_key="...")
# Check system health
health = await databus.health()
# Get capacity report (credits, rate limits, recommendations)
report = databus.capacity_report()
"""
from app.databus.access_control import AccessController, ConsumerType, access_controller
from app.databus.core import DataBus, databus
from app.databus.key_affinity import KeyAffinitySelector, key_affinity
from app.databus.response_schema import SchemaValidator, schema_validator
from app.databus.social import SocialDataAggregator, XTwitterProvider
__all__ = [
"AccessController",
"ConsumerType",
"DataBus",
"KeyAffinitySelector",
"SchemaValidator",
"SocialDataAggregator",
"XTwitterProvider",
"access_controller",
"databus",
"key_affinity",
"schema_validator",
]