TODO.md

Initial System Efficiency Strategy

1. Query generator system a. Discovery b. Tokens
2. Prompt enhancer system
3. Typesense instance for (short cached) a. user actions similarity and recomendation/suggestion b. function path and execution graph search c. external data fetches and proactive data fetch
4. Function path and execution graph generator class
5. Timescale instance for metric measurements and ranking a. Function execution time b. Gas spend c. Integration latency d. Prompt -> answer latency
6. Proactive cache enrichment based on user activity
7. Proactive knowledge graph update based on market activity and user interests a. KG pipeline flow b. Progressive cache and hot context for llm as flow progresses
8. Purchase suggestion engines for users
9. Subtle user education to increase chances of purchases
10. Interest provoking alerts a. Toasts b. Email c. Highlights
11. Short form content generation engine a. Giphs b. Memes c. Short video highlights d. Short voice highlights in background as user interacts with system e. Short top gainer and looser animations
12. User PnL stats animations layerd on system prediction performance
13. User pseudo trading system gamified
14. Fast and easy token purchase for boosted assets (LP partners)
15. Index system for users (create, manage and adjust) for short term and long term
16. User budgeting and financial planning system with scores
17. Users global engagment score and leaaderboard system with point awards
18. Fundamentaal analysis feature
19. Signal and listing alerts
20. Copy trading service
21. Bot trading service
22. Persive-Agressive investor potfolio execution and management service
23. Stock trading service
24. Utility payments
25. Travel service a. Cheap flight paths b. Esim c. Travel expense on crypto d. Airtime and data e. Vouchers and points

Infra

1. Async everthing
2. CI/CD pipeline
3. Strict typed input and output validations
4. Debugging logs
5. Proper general logging and export to log service
6. LLM load balancing and redundancy
7. LLM caching
8. Local and secure micro LLMs servers (Fly or RunPod)
9. Proper backups of all infra resources
10. Cloudflare captcha and WAF
11. User traffic monitoring and active banning system
12. Ofac and sanctions checks
13. KYC flows
14. KYC check service offering to 3rd party
15. V1 SDK realease
16. V1 developer contribution campaings

Priority

1. Host TypeSence or Upstash Redis, Timescale DB, LiteLLM, Ollama, FalkorDB, a. compare Fly and Digital Ocean
2. Create secret store and integrate
3. Create ChatXBT host scalabe hosting (fly or Digital Ocean or RunPod)
4. Set alerts for billing and uptime
5. Set error alerts and llm investigation
6. Add guard rails - https://github.com/NVIDIA/NeMo-Guardrails