feat: integrate A/B testing framework and enhance RAG diversity in recommendation system

chore: update requirements and refactor benchmark methods to use synchronous recommendations

chore: update requirements and documentation for intent classifier and RAG evaluation