Refactor pipeline configuration and update data processing scripts

Removed useless lines of code

made changes to directory locations... removed some unnecessary files

made evaluation easier by adding auto eval... makes configs on its own...

made data pipeline for data processing in process_data_pipeline.py

Update file paths in data processing scripts and enhance error handling;

enhance FlareDownloadProcessor with dynamic max_workers and improved sampling intervals; modify inference_config.yaml for batch size and checkpoint path adjustments.

updated tree structure