FOXES / data

Commit History

Fixed normalization of timestamp names
e522a44

griffingoodwin04 commited on

Refactor pipeline configuration and update data processing scripts
ec2b4e7

griffingoodwin04 commited on

made changes to directory locations... removed some unnecessary files
b6d3638

griffingoodwin04 commited on

Update requirements and configuration files; added new dependencies and modified paths for data processing. Adjusted model parameters and batch sizes for training and inference, including simultaneous flare movie generation logic.
a2506f2

griffingoodwin04 commited on

cleaning up the code base significantly
2c4457e

griffingoodwin04 commited on

Various bug fixes and changes to all codes
83a05d2

griffingoodwin04 commited on

enhance data splitting functionality.
0c7d0f3

griffingoodwin04 commited on

made evaluation easier by adding auto eval... makes configs on its own...
130c9b3

griffingoodwin04 commited on

made data pipeline for data processing in process_data_pipeline.py
c14af1c

griffingoodwin04 commited on

Update data processing scripts to use new combined directory structure; adjust validation and training splits, enhance loss calculation with updated parameters, and modify configuration files for improved model training and evaluation.
7508d0e

griffingoodwin04 commited on

made it easier to change directories for data alignment
5375292

griffingoodwin04 commited on

Refactor GOES data processing to optimize loading and preparation; implement batch processing for efficient timestamp handling and create a lookup table for improved data retrieval.
57c66c0

griffingoodwin04 commited on

Improved aligning code so that it loops through the aia data and finds associated data for most recent goes instrument
5c75907

griffingoodwin04 commited on

Enhance SXRDataProcessor with improved file processing feedback and error handling; added progress tracking for satellite data loading and detailed summary output upon completion.
2045139

griffingoodwin04 commited on

Update file paths in data processing scripts and enhance error handling;
655c5c3

griffingoodwin04 commited on

enhance FlareDownloadProcessor with dynamic max_workers and improved sampling intervals; modify inference_config.yaml for batch size and checkpoint path adjustments.
9dea682

griffingoodwin04 commited on

Implement a script to check downloaded data gap for SDO/AIA FITS files.
1c90a80

alisonjmarch commited on

Updated splitting function so now it can do SXR and AIA individually... it can also repartition an already partioned folder... updated the megs models to include warm restarts, weight decay, and adaptive weights
7bbc799

griffingoodwin04 commited on