Seeking Historical AIFS Data Prior to December 2023
Hi,
I'm curious as to why you are training ML models on an ML model? That seems fraught with issues.
Yes, ECMWF only provides data from December onwards, that is roughly when we started running the precursor models.
The inconsistencies in input data you are encountering are likely a result of the cycles of the IFS which initialise the AIFS. However, as we pretrain off of ERA5, you should be able to run throughout that full period.
Additionally, one of the other reasons why we do not provide any earlier data, is it begins to overlap with the training data, and thus the validity of the predicitons is brought into question, ideally, those periods should not be used.
To run the AIFS with anemoi, an ERA5 / CDS input could be used, and therefore any date to 1980 should be available.