Training and fine-tuning code & tips
Hi ECMWF team,
First, thanks for releasing AIFS-ENS v1.0 and the excellent documentation.
I’d like to fine-tune AIFS-ENS v1.0. Could you please confirm the recommended path using Anemoi Training?
Is Anemoi Training the intended framework for fine-tuning AIFS-ENS v1.0 (CRPS-trained ensemble)?
Is there a notebook example or reference config available to start a fine-tuning run?
Thanks a lot!
Hi,
At the moment we are not releasing our training checkpoints, and thus do not recommend or support finetuning the AIFS models.
If you wished to retrain the AIFS-ENS, yes using anemoi-training is the approach, there we provide default configs for an ensemble model.
Hi
@GianlucaMercuria
, did you have success in fine-tuning AIFS-ENS v1.0 using the pre-trained weights only? What additional information would the training checkpoints contain? I guess finetuning should be possible if you reset the optimizer and start with a new learning rate schedule? Am I missing something? I'm asking because I'm interested in finetuning AIFS single for scientific purposes.
@hcookie129
Is there a roadmap for releasing training checkpoints? The original ECMWF blog-post says:
[...] Looking ahead, we’re also committed to expanding ECMWF’s Hugging Face model collection. Our goals include adding probabilistic models, updating models as new versions are released and providing complete checkpoints, which will provide optimiser states to easily fine-tune for a different application.
Thanks a lot!