AIFS v1 fine-tune dataset files
#7
by
maruf
- opened
I am interested in AIFS fine tuning as described on: https://huggingface.co/ecmwf/aifs-single-1.0#how-to-train-aifs-single-v10
However, the config file has two dataset files (as shown below) and one graph, which are not available.
files:
dataset: aifs-od-an-oper-0001-mars-n320-2016-2023-6h-v6.zarr
dataset_land: aifs-od-an-oper-0001-mars-n320-2016-2023-6h-v1-land.zarr
graph: graph_enc_proc_dec_n320.pt
Can you please provide a script to create those two data files?
Also, where can I get the graph_enc_proc_dec_n320.pt file?
Hi,
At the moment, we do not provide the checkpoints for further finetuning, nor the graph files.
If you wish to retrain a model like the AIFS, we document the configuration and process here
https://github.com/ecmwf/anemoi-configs/tree/main/configs/aifs/aifs-single-mse-1.0