Please check the train_flux.sh file In line 21 there is a variable named "RUN_PROFILE" which can be set to "main" or "quick for testing. If set to "main", it will run the full training loop. If set to "quick", it will run a minimal training loop for testing purposes.
I have set distributed shared for quick testing mode but distributed is set for main mode.