| #SBATCH --nodes=1 | |
| #SBATCH --ntasks-per-node=1 | |
| #SBATCH --gres=gpu:1 | |
| #SBATCH --constraint=A100 | |
| #SBATCH --mem=17000 | |
| {'train_runtime': 19.6202, 'train_samples_per_second': 0.51, 'train_steps_per_second': 0.51, 'train_loss': 0.6896940499544144, 'epoch': 2.0} | |
| Time: 19.62 | |
| Samples/second: 0.51 | |
| GPU memory occupied: 5256 MB. | |