| #SBATCH --nodes=1 | |
| #SBATCH --ntasks-per-node=1 | |
| #SBATCH --gres=gpu:2 | |
| #SBATCH --constraint=A100 | |
| #SBATCH --mem=17000 | |
| {'train_runtime': 92.428, 'train_samples_per_second': 0.108, 'train_steps_per_second': 0.065, 'train_loss': 0.845277359088262, 'epoch': 2.0} | |
| Time: 92.43 | |
| Samples/second: 0.11 | |
| GPU memory occupied: 10826 MB.. |