hyperparameters.txt

{"learning_rate": 0.0005, "per_device_train_batch_size": 8, "weight_decay": 0.01}