| Training/evaluation parameters Namespace(data_dir='intent_example/', model_dir='/data/ryanyip/huggingface-models/', model_name='mc_bert_base', output_dir='./intent_test', do_train=True, do_predict=False, result_output_dir='./intent_test/result/', max_length=128, train_batch_size=8, eval_batch_size=8, learning_rate=5e-05, weight_decay=0.01, adam_epsilon=1e-08, max_grad_norm=1.0, epochs=3, warmup_proportion=0.1, earlystop_patience=2, logging_steps=10, save_steps=1000, seed=2021, device=device(type='cuda'), model_type='bert', task_name='qic') | |
| ***** Running training ***** | |
| Num samples 1350 | |
| Num epochs 3 | |
| Num training steps 507 | |
| Num warmup steps 50 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.1 | |
| Saving models checkpoint to ./intent_test/checkpoint-10 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.18823529411764706 | |
| Saving models checkpoint to ./intent_test/checkpoint-20 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.2235294117647059 | |
| Saving models checkpoint to ./intent_test/checkpoint-30 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.24705882352941178 | |
| Saving models checkpoint to ./intent_test/checkpoint-40 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.2529411764705882 | |
| Saving models checkpoint to ./intent_test/checkpoint-50 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.32941176470588235 | |
| Saving models checkpoint to ./intent_test/checkpoint-60 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.2647058823529412 | |
| Earlystopper counter: 1 out of 2 | |
| ***** Running evaluation ***** | |
| Num samples 170 | |
| qic-mc_bert_base acc: 0.27647058823529413 | |
| Earlystopper counter: 2 out of 2 | |
| Training Stop! The best step 60: 0.32941176470588235 | |
| Saving models checkpoint to ./intent_test | |