| 2020-09-30 01:28:04,393 loading file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-vocab.txt from cache at /home/tiger/.cache/torch/transformers/26bc1ad6c0ac742e9b52263248f6d0f00068293b33709fae12320c0e35ccfbbb.542ce4285a40d23a559526243235df47c5f75c197f04f37d1a0c124c32c9a084 |
| 2020-09-30 01:28:05,900 Did not load checkpoints |
| 2020-09-30 01:28:05,902 Resnet backbone now has fixed blocks 2 |
| 2020-09-30 01:28:07,321 loading configuration file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-config.json from cache at /home/tiger/.cache/torch/transformers/4dad0251492946e18ac39290fcfe91b89d370fee250efe9521476438fe8ca185.7156163d5fdc189c3016baca0775ffce230789d7fa2a42ef516483e4ca884517 |
| 2020-09-30 01:28:07,322 Model config { |
| "architectures": [ |
| "BertForMaskedLM" |
| ], |
| "attention_probs_dropout_prob": 0.1, |
| "finetuning_task": null, |
| "hidden_act": "gelu", |
| "hidden_dropout_prob": 0.1, |
| "hidden_size": 768, |
| "initializer_range": 0.02, |
| "intermediate_size": 3072, |
| "layer_norm_eps": 1e-12, |
| "max_position_embeddings": 512, |
| "model_type": "bert", |
| "num_attention_heads": 12, |
| "num_hidden_layers": 12, |
| "num_labels": 2, |
| "output_attentions": false, |
| "output_hidden_states": false, |
| "pad_token_id": 0, |
| "pruned_heads": {}, |
| "torchscript": false, |
| "type_vocab_size": 2, |
| "use_bfloat16": false, |
| "vocab_size": 30522 |
| } |
|
|
| 2020-09-30 01:28:08,758 loading weights file https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-uncased-pytorch_model.bin from cache at /home/tiger/.cache/torch/transformers/aa1ef1aede4482d0dbcd4d52baad8ae300e60902e88fcb0bebdec09afd232066.36ca03ab34a1a5d5fa7bc3d03d55c4fa650fed07220e2eeebc06ce58d0e9a157 |
| 2020-09-30 01:28:10,844 Use adam as the optimizer, with init lr 0.0005 |
| 2020-09-30 01:28:10,845 Image encoder is data paralleled now. |
| 2020-09-30 01:28:10,981 Load full model with backbone |
| 2020-09-30 01:28:10,983 Loading dataset |
| 2020-09-30 01:28:15,016 Input mode small: scaled by factor 2.0 |
| 2020-09-30 01:28:24,713 Computing results... |
| 2020-09-30 01:29:21,486 Test: [0/40] Le 61.7868 (61.7867) Time 56.770 (0.000) |
| 2020-09-30 01:29:29,720 Test: [10/40] Le 62.1460 (61.6953) Time 0.866 (0.000) |
| 2020-09-30 01:29:38,035 Test: [20/40] Le 60.0629 (61.3002) Time 0.793 (0.000) |
| 2020-09-30 01:29:46,124 Test: [30/40] Le 61.7439 (61.4198) Time 0.788 (0.000) |
| 2020-09-30 01:29:56,538 Images: 1000, Captions: 5000 |
| 2020-09-30 01:29:57,433 Save the similarity into runs/f30k_vsepp_wsl_bert_var_gpool/results_testall_5k.npy |
| 2020-09-30 01:29:57,433 calculate similarity time: |
| 2020-09-30 01:29:58,057 rsum: 550.9 |
| 2020-09-30 01:29:58,057 Average i2t Recall: 95.4 |
| 2020-09-30 01:29:58,057 Image to text: 88.4 98.3 99.5 1.0 1.3 |
| 2020-09-30 01:29:58,057 Average t2i Recall: 88.2 |
| 2020-09-30 01:29:58,057 Text to image: 74.2 93.7 96.8 1.0 3.0 |
|
|