mert_cmp_single_nse
This model is a fine-tuned version of m-a-p/MERT-v0 on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 1.9750
- Accuracy: 0.7132
- Precision Micro: 0.7132
- Recall Micro: 0.7132
- F1 Micro: 0.7132
- Precision Macro: 0.6817
- Recall Macro: 0.6740
- F1 Macro: 0.6672
- Precision Weighted: 0.7132
- Recall Weighted: 0.7132
- F1 Weighted: 0.7052
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.005
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 200
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision Micro | Recall Micro | F1 Micro | Precision Macro | Recall Macro | F1 Macro | Precision Weighted | Recall Weighted | F1 Weighted |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1.607 | 1.0 | 192 | 1.3559 | 0.4447 | 0.4447 | 0.4447 | 0.4447 | 0.3859 | 0.4278 | 0.3416 | 0.4509 | 0.4447 | 0.3810 |
| 1.407 | 2.0 | 384 | 1.2990 | 0.4607 | 0.4607 | 0.4607 | 0.4607 | 0.3987 | 0.4546 | 0.3814 | 0.4415 | 0.4607 | 0.4047 |
| 1.3415 | 3.0 | 576 | 1.2486 | 0.5156 | 0.5156 | 0.5156 | 0.5156 | 0.4259 | 0.5366 | 0.4446 | 0.5046 | 0.5156 | 0.4884 |
| 1.2628 | 4.0 | 768 | 1.1842 | 0.5492 | 0.5492 | 0.5492 | 0.5492 | 0.4662 | 0.5326 | 0.4759 | 0.5301 | 0.5492 | 0.5263 |
| 1.2316 | 5.0 | 960 | 1.1394 | 0.5858 | 0.5858 | 0.5858 | 0.5858 | 0.4809 | 0.5459 | 0.5093 | 0.5313 | 0.5858 | 0.5551 |
| 1.219 | 6.0 | 1152 | 1.0897 | 0.5523 | 0.5523 | 0.5523 | 0.5523 | 0.4602 | 0.5295 | 0.4775 | 0.5222 | 0.5523 | 0.5171 |
| 1.2034 | 7.0 | 1344 | 1.1280 | 0.5606 | 0.5606 | 0.5606 | 0.5606 | 0.4697 | 0.5404 | 0.4911 | 0.5240 | 0.5606 | 0.5260 |
| 1.1801 | 8.0 | 1536 | 1.0489 | 0.5904 | 0.5904 | 0.5904 | 0.5904 | 0.4925 | 0.5480 | 0.5134 | 0.5421 | 0.5904 | 0.5601 |
| 1.1668 | 9.0 | 1728 | 1.0886 | 0.5736 | 0.5736 | 0.5736 | 0.5736 | 0.4704 | 0.5626 | 0.4984 | 0.5364 | 0.5736 | 0.5414 |
| 1.1606 | 10.0 | 1920 | 1.1040 | 0.5637 | 0.5637 | 0.5637 | 0.5637 | 0.5272 | 0.5531 | 0.5147 | 0.5797 | 0.5637 | 0.5456 |
| 1.1279 | 11.0 | 2112 | 1.0697 | 0.5614 | 0.5614 | 0.5614 | 0.5614 | 0.5419 | 0.5388 | 0.4881 | 0.5775 | 0.5614 | 0.5192 |
| 1.0985 | 12.0 | 2304 | 1.0258 | 0.5965 | 0.5965 | 0.5965 | 0.5965 | 0.5802 | 0.5591 | 0.5237 | 0.5912 | 0.5965 | 0.5632 |
| 1.1136 | 13.0 | 2496 | 1.1465 | 0.5645 | 0.5645 | 0.5645 | 0.5645 | 0.5004 | 0.4954 | 0.4748 | 0.5384 | 0.5645 | 0.5271 |
| 1.0795 | 14.0 | 2688 | 1.3491 | 0.5843 | 0.5843 | 0.5843 | 0.5843 | 0.5281 | 0.5194 | 0.5112 | 0.5555 | 0.5843 | 0.5547 |
| 1.0585 | 15.0 | 2880 | 1.2309 | 0.5950 | 0.5950 | 0.5950 | 0.5950 | 0.5096 | 0.5434 | 0.5222 | 0.5419 | 0.5950 | 0.5631 |
| 1.0962 | 16.0 | 3072 | 1.0549 | 0.6095 | 0.6095 | 0.6095 | 0.6095 | 0.5208 | 0.5590 | 0.5353 | 0.5611 | 0.6095 | 0.5806 |
| 1.0365 | 17.0 | 3264 | 1.1118 | 0.5850 | 0.5850 | 0.5850 | 0.5850 | 0.5612 | 0.5695 | 0.5191 | 0.6032 | 0.5850 | 0.5506 |
| 1.0389 | 18.0 | 3456 | 1.0790 | 0.6217 | 0.6217 | 0.6217 | 0.6217 | 0.5504 | 0.5866 | 0.5512 | 0.5985 | 0.6217 | 0.5986 |
| 1.0498 | 19.0 | 3648 | 1.0949 | 0.6056 | 0.6056 | 0.6056 | 0.6056 | 0.5665 | 0.5887 | 0.5552 | 0.6144 | 0.6056 | 0.5971 |
| 1.0212 | 20.0 | 3840 | 1.0884 | 0.6041 | 0.6041 | 0.6041 | 0.6041 | 0.5845 | 0.5738 | 0.5251 | 0.6138 | 0.6041 | 0.5681 |
| 1.0269 | 21.0 | 4032 | 1.0606 | 0.6301 | 0.6301 | 0.6301 | 0.6301 | 0.6048 | 0.5978 | 0.5817 | 0.6304 | 0.6301 | 0.6126 |
| 1.0068 | 22.0 | 4224 | 1.1584 | 0.5690 | 0.5690 | 0.5690 | 0.5690 | 0.6019 | 0.5875 | 0.4961 | 0.6473 | 0.5690 | 0.5466 |
| 1.0192 | 23.0 | 4416 | 1.1837 | 0.6133 | 0.6133 | 0.6133 | 0.6133 | 0.6090 | 0.5680 | 0.5749 | 0.6103 | 0.6133 | 0.5990 |
| 1.0346 | 24.0 | 4608 | 1.3584 | 0.5873 | 0.5873 | 0.5873 | 0.5873 | 0.5365 | 0.5439 | 0.5224 | 0.5777 | 0.5873 | 0.5596 |
| 0.9572 | 25.0 | 4800 | 1.0044 | 0.6293 | 0.6293 | 0.6293 | 0.6293 | 0.5858 | 0.5927 | 0.5823 | 0.6185 | 0.6293 | 0.6196 |
| 0.9688 | 26.0 | 4992 | 0.9949 | 0.6117 | 0.6117 | 0.6117 | 0.6117 | 0.5746 | 0.5810 | 0.5669 | 0.6167 | 0.6117 | 0.6033 |
| 0.9744 | 27.0 | 5184 | 1.2110 | 0.6392 | 0.6392 | 0.6392 | 0.6392 | 0.6218 | 0.5844 | 0.5730 | 0.6386 | 0.6392 | 0.6180 |
| 0.9776 | 28.0 | 5376 | 1.0603 | 0.6453 | 0.6453 | 0.6453 | 0.6453 | 0.5307 | 0.6046 | 0.5600 | 0.5950 | 0.6453 | 0.6124 |
| 0.9797 | 29.0 | 5568 | 1.1807 | 0.6209 | 0.6209 | 0.6209 | 0.6209 | 0.6475 | 0.5691 | 0.5457 | 0.6453 | 0.6209 | 0.5929 |
| 0.9423 | 30.0 | 5760 | 1.2613 | 0.6201 | 0.6201 | 0.6201 | 0.6201 | 0.6079 | 0.5844 | 0.5447 | 0.6357 | 0.6201 | 0.5917 |
| 0.9233 | 31.0 | 5952 | 1.1114 | 0.6255 | 0.6255 | 0.6255 | 0.6255 | 0.5948 | 0.6008 | 0.5652 | 0.6181 | 0.6255 | 0.6023 |
| 0.9696 | 32.0 | 6144 | 1.2268 | 0.6087 | 0.6087 | 0.6087 | 0.6087 | 0.6119 | 0.5573 | 0.5435 | 0.6192 | 0.6087 | 0.5868 |
| 0.9166 | 33.0 | 6336 | 1.1326 | 0.6499 | 0.6499 | 0.6499 | 0.6499 | 0.6381 | 0.5990 | 0.5780 | 0.6521 | 0.6499 | 0.6242 |
| 0.8916 | 34.0 | 6528 | 1.2382 | 0.6316 | 0.6316 | 0.6316 | 0.6316 | 0.6446 | 0.5997 | 0.5767 | 0.6530 | 0.6316 | 0.6086 |
| 0.919 | 35.0 | 6720 | 1.1989 | 0.6240 | 0.6240 | 0.6240 | 0.6240 | 0.6526 | 0.5786 | 0.5542 | 0.6504 | 0.6240 | 0.5956 |
| 0.9314 | 36.0 | 6912 | 1.2372 | 0.6552 | 0.6552 | 0.6552 | 0.6552 | 0.6649 | 0.5927 | 0.5825 | 0.6738 | 0.6552 | 0.6314 |
| 0.9107 | 37.0 | 7104 | 1.1582 | 0.6545 | 0.6545 | 0.6545 | 0.6545 | 0.6486 | 0.6460 | 0.5961 | 0.6778 | 0.6545 | 0.6358 |
| 0.9044 | 38.0 | 7296 | 1.1471 | 0.6316 | 0.6316 | 0.6316 | 0.6316 | 0.6513 | 0.5885 | 0.5633 | 0.6546 | 0.6316 | 0.6074 |
| 0.8877 | 39.0 | 7488 | 1.1052 | 0.6484 | 0.6484 | 0.6484 | 0.6484 | 0.6509 | 0.6045 | 0.5665 | 0.6622 | 0.6484 | 0.6182 |
| 0.8526 | 40.0 | 7680 | 1.2574 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6928 | 0.6360 | 0.6173 | 0.6935 | 0.6751 | 0.6551 |
| 0.8712 | 41.0 | 7872 | 1.1521 | 0.6415 | 0.6415 | 0.6415 | 0.6415 | 0.6411 | 0.5994 | 0.5849 | 0.6515 | 0.6415 | 0.6228 |
| 0.8728 | 42.0 | 8064 | 1.1905 | 0.6384 | 0.6384 | 0.6384 | 0.6384 | 0.6254 | 0.6168 | 0.5853 | 0.6593 | 0.6384 | 0.6184 |
| 0.8835 | 43.0 | 8256 | 1.1435 | 0.6629 | 0.6629 | 0.6629 | 0.6629 | 0.6134 | 0.6099 | 0.6007 | 0.6466 | 0.6629 | 0.6462 |
| 0.8341 | 44.0 | 8448 | 1.2884 | 0.6621 | 0.6621 | 0.6621 | 0.6621 | 0.6414 | 0.6278 | 0.6021 | 0.6630 | 0.6621 | 0.6435 |
| 0.8523 | 45.0 | 8640 | 1.2624 | 0.6537 | 0.6537 | 0.6537 | 0.6537 | 0.6747 | 0.6139 | 0.6004 | 0.6726 | 0.6537 | 0.6355 |
| 0.9055 | 46.0 | 8832 | 1.1137 | 0.6606 | 0.6606 | 0.6606 | 0.6606 | 0.6466 | 0.5994 | 0.6093 | 0.6694 | 0.6606 | 0.6520 |
| 0.8353 | 47.0 | 9024 | 1.3152 | 0.6476 | 0.6476 | 0.6476 | 0.6476 | 0.5990 | 0.6231 | 0.6002 | 0.6357 | 0.6476 | 0.6361 |
| 0.8534 | 48.0 | 9216 | 1.3329 | 0.6430 | 0.6430 | 0.6430 | 0.6430 | 0.6225 | 0.6145 | 0.5759 | 0.6469 | 0.6430 | 0.6172 |
| 0.8644 | 49.0 | 9408 | 1.2992 | 0.6697 | 0.6697 | 0.6697 | 0.6697 | 0.6577 | 0.6498 | 0.6211 | 0.6822 | 0.6697 | 0.6555 |
| 0.8855 | 50.0 | 9600 | 1.1431 | 0.6690 | 0.6690 | 0.6690 | 0.6690 | 0.6565 | 0.6170 | 0.5906 | 0.6736 | 0.6690 | 0.6407 |
| 0.8077 | 51.0 | 9792 | 1.1859 | 0.6827 | 0.6827 | 0.6827 | 0.6827 | 0.6280 | 0.6534 | 0.6294 | 0.6718 | 0.6827 | 0.6700 |
| 0.8038 | 52.0 | 9984 | 1.1350 | 0.6636 | 0.6636 | 0.6636 | 0.6636 | 0.6283 | 0.6547 | 0.6285 | 0.6651 | 0.6636 | 0.6567 |
| 0.8189 | 53.0 | 10176 | 1.1752 | 0.6583 | 0.6583 | 0.6583 | 0.6583 | 0.6658 | 0.6264 | 0.5976 | 0.6772 | 0.6583 | 0.6370 |
| 0.8488 | 54.0 | 10368 | 1.2030 | 0.6667 | 0.6667 | 0.6667 | 0.6667 | 0.6494 | 0.6276 | 0.6115 | 0.6708 | 0.6667 | 0.6508 |
| 0.8018 | 55.0 | 10560 | 1.1059 | 0.6712 | 0.6712 | 0.6712 | 0.6712 | 0.6428 | 0.6408 | 0.6345 | 0.6671 | 0.6712 | 0.6629 |
| 0.8058 | 56.0 | 10752 | 1.1779 | 0.6697 | 0.6697 | 0.6697 | 0.6697 | 0.6339 | 0.6409 | 0.6130 | 0.6698 | 0.6697 | 0.6542 |
| 0.7793 | 57.0 | 10944 | 1.2871 | 0.6659 | 0.6659 | 0.6659 | 0.6659 | 0.6391 | 0.6333 | 0.6031 | 0.6664 | 0.6659 | 0.6454 |
| 0.795 | 58.0 | 11136 | 1.3088 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6467 | 0.6555 | 0.6426 | 0.6777 | 0.6751 | 0.6705 |
| 0.7903 | 59.0 | 11328 | 1.3937 | 0.6758 | 0.6758 | 0.6758 | 0.6758 | 0.6452 | 0.6325 | 0.6113 | 0.6754 | 0.6758 | 0.6546 |
| 0.8024 | 60.0 | 11520 | 1.2951 | 0.6629 | 0.6629 | 0.6629 | 0.6629 | 0.6373 | 0.6155 | 0.6015 | 0.6507 | 0.6629 | 0.6409 |
| 0.7846 | 61.0 | 11712 | 1.4113 | 0.6484 | 0.6484 | 0.6484 | 0.6484 | 0.6185 | 0.6198 | 0.5820 | 0.6491 | 0.6484 | 0.6246 |
| 0.78 | 62.0 | 11904 | 1.1698 | 0.6712 | 0.6712 | 0.6712 | 0.6712 | 0.6549 | 0.6423 | 0.6300 | 0.6706 | 0.6712 | 0.6591 |
| 0.7666 | 63.0 | 12096 | 1.4623 | 0.6583 | 0.6583 | 0.6583 | 0.6583 | 0.6780 | 0.6180 | 0.5882 | 0.6859 | 0.6583 | 0.6328 |
| 0.775 | 64.0 | 12288 | 1.4944 | 0.6537 | 0.6537 | 0.6537 | 0.6537 | 0.6335 | 0.6197 | 0.6040 | 0.6512 | 0.6537 | 0.6349 |
| 0.8153 | 65.0 | 12480 | 1.4137 | 0.6812 | 0.6812 | 0.6812 | 0.6812 | 0.6626 | 0.6386 | 0.6275 | 0.6798 | 0.6812 | 0.6660 |
| 0.7389 | 66.0 | 12672 | 1.3423 | 0.6873 | 0.6873 | 0.6873 | 0.6873 | 0.6426 | 0.6488 | 0.6187 | 0.6779 | 0.6873 | 0.6654 |
| 0.7818 | 67.0 | 12864 | 1.4067 | 0.6659 | 0.6659 | 0.6659 | 0.6659 | 0.6201 | 0.6291 | 0.6137 | 0.6536 | 0.6659 | 0.6530 |
| 0.7571 | 68.0 | 13056 | 1.4498 | 0.6850 | 0.6850 | 0.6850 | 0.6850 | 0.6599 | 0.6481 | 0.6203 | 0.6882 | 0.6850 | 0.6637 |
| 0.7476 | 69.0 | 13248 | 1.2351 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6445 | 0.6166 | 0.6095 | 0.6684 | 0.6751 | 0.6564 |
| 0.7567 | 70.0 | 13440 | 1.4760 | 0.6895 | 0.6895 | 0.6895 | 0.6895 | 0.6612 | 0.6556 | 0.6424 | 0.6867 | 0.6895 | 0.6770 |
| 0.7919 | 71.0 | 13632 | 1.1386 | 0.6789 | 0.6789 | 0.6789 | 0.6789 | 0.6450 | 0.6462 | 0.6271 | 0.6773 | 0.6789 | 0.6651 |
| 0.7421 | 72.0 | 13824 | 1.2441 | 0.6888 | 0.6888 | 0.6888 | 0.6888 | 0.6463 | 0.6356 | 0.6172 | 0.6788 | 0.6888 | 0.6680 |
| 0.7555 | 73.0 | 14016 | 1.5891 | 0.6781 | 0.6781 | 0.6781 | 0.6781 | 0.6462 | 0.6483 | 0.6245 | 0.6858 | 0.6781 | 0.6678 |
| 0.7572 | 74.0 | 14208 | 1.5133 | 0.6918 | 0.6918 | 0.6918 | 0.6918 | 0.6768 | 0.6544 | 0.6576 | 0.6900 | 0.6918 | 0.6850 |
| 0.7284 | 75.0 | 14400 | 1.6124 | 0.6674 | 0.6674 | 0.6674 | 0.6674 | 0.6582 | 0.6339 | 0.6311 | 0.6696 | 0.6674 | 0.6562 |
| 0.7553 | 76.0 | 14592 | 1.6356 | 0.6514 | 0.6514 | 0.6514 | 0.6514 | 0.6233 | 0.6222 | 0.5949 | 0.6472 | 0.6514 | 0.6313 |
| 0.7058 | 77.0 | 14784 | 1.3671 | 0.6606 | 0.6606 | 0.6606 | 0.6606 | 0.6638 | 0.6153 | 0.6094 | 0.6716 | 0.6606 | 0.6451 |
| 0.74 | 78.0 | 14976 | 1.4456 | 0.6903 | 0.6903 | 0.6903 | 0.6903 | 0.6896 | 0.6441 | 0.6293 | 0.6985 | 0.6903 | 0.6709 |
| 0.7274 | 79.0 | 15168 | 1.2708 | 0.6766 | 0.6766 | 0.6766 | 0.6766 | 0.6581 | 0.6261 | 0.6191 | 0.6759 | 0.6766 | 0.6613 |
| 0.7108 | 80.0 | 15360 | 1.2781 | 0.6957 | 0.6957 | 0.6957 | 0.6957 | 0.6646 | 0.6529 | 0.6449 | 0.6890 | 0.6957 | 0.6837 |
| 0.6989 | 81.0 | 15552 | 1.4560 | 0.6850 | 0.6850 | 0.6850 | 0.6850 | 0.6610 | 0.6458 | 0.6318 | 0.6854 | 0.6850 | 0.6700 |
| 0.7001 | 82.0 | 15744 | 1.5504 | 0.6575 | 0.6575 | 0.6575 | 0.6575 | 0.6307 | 0.6269 | 0.6168 | 0.6605 | 0.6575 | 0.6492 |
| 0.6731 | 83.0 | 15936 | 1.7144 | 0.6781 | 0.6781 | 0.6781 | 0.6781 | 0.6525 | 0.6569 | 0.6368 | 0.6850 | 0.6781 | 0.6708 |
| 0.6948 | 84.0 | 16128 | 1.4266 | 0.6995 | 0.6995 | 0.6995 | 0.6995 | 0.6950 | 0.6581 | 0.6584 | 0.7045 | 0.6995 | 0.6888 |
| 0.6709 | 85.0 | 16320 | 1.4075 | 0.6804 | 0.6804 | 0.6804 | 0.6804 | 0.6553 | 0.6434 | 0.6375 | 0.6766 | 0.6804 | 0.6710 |
| 0.6836 | 86.0 | 16512 | 1.4883 | 0.6590 | 0.6590 | 0.6590 | 0.6590 | 0.6337 | 0.6199 | 0.6086 | 0.6548 | 0.6590 | 0.6435 |
| 0.7046 | 87.0 | 16704 | 1.3066 | 0.6895 | 0.6895 | 0.6895 | 0.6895 | 0.6629 | 0.6572 | 0.6354 | 0.6924 | 0.6895 | 0.6748 |
| 0.6741 | 88.0 | 16896 | 1.2577 | 0.6865 | 0.6865 | 0.6865 | 0.6865 | 0.6890 | 0.6433 | 0.6214 | 0.7067 | 0.6865 | 0.6671 |
| 0.6889 | 89.0 | 17088 | 1.2343 | 0.6781 | 0.6781 | 0.6781 | 0.6781 | 0.6658 | 0.6474 | 0.6363 | 0.6855 | 0.6781 | 0.6661 |
| 0.6848 | 90.0 | 17280 | 1.2996 | 0.6995 | 0.6995 | 0.6995 | 0.6995 | 0.6628 | 0.6682 | 0.6594 | 0.6936 | 0.6995 | 0.6928 |
| 0.6675 | 91.0 | 17472 | 1.2649 | 0.6888 | 0.6888 | 0.6888 | 0.6888 | 0.6480 | 0.6624 | 0.6309 | 0.6918 | 0.6888 | 0.6754 |
| 0.6476 | 92.0 | 17664 | 1.4824 | 0.6796 | 0.6796 | 0.6796 | 0.6796 | 0.6632 | 0.6315 | 0.6147 | 0.6826 | 0.6796 | 0.6604 |
| 0.6416 | 93.0 | 17856 | 1.6575 | 0.6987 | 0.6987 | 0.6987 | 0.6987 | 0.6665 | 0.6587 | 0.6451 | 0.6945 | 0.6987 | 0.6864 |
| 0.6459 | 94.0 | 18048 | 1.4711 | 0.7071 | 0.7071 | 0.7071 | 0.7071 | 0.6790 | 0.6718 | 0.6641 | 0.7048 | 0.7071 | 0.6990 |
| 0.6758 | 95.0 | 18240 | 1.5885 | 0.6796 | 0.6796 | 0.6796 | 0.6796 | 0.6775 | 0.6404 | 0.6198 | 0.6980 | 0.6796 | 0.6608 |
| 0.6608 | 96.0 | 18432 | 1.8510 | 0.6712 | 0.6712 | 0.6712 | 0.6712 | 0.6426 | 0.6243 | 0.6032 | 0.6702 | 0.6712 | 0.6507 |
| 0.6986 | 97.0 | 18624 | 1.4376 | 0.6789 | 0.6789 | 0.6789 | 0.6789 | 0.6654 | 0.6488 | 0.6324 | 0.6894 | 0.6789 | 0.6665 |
| 0.655 | 98.0 | 18816 | 1.4168 | 0.6911 | 0.6911 | 0.6911 | 0.6911 | 0.6726 | 0.6530 | 0.6382 | 0.6950 | 0.6911 | 0.6771 |
| 0.6641 | 99.0 | 19008 | 1.4857 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6590 | 0.6305 | 0.6102 | 0.6826 | 0.6751 | 0.6551 |
| 0.623 | 100.0 | 19200 | 1.5752 | 0.6781 | 0.6781 | 0.6781 | 0.6781 | 0.6677 | 0.6438 | 0.6450 | 0.6881 | 0.6781 | 0.6723 |
| 0.6386 | 101.0 | 19392 | 1.5269 | 0.6728 | 0.6728 | 0.6728 | 0.6728 | 0.6631 | 0.6202 | 0.6132 | 0.6749 | 0.6728 | 0.6544 |
| 0.6361 | 102.0 | 19584 | 1.5767 | 0.6957 | 0.6957 | 0.6957 | 0.6957 | 0.6786 | 0.6635 | 0.6566 | 0.6989 | 0.6957 | 0.6869 |
| 0.6348 | 103.0 | 19776 | 1.4711 | 0.6934 | 0.6934 | 0.6934 | 0.6934 | 0.6567 | 0.6583 | 0.6469 | 0.6837 | 0.6934 | 0.6819 |
| 0.6731 | 104.0 | 19968 | 1.4920 | 0.6934 | 0.6934 | 0.6934 | 0.6934 | 0.6634 | 0.6525 | 0.6417 | 0.6929 | 0.6934 | 0.6811 |
| 0.6301 | 105.0 | 20160 | 1.5127 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6596 | 0.6355 | 0.6144 | 0.6835 | 0.6751 | 0.6554 |
| 0.6618 | 106.0 | 20352 | 1.5279 | 0.6895 | 0.6895 | 0.6895 | 0.6895 | 0.6518 | 0.6415 | 0.6266 | 0.6837 | 0.6895 | 0.6735 |
| 0.647 | 107.0 | 20544 | 1.4412 | 0.6880 | 0.6880 | 0.6880 | 0.6880 | 0.6621 | 0.6397 | 0.6260 | 0.6869 | 0.6880 | 0.6704 |
| 0.5969 | 108.0 | 20736 | 1.6005 | 0.6705 | 0.6705 | 0.6705 | 0.6705 | 0.6551 | 0.6308 | 0.6155 | 0.6769 | 0.6705 | 0.6531 |
| 0.6417 | 109.0 | 20928 | 1.5405 | 0.6720 | 0.6720 | 0.6720 | 0.6720 | 0.6575 | 0.6475 | 0.6373 | 0.6755 | 0.6720 | 0.6615 |
| 0.5936 | 110.0 | 21120 | 1.5514 | 0.6850 | 0.6850 | 0.6850 | 0.6850 | 0.6450 | 0.6567 | 0.6373 | 0.6805 | 0.6850 | 0.6730 |
| 0.6604 | 111.0 | 21312 | 1.4842 | 0.6751 | 0.6751 | 0.6751 | 0.6751 | 0.6571 | 0.6353 | 0.6303 | 0.6807 | 0.6751 | 0.6641 |
| 0.6181 | 112.0 | 21504 | 1.5548 | 0.6972 | 0.6972 | 0.6972 | 0.6972 | 0.6726 | 0.6558 | 0.6577 | 0.6942 | 0.6972 | 0.6904 |
| 0.6212 | 113.0 | 21696 | 1.6979 | 0.6842 | 0.6842 | 0.6842 | 0.6842 | 0.6522 | 0.6365 | 0.6295 | 0.6770 | 0.6842 | 0.6697 |
| 0.6346 | 114.0 | 21888 | 1.5769 | 0.6895 | 0.6895 | 0.6895 | 0.6895 | 0.6642 | 0.6442 | 0.6389 | 0.6832 | 0.6895 | 0.6761 |
| 0.6219 | 115.0 | 22080 | 1.5441 | 0.7033 | 0.7033 | 0.7033 | 0.7033 | 0.6700 | 0.6702 | 0.6630 | 0.6976 | 0.7033 | 0.6958 |
| 0.6307 | 116.0 | 22272 | 1.3654 | 0.6873 | 0.6873 | 0.6873 | 0.6873 | 0.6338 | 0.6472 | 0.6284 | 0.6755 | 0.6873 | 0.6738 |
| 0.6229 | 117.0 | 22464 | 1.5062 | 0.6941 | 0.6941 | 0.6941 | 0.6941 | 0.6616 | 0.6695 | 0.6554 | 0.6976 | 0.6941 | 0.6870 |
| 0.6236 | 118.0 | 22656 | 1.4269 | 0.6850 | 0.6850 | 0.6850 | 0.6850 | 0.6386 | 0.6483 | 0.6387 | 0.6765 | 0.6850 | 0.6773 |
| 0.6087 | 119.0 | 22848 | 1.7151 | 0.6911 | 0.6911 | 0.6911 | 0.6911 | 0.6649 | 0.6678 | 0.6578 | 0.6969 | 0.6911 | 0.6862 |
| 0.6043 | 120.0 | 23040 | 1.5938 | 0.7010 | 0.7010 | 0.7010 | 0.7010 | 0.6724 | 0.6558 | 0.6498 | 0.7029 | 0.7010 | 0.6914 |
| 0.5836 | 121.0 | 23232 | 1.8270 | 0.6827 | 0.6827 | 0.6827 | 0.6827 | 0.6601 | 0.6420 | 0.6381 | 0.6824 | 0.6827 | 0.6732 |
| 0.5744 | 122.0 | 23424 | 1.6394 | 0.6972 | 0.6972 | 0.6972 | 0.6972 | 0.6635 | 0.6603 | 0.6555 | 0.6956 | 0.6972 | 0.6907 |
| 0.5962 | 123.0 | 23616 | 1.5110 | 0.6926 | 0.6926 | 0.6926 | 0.6926 | 0.6619 | 0.6552 | 0.6369 | 0.6939 | 0.6926 | 0.6782 |
| 0.5748 | 124.0 | 23808 | 1.5643 | 0.7208 | 0.7208 | 0.7208 | 0.7208 | 0.6930 | 0.6921 | 0.6823 | 0.7241 | 0.7208 | 0.7150 |
| 0.583 | 125.0 | 24000 | 1.6166 | 0.6773 | 0.6773 | 0.6773 | 0.6773 | 0.6482 | 0.6453 | 0.6364 | 0.6772 | 0.6773 | 0.6693 |
| 0.5662 | 126.0 | 24192 | 1.5633 | 0.7071 | 0.7071 | 0.7071 | 0.7071 | 0.6734 | 0.6671 | 0.6587 | 0.7004 | 0.7071 | 0.6959 |
| 0.606 | 127.0 | 24384 | 1.5673 | 0.6995 | 0.6995 | 0.6995 | 0.6995 | 0.6731 | 0.6580 | 0.6483 | 0.7012 | 0.6995 | 0.6874 |
| 0.5514 | 128.0 | 24576 | 1.7911 | 0.7071 | 0.7071 | 0.7071 | 0.7071 | 0.6882 | 0.6738 | 0.6678 | 0.7110 | 0.7071 | 0.6989 |
| 0.5754 | 129.0 | 24768 | 1.7411 | 0.7040 | 0.7040 | 0.7040 | 0.7040 | 0.6783 | 0.6646 | 0.6589 | 0.7034 | 0.7040 | 0.6942 |
| 0.5736 | 130.0 | 24960 | 1.5579 | 0.7117 | 0.7117 | 0.7117 | 0.7117 | 0.6782 | 0.6759 | 0.6664 | 0.7106 | 0.7117 | 0.7039 |
| 0.5644 | 131.0 | 25152 | 1.6990 | 0.6964 | 0.6964 | 0.6964 | 0.6964 | 0.6820 | 0.6639 | 0.6531 | 0.7038 | 0.6964 | 0.6857 |
| 0.569 | 132.0 | 25344 | 1.6989 | 0.6911 | 0.6911 | 0.6911 | 0.6911 | 0.6726 | 0.6471 | 0.6414 | 0.6931 | 0.6911 | 0.6779 |
| 0.5774 | 133.0 | 25536 | 1.6192 | 0.7048 | 0.7048 | 0.7048 | 0.7048 | 0.6904 | 0.6677 | 0.6688 | 0.7114 | 0.7048 | 0.6997 |
| 0.518 | 134.0 | 25728 | 1.8919 | 0.7033 | 0.7033 | 0.7033 | 0.7033 | 0.6874 | 0.6571 | 0.6556 | 0.7039 | 0.7033 | 0.6915 |
| 0.5982 | 135.0 | 25920 | 1.8296 | 0.6766 | 0.6766 | 0.6766 | 0.6766 | 0.6561 | 0.6529 | 0.6373 | 0.6895 | 0.6766 | 0.6699 |
| 0.5748 | 136.0 | 26112 | 1.7068 | 0.7185 | 0.7185 | 0.7185 | 0.7185 | 0.6978 | 0.6821 | 0.6749 | 0.7220 | 0.7185 | 0.7097 |
| 0.6264 | 137.0 | 26304 | 1.4707 | 0.7063 | 0.7063 | 0.7063 | 0.7063 | 0.6686 | 0.6754 | 0.6642 | 0.7066 | 0.7063 | 0.7011 |
| 0.5729 | 138.0 | 26496 | 1.7704 | 0.7033 | 0.7033 | 0.7033 | 0.7033 | 0.6694 | 0.6755 | 0.6619 | 0.7096 | 0.7033 | 0.6991 |
| 0.548 | 139.0 | 26688 | 1.5986 | 0.7109 | 0.7109 | 0.7109 | 0.7109 | 0.6760 | 0.6807 | 0.6648 | 0.7147 | 0.7109 | 0.7034 |
| 0.5417 | 140.0 | 26880 | 1.7461 | 0.7033 | 0.7033 | 0.7033 | 0.7033 | 0.6695 | 0.6778 | 0.6601 | 0.7098 | 0.7033 | 0.6971 |
| 0.5742 | 141.0 | 27072 | 1.7497 | 0.7155 | 0.7155 | 0.7155 | 0.7155 | 0.6880 | 0.6810 | 0.6715 | 0.7195 | 0.7155 | 0.7077 |
| 0.57 | 142.0 | 27264 | 1.6316 | 0.7025 | 0.7025 | 0.7025 | 0.7025 | 0.6768 | 0.6711 | 0.6633 | 0.7082 | 0.7025 | 0.6977 |
| 0.5533 | 143.0 | 27456 | 1.5841 | 0.7155 | 0.7155 | 0.7155 | 0.7155 | 0.6846 | 0.6792 | 0.6692 | 0.7184 | 0.7155 | 0.7076 |
| 0.5335 | 144.0 | 27648 | 1.7290 | 0.6964 | 0.6964 | 0.6964 | 0.6964 | 0.6668 | 0.6648 | 0.6567 | 0.6985 | 0.6964 | 0.6902 |
| 0.5442 | 145.0 | 27840 | 1.6522 | 0.7140 | 0.7140 | 0.7140 | 0.7140 | 0.6914 | 0.6801 | 0.6793 | 0.7155 | 0.7140 | 0.7096 |
| 0.5332 | 146.0 | 28032 | 1.7051 | 0.6979 | 0.6979 | 0.6979 | 0.6979 | 0.6736 | 0.6662 | 0.6581 | 0.7049 | 0.6979 | 0.6904 |
| 0.5089 | 147.0 | 28224 | 1.6610 | 0.7101 | 0.7101 | 0.7101 | 0.7101 | 0.6825 | 0.6836 | 0.6771 | 0.7157 | 0.7101 | 0.7074 |
| 0.5307 | 148.0 | 28416 | 1.6049 | 0.7109 | 0.7109 | 0.7109 | 0.7109 | 0.6833 | 0.6643 | 0.6614 | 0.7087 | 0.7109 | 0.7004 |
| 0.5652 | 149.0 | 28608 | 1.5608 | 0.7140 | 0.7140 | 0.7140 | 0.7140 | 0.6807 | 0.6754 | 0.6692 | 0.7126 | 0.7140 | 0.7073 |
| 0.5625 | 150.0 | 28800 | 1.8562 | 0.6850 | 0.6850 | 0.6850 | 0.6850 | 0.6489 | 0.6511 | 0.6379 | 0.6874 | 0.6850 | 0.6774 |
| 0.5409 | 151.0 | 28992 | 1.6366 | 0.7109 | 0.7109 | 0.7109 | 0.7109 | 0.6717 | 0.6693 | 0.6587 | 0.7069 | 0.7109 | 0.7011 |
| 0.5187 | 152.0 | 29184 | 1.6122 | 0.7147 | 0.7147 | 0.7147 | 0.7147 | 0.6844 | 0.6779 | 0.6677 | 0.7191 | 0.7147 | 0.7077 |
| 0.5439 | 153.0 | 29376 | 1.5994 | 0.7033 | 0.7033 | 0.7033 | 0.7033 | 0.6682 | 0.6670 | 0.6619 | 0.7022 | 0.7033 | 0.6981 |
| 0.5214 | 154.0 | 29568 | 1.6036 | 0.7124 | 0.7124 | 0.7124 | 0.7124 | 0.6659 | 0.6762 | 0.6599 | 0.7074 | 0.7124 | 0.7030 |
| 0.5171 | 155.0 | 29760 | 1.7052 | 0.7079 | 0.7079 | 0.7079 | 0.7079 | 0.6793 | 0.6754 | 0.6648 | 0.7115 | 0.7079 | 0.6998 |
| 0.5344 | 156.0 | 29952 | 1.4730 | 0.7094 | 0.7094 | 0.7094 | 0.7094 | 0.6777 | 0.6696 | 0.6644 | 0.7047 | 0.7094 | 0.7006 |
| 0.5147 | 157.0 | 30144 | 1.6911 | 0.7193 | 0.7193 | 0.7193 | 0.7193 | 0.6864 | 0.6829 | 0.6753 | 0.7177 | 0.7193 | 0.7112 |
| 0.4828 | 158.0 | 30336 | 2.0215 | 0.7079 | 0.7079 | 0.7079 | 0.7079 | 0.6770 | 0.6791 | 0.6680 | 0.7100 | 0.7079 | 0.7020 |
| 0.4964 | 159.0 | 30528 | 1.6681 | 0.7132 | 0.7132 | 0.7132 | 0.7132 | 0.6751 | 0.6771 | 0.6687 | 0.7100 | 0.7132 | 0.7066 |
| 0.5029 | 160.0 | 30720 | 1.7514 | 0.7101 | 0.7101 | 0.7101 | 0.7101 | 0.6813 | 0.6715 | 0.6663 | 0.7098 | 0.7101 | 0.7022 |
| 0.5107 | 161.0 | 30912 | 1.6907 | 0.7140 | 0.7140 | 0.7140 | 0.7140 | 0.6805 | 0.6744 | 0.6665 | 0.7115 | 0.7140 | 0.7050 |
| 0.4883 | 162.0 | 31104 | 1.8571 | 0.6957 | 0.6957 | 0.6957 | 0.6957 | 0.6638 | 0.6569 | 0.6474 | 0.6983 | 0.6957 | 0.6876 |
| 0.5133 | 163.0 | 31296 | 1.7273 | 0.7056 | 0.7056 | 0.7056 | 0.7056 | 0.6738 | 0.6743 | 0.6613 | 0.7097 | 0.7056 | 0.6981 |
| 0.4823 | 164.0 | 31488 | 1.7755 | 0.7246 | 0.7246 | 0.7246 | 0.7246 | 0.6894 | 0.6888 | 0.6792 | 0.7242 | 0.7246 | 0.7176 |
| 0.4854 | 165.0 | 31680 | 1.7858 | 0.7071 | 0.7071 | 0.7071 | 0.7071 | 0.6725 | 0.6760 | 0.6650 | 0.7091 | 0.7071 | 0.7015 |
| 0.502 | 166.0 | 31872 | 1.8761 | 0.7079 | 0.7079 | 0.7079 | 0.7079 | 0.6713 | 0.6765 | 0.6644 | 0.7084 | 0.7079 | 0.7015 |
| 0.5125 | 167.0 | 32064 | 1.6814 | 0.7086 | 0.7086 | 0.7086 | 0.7086 | 0.6820 | 0.6677 | 0.6653 | 0.7084 | 0.7086 | 0.7008 |
| 0.4878 | 168.0 | 32256 | 1.8586 | 0.7124 | 0.7124 | 0.7124 | 0.7124 | 0.6797 | 0.6778 | 0.6684 | 0.7134 | 0.7124 | 0.7057 |
| 0.5194 | 169.0 | 32448 | 1.8479 | 0.7185 | 0.7185 | 0.7185 | 0.7185 | 0.6802 | 0.6762 | 0.6657 | 0.7138 | 0.7185 | 0.7078 |
| 0.5469 | 170.0 | 32640 | 1.9661 | 0.7048 | 0.7048 | 0.7048 | 0.7048 | 0.6675 | 0.6664 | 0.6572 | 0.7010 | 0.7048 | 0.6960 |
| 0.485 | 171.0 | 32832 | 1.8135 | 0.7063 | 0.7063 | 0.7063 | 0.7063 | 0.6751 | 0.6742 | 0.6639 | 0.7064 | 0.7063 | 0.6979 |
| 0.5114 | 172.0 | 33024 | 1.8663 | 0.7140 | 0.7140 | 0.7140 | 0.7140 | 0.6759 | 0.6775 | 0.6637 | 0.7144 | 0.7140 | 0.7048 |
| 0.4581 | 173.0 | 33216 | 1.7983 | 0.7117 | 0.7117 | 0.7117 | 0.7117 | 0.6840 | 0.6720 | 0.6624 | 0.7132 | 0.7117 | 0.7014 |
| 0.5506 | 174.0 | 33408 | 1.5626 | 0.7185 | 0.7185 | 0.7185 | 0.7185 | 0.6823 | 0.6802 | 0.6717 | 0.7135 | 0.7185 | 0.7095 |
| 0.4769 | 175.0 | 33600 | 1.6893 | 0.7025 | 0.7025 | 0.7025 | 0.7025 | 0.6636 | 0.6631 | 0.6546 | 0.6965 | 0.7025 | 0.6932 |
| 0.4994 | 176.0 | 33792 | 1.7566 | 0.7079 | 0.7079 | 0.7079 | 0.7079 | 0.6753 | 0.6757 | 0.6651 | 0.7107 | 0.7079 | 0.7005 |
| 0.4547 | 177.0 | 33984 | 1.8461 | 0.7147 | 0.7147 | 0.7147 | 0.7147 | 0.6827 | 0.6779 | 0.6680 | 0.7133 | 0.7147 | 0.7049 |
| 0.4988 | 178.0 | 34176 | 1.7769 | 0.7178 | 0.7178 | 0.7178 | 0.7178 | 0.6804 | 0.6809 | 0.6683 | 0.7172 | 0.7178 | 0.7085 |
| 0.4509 | 179.0 | 34368 | 1.8389 | 0.7140 | 0.7140 | 0.7140 | 0.7140 | 0.6689 | 0.6763 | 0.6624 | 0.7078 | 0.7140 | 0.7043 |
| 0.4894 | 180.0 | 34560 | 1.9348 | 0.7178 | 0.7178 | 0.7178 | 0.7178 | 0.6843 | 0.6858 | 0.6760 | 0.7214 | 0.7178 | 0.7126 |
| 0.4614 | 181.0 | 34752 | 1.9625 | 0.7155 | 0.7155 | 0.7155 | 0.7155 | 0.6866 | 0.6817 | 0.6743 | 0.7161 | 0.7155 | 0.7079 |
| 0.4615 | 182.0 | 34944 | 1.8944 | 0.7132 | 0.7132 | 0.7132 | 0.7132 | 0.6826 | 0.6786 | 0.6679 | 0.7131 | 0.7132 | 0.7043 |
| 0.4592 | 183.0 | 35136 | 1.8405 | 0.7201 | 0.7201 | 0.7201 | 0.7201 | 0.6840 | 0.6812 | 0.6724 | 0.7170 | 0.7201 | 0.7116 |
| 0.4827 | 184.0 | 35328 | 1.8725 | 0.7155 | 0.7155 | 0.7155 | 0.7155 | 0.6822 | 0.6823 | 0.6716 | 0.7144 | 0.7155 | 0.7071 |
| 0.4662 | 185.0 | 35520 | 1.7896 | 0.7277 | 0.7277 | 0.7277 | 0.7277 | 0.6965 | 0.6898 | 0.6830 | 0.7250 | 0.7277 | 0.7191 |
| 0.4804 | 186.0 | 35712 | 1.9144 | 0.7170 | 0.7170 | 0.7170 | 0.7170 | 0.6859 | 0.6806 | 0.6729 | 0.7159 | 0.7170 | 0.7090 |
| 0.4677 | 187.0 | 35904 | 2.0640 | 0.7109 | 0.7109 | 0.7109 | 0.7109 | 0.6848 | 0.6774 | 0.6674 | 0.7143 | 0.7109 | 0.7024 |
| 0.4523 | 188.0 | 36096 | 1.9061 | 0.7231 | 0.7231 | 0.7231 | 0.7231 | 0.6918 | 0.6918 | 0.6856 | 0.7232 | 0.7231 | 0.7185 |
| 0.4408 | 189.0 | 36288 | 1.8713 | 0.7300 | 0.7300 | 0.7300 | 0.7300 | 0.6978 | 0.6971 | 0.6900 | 0.7304 | 0.7300 | 0.7250 |
| 0.46 | 190.0 | 36480 | 2.0144 | 0.7231 | 0.7231 | 0.7231 | 0.7231 | 0.6899 | 0.6897 | 0.6805 | 0.7221 | 0.7231 | 0.7162 |
| 0.4627 | 191.0 | 36672 | 1.9990 | 0.7170 | 0.7170 | 0.7170 | 0.7170 | 0.6844 | 0.6822 | 0.6747 | 0.7156 | 0.7170 | 0.7099 |
| 0.447 | 192.0 | 36864 | 2.0092 | 0.7216 | 0.7216 | 0.7216 | 0.7216 | 0.6884 | 0.6876 | 0.6786 | 0.7212 | 0.7216 | 0.7145 |
| 0.4599 | 193.0 | 37056 | 2.0249 | 0.7201 | 0.7201 | 0.7201 | 0.7201 | 0.6891 | 0.6878 | 0.6782 | 0.7196 | 0.7201 | 0.7124 |
| 0.4642 | 194.0 | 37248 | 1.9990 | 0.7216 | 0.7216 | 0.7216 | 0.7216 | 0.6924 | 0.6864 | 0.6788 | 0.7222 | 0.7216 | 0.7140 |
| 0.4614 | 195.0 | 37440 | 1.9922 | 0.7246 | 0.7246 | 0.7246 | 0.7246 | 0.6946 | 0.6889 | 0.6812 | 0.7247 | 0.7246 | 0.7171 |
| 0.4888 | 196.0 | 37632 | 1.9289 | 0.7193 | 0.7193 | 0.7193 | 0.7193 | 0.6860 | 0.6799 | 0.6730 | 0.7185 | 0.7193 | 0.7114 |
| 0.4465 | 197.0 | 37824 | 1.9415 | 0.7185 | 0.7185 | 0.7185 | 0.7185 | 0.6847 | 0.6786 | 0.6727 | 0.7168 | 0.7185 | 0.7111 |
| 0.4531 | 198.0 | 38016 | 1.9791 | 0.7124 | 0.7124 | 0.7124 | 0.7124 | 0.6819 | 0.6734 | 0.6671 | 0.7123 | 0.7124 | 0.7043 |
| 0.4805 | 199.0 | 38208 | 1.9764 | 0.7124 | 0.7124 | 0.7124 | 0.7124 | 0.6812 | 0.6733 | 0.6666 | 0.7126 | 0.7124 | 0.7045 |
| 0.4306 | 200.0 | 38400 | 1.9750 | 0.7132 | 0.7132 | 0.7132 | 0.7132 | 0.6817 | 0.6740 | 0.6672 | 0.7132 | 0.7132 | 0.7052 |
Framework versions
- Transformers 4.44.0
- Pytorch 2.3.1+cu121
- Datasets 4.0.0
- Tokenizers 0.19.1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for kurosekurose/mert_cmp_single_nse
Base model
m-a-p/MERT-v0