videomae-tiny-92-kinetics-binary-finetuned-xd-violence

This model is a fine-tuned version of MCG-NJU/videomae-base-finetuned-kinetics on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.7844
  • Accuracy: 0.6721
  • Precision: 0.7322
  • Recall: 0.5929
  • F1: 0.6553
  • Tp: 134
  • Tn: 155
  • Fp: 49
  • Fn: 92
  • Specificity: 0.7598
  • Unsafe Precision At Default Threshold: 0.6139
  • Unsafe Recall At Default Threshold: 0.7035
  • Unsafe F1 At Default Threshold: 0.6557
  • Unsafe Precision At Best Threshold: 0.6139
  • Unsafe Recall At Best Threshold: 0.7035
  • Unsafe Fbeta At Best Threshold: 0.6836
  • Best Threshold: 0.25
  • Roc Auc: 0.6918
  • Average Precision: 0.7164

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • lr_scheduler_type: cosine
  • lr_scheduler_warmup_ratio: 0.1
  • num_epochs: 92
  • mixed_precision_training: Native AMP

Training results

Training Loss Epoch Step Accuracy Average Precision Best Threshold F1 Fn Fp Validation Loss Precision Recall Roc Auc Specificity Tn Tp Unsafe F1 At Default Threshold Unsafe Fbeta At Best Threshold Unsafe Precision At Best Threshold Unsafe Precision At Default Threshold Unsafe Recall At Best Threshold Unsafe Recall At Default Threshold
0.715 1.0 422 0.5349 0.5972 0.25 0.6226 61 139 0.7038 0.5428 0.7301 0.5644 0.3186 65 165 0.6922 0.8490 0.5293 0.5293 1.0 1.0
0.6737 2.0 844 0.5860 0.6177 0.3 0.5616 112 66 0.6732 0.6333 0.5044 0.6353 0.6765 138 114 0.6922 0.8491 0.5398 0.5293 0.9912 1.0
0.6639 3.0 1266 0.6256 0.7115 0.25 0.5924 109 52 0.6413 0.6923 0.5177 0.7109 0.7451 152 117 0.6998 0.8516 0.5396 0.5396 0.9956 0.9956
0.7136 4.0 1688 0.6581 0.7143 0.3 0.6316 100 47 0.6424 0.7283 0.5575 0.7135 0.7696 157 126 0.6933 0.8511 0.5437 0.5305 0.9912 1.0
0.6542 5.0 2110 0.6767 0.7281 0.325 0.7203 47 92 0.6289 0.6605 0.7920 0.7326 0.5490 112 179 0.6911 0.8510 0.5383 0.5280 0.9956 1.0
0.64 6.0 2532 0.6605 0.7415 0.25 0.6332 100 46 0.6257 0.7326 0.5575 0.7230 0.7745 158 126 0.7044 0.8524 0.5463 0.5463 0.9912 0.9912
0.5858 7.0 2954 0.6581 0.7420 0.25 0.6059 113 34 0.6348 0.7687 0.5 0.7312 0.8333 170 113 0.7243 0.8151 0.6109 0.6109 0.8894 0.8894
0.6228 8.0 3376 0.6698 0.7342 0.25 0.6570 90 52 0.6220 0.7234 0.6018 0.7356 0.7451 152 136 0.7138 0.8538 0.5606 0.5606 0.9823 0.9823
0.6999 9.0 3798 0.6698 0.7371 0.3 0.6787 76 66 0.6204 0.6944 0.6637 0.7298 0.6765 138 150 0.6965 0.8517 0.5450 0.5343 0.9912 1.0
0.6338 10.0 4220 0.6791 0.7254 0.325 0.7064 60 78 0.6270 0.6803 0.7345 0.7254 0.6176 126 166 0.6934 0.8511 0.5493 0.5319 0.9867 0.9956
0.6303 11.0 4642 0.6744 0.7243 0.25 0.6916 69 71 0.6278 0.6886 0.6947 0.7191 0.6520 133 157 0.7057 0.8511 0.5493 0.5493 0.9867 0.9867
0.5972 12.0 5064 0.6442 0.7258 0.25 0.64 90 63 0.6289 0.6834 0.6018 0.7192 0.6912 141 136 0.7046 0.8505 0.5479 0.5479 0.9867 0.9867
0.6028 13.0 5486 0.6605 0.7486 0.275 0.6473 92 54 0.6168 0.7128 0.5929 0.7372 0.7353 150 134 0.6986 0.8456 0.5662 0.5461 0.9646 0.9690
0.6118 14.0 5908 0.6349 0.7392 0.25 0.5901 113 44 0.6310 0.7197 0.5 0.7263 0.7843 160 113 0.7074 0.8340 0.5646 0.5646 0.9469 0.9469
0.6541 15.0 6330 0.6419 0.7365 0.275 0.6188 101 53 0.6237 0.7022 0.5531 0.7271 0.7402 151 125 0.7006 0.8424 0.5651 0.5473 0.9602 0.9735
0.5885 16.0 6752 0.6628 0.7418 0.25 0.6329 101 44 0.6265 0.7396 0.5531 0.7241 0.7843 160 125 0.7074 0.8462 0.5556 0.5556 0.9735 0.9735
0.5378 17.0 7174 0.6512 0.7396 0.25 0.6287 99 51 0.6252 0.7135 0.5619 0.7244 0.75 153 127 0.7055 0.8410 0.5561 0.5561 0.9646 0.9646
0.6367 18.0 7596 0.6581 0.7411 0.25 0.6423 94 53 0.6248 0.7135 0.5841 0.7268 0.7402 151 132 0.7024 0.8353 0.5553 0.5553 0.9558 0.9558
0.6296 19.0 8018 0.6535 0.7412 0.25 0.6284 100 49 0.6264 0.72 0.5575 0.7266 0.7598 155 126 0.7016 0.8307 0.5573 0.5573 0.9469 0.9469
0.6629 20.0 8440 0.6535 0.7410 0.25 0.6284 100 49 0.6274 0.72 0.5575 0.7261 0.7598 155 126 0.6995 0.8275 0.5561 0.5561 0.9425 0.9425
0.6318 21.0 8862 0.6608 0.6023 0.7434 0.3717 0.4956 84 175 29 142 0.8578 0.5710 0.9071 0.7009 0.5710 0.9071 0.8116 0.25 0.7018 0.7147
0.5924 22.0 9284 0.6293 0.6512 0.7468 0.5088 0.6053 115 165 39 111 0.8088 0.5522 0.9602 0.7011 0.5522 0.9602 0.8365 0.25 0.7125 0.7407
0.6122 23.0 9706 0.6270 0.6465 0.6927 0.5885 0.6364 133 145 59 93 0.7108 0.5370 0.9956 0.6977 0.5437 0.9912 0.8511 0.275 0.7122 0.7250
0.6009 24.0 10128 0.6493 0.6349 0.7594 0.4469 0.5627 101 172 32 125 0.8431 0.5658 0.8938 0.6930 0.5658 0.8938 0.8010 0.25 0.7082 0.7303
0.5984 25.0 10550 0.6321 0.6605 0.7 0.6195 0.6573 140 144 60 86 0.7059 0.5459 0.9735 0.6995 0.5459 0.9735 0.8416 0.25 0.7099 0.7335
0.6635 26.0 10972 0.6477 0.6349 0.7091 0.5177 0.5985 117 156 48 109 0.7647 0.5723 0.8761 0.6923 0.5723 0.8761 0.7920 0.25 0.7036 0.7222
0.6299 27.0 11394 0.6421 0.6349 0.7255 0.4912 0.5858 111 162 42 115 0.7941 0.5806 0.8761 0.6984 0.5806 0.8761 0.7952 0.25 0.7096 0.7346
0.5977 28.0 11816 0.6281 0.6558 0.7378 0.5354 0.6205 121 161 43 105 0.7892 0.545 0.9646 0.6965 0.545 0.9646 0.8359 0.25 0.7157 0.7376
0.5986 29.0 12238 0.6464 0.6442 0.7829 0.4469 0.5690 101 176 28 125 0.8627 0.5752 0.8628 0.6903 0.6161 0.8451 0.7867 0.275 0.7198 0.7434
0.5657 30.0 12660 0.6417 0.6349 0.6885 0.5575 0.6161 126 147 57 100 0.7206 0.5615 0.9292 0.7 0.5615 0.9292 0.8216 0.25 0.6966 0.7209
0.5328 31.0 13082 0.6350 0.6372 0.6716 0.6062 0.6372 137 137 67 89 0.6716 0.5570 0.9513 0.7026 0.5570 0.9513 0.8333 0.25 0.7082 0.7264
0.5098 32.0 13504 0.6279 0.6581 0.7112 0.5885 0.6441 133 150 54 93 0.7353 0.5618 0.9248 0.6990 0.5618 0.9248 0.8190 0.25 0.7183 0.7380
0.5731 33.0 13926 0.6433 0.6488 0.7049 0.5708 0.6308 129 150 54 97 0.7353 0.5481 0.9336 0.6907 0.5481 0.9336 0.8185 0.25 0.6974 0.7182
0.5336 34.0 14348 0.6450 0.6372 0.6591 0.6416 0.6502 145 129 75 81 0.6324 0.5570 0.9513 0.7026 0.5570 0.9513 0.8333 0.25 0.7067 0.7260
0.5981 35.0 14770 0.6483 0.6651 0.6916 0.6549 0.6727 148 138 66 78 0.6765 0.5493 0.9115 0.6855 0.5493 0.9115 0.8053 0.25 0.7109 0.7307
0.6054 36.0 15192 0.6534 0.6465 0.7403 0.5044 0.6 114 164 40 112 0.8039 0.5816 0.8673 0.6963 0.5816 0.8673 0.7897 0.25 0.7020 0.7302
0.5677 37.0 15614 0.6662 0.6233 0.6720 0.5531 0.6068 125 143 61 101 0.7010 0.5774 0.8584 0.6904 0.5774 0.8584 0.7823 0.25 0.6920 0.7038
0.5865 38.0 16036 0.6593 0.6395 0.7029 0.5442 0.6135 123 152 52 103 0.7451 0.5974 0.8274 0.6939 0.5974 0.8274 0.7683 0.25 0.7059 0.7295
0.5453 39.0 16458 0.6554 0.6326 0.7073 0.5133 0.5949 116 156 48 110 0.7647 0.5912 0.8319 0.6912 0.5912 0.8319 0.7692 0.25 0.7073 0.7301
0.5755 40.0 16880 0.6818 0.6233 0.7254 0.4558 0.5598 103 165 39 123 0.8088 0.6329 0.8009 0.7070 0.6329 0.8009 0.7605 0.25 0.7084 0.7235
0.4339 41.0 17302 0.6471 0.6535 0.7059 0.5841 0.6392 132 149 55 94 0.7304 0.625 0.8850 0.7326 0.625 0.8850 0.8170 0.25 0.7338 0.7396
0.638 42.0 17724 0.6720 0.6372 0.6989 0.5442 0.6119 123 151 53 103 0.7402 0.5987 0.8186 0.6916 0.5987 0.8186 0.7626 0.25 0.7078 0.7347
0.6158 43.0 18146 0.6449 0.6465 0.6814 0.6150 0.6465 139 139 65 87 0.6814 0.5580 0.9159 0.6935 0.5787 0.9115 0.8175 0.275 0.7109 0.7256
0.5543 44.0 18568 0.6830 0.6070 0.6887 0.4602 0.5517 104 157 47 122 0.7696 0.5839 0.8319 0.6861 0.5839 0.8319 0.7667 0.25 0.6774 0.7027
0.6408 45.0 18990 0.6737 0.6419 0.6651 0.6416 0.6532 145 131 73 81 0.6422 0.5714 0.8850 0.6944 0.5714 0.8850 0.7974 0.25 0.6950 0.7267
0.5412 46.0 19412 0.6515 0.6419 0.7169 0.5265 0.6071 119 157 47 107 0.7696 0.5794 0.8717 0.6961 0.5794 0.8717 0.7918 0.25 0.7118 0.7279
0.4707 47.0 19834 0.6639 0.6326 0.6954 0.5354 0.605 121 151 53 105 0.7402 0.5740 0.8584 0.6879 0.5740 0.8584 0.7810 0.25 0.6972 0.7280
0.6093 48.0 20256 0.6578 0.6558 0.7216 0.5619 0.6318 127 155 49 99 0.7598 0.5799 0.8673 0.6950 0.5799 0.8673 0.7890 0.25 0.6995 0.7390
0.5668 49.0 20678 0.6748 0.6372 0.7273 0.4956 0.5895 112 162 42 114 0.7941 0.6201 0.7655 0.6851 0.6201 0.7655 0.7312 0.25 0.7157 0.7447
0.5312 50.0 21100 0.6832 0.6605 0.7105 0.5973 0.6490 135 149 55 91 0.7304 0.6032 0.8274 0.6978 0.6032 0.8274 0.7702 0.25 0.7030 0.7120
0.5586 51.0 21522 0.7203 0.6279 0.7260 0.4690 0.5699 106 164 40 120 0.8039 0.5943 0.7389 0.6588 0.5943 0.7389 0.7046 0.25 0.6823 0.7029
0.5103 52.0 21944 0.7010 0.6349 0.6949 0.5442 0.6104 123 150 54 103 0.7353 0.5807 0.8274 0.6825 0.5807 0.8274 0.7626 0.25 0.6904 0.7124
0.511 53.0 22366 0.6848 0.6326 0.6868 0.5531 0.6127 125 147 57 101 0.7206 0.5916 0.8142 0.6853 0.5916 0.8142 0.7572 0.25 0.6976 0.7328
0.5577 54.0 22788 0.6841 0.6419 0.6593 0.6593 0.6593 149 127 77 77 0.6225 0.5677 0.8717 0.6876 0.5677 0.8717 0.7874 0.25 0.7045 0.7373
0.5502 55.0 23210 0.7033 0.6651 0.6881 0.6637 0.6757 150 136 68 76 0.6667 0.5610 0.8540 0.6772 0.5610 0.8540 0.7732 0.25 0.6879 0.6960
0.5591 56.0 23632 0.7198 0.6326 0.7024 0.5221 0.5990 118 154 50 108 0.7549 0.6049 0.7655 0.6758 0.6049 0.7655 0.7269 0.25 0.6908 0.7164
0.4376 57.0 24054 0.7017 0.6419 0.7308 0.5044 0.5969 114 162 42 112 0.7941 0.6322 0.7301 0.6776 0.6322 0.7301 0.7082 0.25 0.7125 0.7361
0.4775 58.0 24476 0.6878 0.6419 0.7195 0.5221 0.6051 118 158 46 108 0.7745 0.6041 0.7832 0.6821 0.6041 0.7832 0.7393 0.25 0.7091 0.7314
0.5433 59.0 24898 0.6964 0.6512 0.7021 0.5841 0.6377 132 148 56 94 0.7255 0.5823 0.8142 0.6790 0.5823 0.8142 0.7541 0.25 0.6967 0.7304
0.441 60.0 25320 0.7444 0.6395 0.7383 0.4867 0.5867 110 165 39 116 0.8088 0.608 0.6726 0.6387 0.608 0.6726 0.6586 0.25 0.6862 0.7130
0.6373 61.0 25742 0.7255 0.6465 0.7011 0.5708 0.6293 129 149 55 97 0.7304 0.5892 0.7743 0.6692 0.5892 0.7743 0.7286 0.25 0.6895 0.7127
0.481 62.0 26164 0.7204 0.6581 0.6890 0.6372 0.6621 144 139 65 82 0.6814 0.5875 0.8319 0.6886 0.5875 0.8319 0.7680 0.25 0.6975 0.7171
0.3889 63.0 26586 0.7529 0.6279 0.6813 0.5487 0.6078 124 146 58 102 0.7157 0.6050 0.7522 0.6706 0.6050 0.7522 0.7173 0.25 0.6752 0.6935
0.4987 64.0 27008 0.7428 0.6512 0.7111 0.5664 0.6305 128 152 52 98 0.7451 0.6137 0.7522 0.6759 0.6137 0.7522 0.7197 0.25 0.6906 0.7147
0.4427 65.0 27430 0.7427 0.6535 0.7127 0.5708 0.6339 129 152 52 97 0.7451 0.5964 0.7389 0.6601 0.5964 0.7389 0.7052 0.25 0.6845 0.7239
0.4008 66.0 27852 0.7042 0.6698 0.71 0.6283 0.6667 142 146 58 84 0.7157 0.5966 0.7788 0.6756 0.6184 0.7743 0.7372 0.275 0.7198 0.7375
0.5188 67.0 28274 0.7150 0.6512 0.7159 0.5575 0.6269 126 154 50 100 0.7549 0.6079 0.7478 0.6706 0.6079 0.7478 0.7149 0.25 0.6955 0.7317
0.4265 68.0 28696 0.7367 0.6698 0.7333 0.5841 0.6502 132 156 48 94 0.7647 0.6125 0.7345 0.6680 0.6125 0.7345 0.7064 0.25 0.6938 0.7194
0.3242 69.0 29118 0.8226 0.6302 0.7190 0.4867 0.5805 110 161 43 116 0.7892 0.6376 0.6460 0.6418 0.6518 0.6460 0.6472 0.275 0.6717 0.7079
0.6007 70.0 29540 0.7779 0.6605 0.7273 0.5664 0.6368 128 156 48 98 0.7647 0.62 0.6858 0.6513 0.62 0.6858 0.6716 0.25 0.6882 0.7249
0.4966 71.0 29962 0.7819 0.6395 0.7233 0.5088 0.5974 115 160 44 111 0.7843 0.6025 0.6504 0.6255 0.6025 0.6504 0.6402 0.25 0.6728 0.7103
0.4704 72.0 30384 0.7876 0.6372 0.7134 0.5177 0.6 117 157 47 109 0.7696 0.6314 0.6593 0.6450 0.6314 0.6593 0.6535 0.25 0.6820 0.7114
0.4783 73.0 30806 0.7493 0.6674 0.7399 0.5664 0.6416 128 159 45 98 0.7794 0.6389 0.7124 0.6736 0.6389 0.7124 0.6964 0.25 0.7031 0.7349
0.4718 74.0 31228 0.7350 0.6628 0.7035 0.6195 0.6588 140 145 59 86 0.7108 0.5993 0.7478 0.6654 0.5993 0.7478 0.7125 0.25 0.7077 0.7351
0.4601 75.0 31650 0.7951 0.6442 0.7212 0.5265 0.6087 119 158 46 107 0.7745 0.6220 0.6770 0.6483 0.6220 0.6770 0.6652 0.25 0.6789 0.7148
0.5263 76.0 32072 0.7668 0.6581 0.7090 0.5929 0.6458 134 149 55 92 0.7304 0.5934 0.7168 0.6493 0.5934 0.7168 0.6882 0.25 0.6854 0.7109
0.4233 77.0 32494 0.7819 0.6651 0.7356 0.5664 0.64 128 158 46 98 0.7745 0.6102 0.6858 0.6458 0.6102 0.6858 0.6693 0.25 0.6820 0.7109
0.5201 78.0 32916 0.7647 0.6419 0.6915 0.5752 0.6280 130 146 58 96 0.7157 0.6058 0.7345 0.664 0.6058 0.7345 0.7046 0.25 0.6911 0.7274
0.3932 79.0 33338 0.7824 0.6651 0.7092 0.6150 0.6588 139 147 57 87 0.7206 0.6151 0.7212 0.6640 0.6151 0.7212 0.6972 0.25 0.6963 0.7194
0.4442 80.0 33760 0.7667 0.6628 0.7143 0.5973 0.6506 135 150 54 91 0.7353 0.6082 0.7212 0.6599 0.6082 0.7212 0.6954 0.25 0.6932 0.7237
0.3872 81.0 34182 0.7803 0.6721 0.7374 0.5841 0.6519 132 157 47 94 0.7696 0.6260 0.7035 0.6625 0.6260 0.7035 0.6865 0.25 0.6946 0.7193
0.4327 82.0 34604 0.7694 0.6651 0.7278 0.5796 0.6453 131 155 49 95 0.7598 0.6084 0.7080 0.6544 0.6084 0.7080 0.6855 0.25 0.6912 0.7158
0.4644 83.0 35026 0.7887 0.6674 0.7485 0.5531 0.6361 125 162 42 101 0.7941 0.6245 0.6770 0.6497 0.6245 0.6770 0.6658 0.25 0.6872 0.7172
0.4664 84.0 35448 0.7796 0.6628 0.7143 0.5973 0.6506 135 150 54 91 0.7353 0.6139 0.7035 0.6557 0.6295 0.6991 0.6840 0.275 0.6930 0.7162
0.4565 85.0 35870 0.7816 0.6651 0.7330 0.5708 0.6418 129 157 47 97 0.7696 0.6163 0.7035 0.6570 0.6163 0.7035 0.6842 0.25 0.6909 0.7190
0.5554 86.0 36292 0.7856 0.6721 0.7401 0.5796 0.6501 131 158 46 95 0.7745 0.6235 0.7035 0.6611 0.6235 0.7035 0.6859 0.25 0.6906 0.7167
0.436 87.0 36714 0.7825 0.6698 0.7283 0.5929 0.6537 134 154 50 92 0.7549 0.6139 0.7035 0.6557 0.6310 0.7035 0.6877 0.275 0.6924 0.7174
0.3596 88.0 37136 0.7835 0.6744 0.7337 0.5973 0.6585 135 155 49 91 0.7598 0.6139 0.7035 0.6557 0.6139 0.7035 0.6836 0.25 0.6922 0.7178
0.276 89.0 37558 0.7840 0.6698 0.7234 0.6018 0.6570 136 152 52 90 0.7451 0.6139 0.7035 0.6557 0.6139 0.7035 0.6836 0.25 0.6923 0.7171
0.4381 90.0 37980 0.7844 0.6721 0.7322 0.5929 0.6553 134 155 49 92 0.7598 0.6139 0.7035 0.6557 0.6139 0.7035 0.6836 0.25 0.6921 0.7167
0.3547 91.0 38402 0.7841 0.6721 0.7322 0.5929 0.6553 134 155 49 92 0.7598 0.6139 0.7035 0.6557 0.6139 0.7035 0.6836 0.25 0.6918 0.7163
0.4284 92.0 38824 0.7844 0.6721 0.7322 0.5929 0.6553 134 155 49 92 0.7598 0.6139 0.7035 0.6557 0.6139 0.7035 0.6836 0.25 0.6918 0.7164

Framework versions

  • Transformers 4.51.3
  • Pytorch 2.5.1+cu121
  • Datasets 3.6.0
  • Tokenizers 0.21.4
Downloads last month
6
Safetensors
Model size
5.63M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mitegvg/videomae-tiny-92-kinetics-binary-finetuned-xd-violence

Finetuned
(277)
this model