| | --- |
| | base_model: Hasanur525/deed-summarization_version_10 |
| | tags: |
| | - generated_from_trainer |
| | metrics: |
| | - rouge |
| | model-index: |
| | - name: deed-summarization_version_11 |
| | results: [] |
| | --- |
| | |
| | <!-- This model card has been generated automatically according to the information the Trainer had access to. You |
| | should probably proofread and complete it, then remove this comment. --> |
| |
|
| | # deed-summarization_version_11 |
| |
|
| | This model is a fine-tuned version of [Hasanur525/deed-summarization_version_10](https://huggingface.co/Hasanur525/deed-summarization_version_10) on the None dataset. |
| | It achieves the following results on the evaluation set: |
| | - Loss: 0.2748 |
| | - Rouge1: 0.7615 |
| | - Rouge2: 0.3638 |
| | - Rougel: 0.7644 |
| | - Rougelsum: 0.7534 |
| | - Gen Len: 98.2164 |
| |
|
| | ## Model description |
| |
|
| | More information needed |
| |
|
| | ## Intended uses & limitations |
| |
|
| | More information needed |
| |
|
| | ## Training and evaluation data |
| |
|
| | More information needed |
| |
|
| | ## Training procedure |
| |
|
| | ### Training hyperparameters |
| |
|
| | The following hyperparameters were used during training: |
| | - learning_rate: 2e-05 |
| | - train_batch_size: 4 |
| | - eval_batch_size: 4 |
| | - seed: 42 |
| | - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
| | - lr_scheduler_type: linear |
| | - lr_scheduler_warmup_steps: 5000 |
| | - num_epochs: 25 |
| | |
| | ### Training results |
| | |
| | | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len | |
| | |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:| |
| | | 1.1025 | 1.0 | 265 | 0.4128 | 0.3423 | 0.1522 | 0.3482 | 0.3493 | 98.4272 | |
| | | 0.7311 | 2.0 | 530 | 0.4113 | 0.3324 | 0.1504 | 0.3405 | 0.3389 | 98.465 | |
| | | 0.1826 | 3.0 | 795 | 0.4086 | 0.3511 | 0.1619 | 0.36 | 0.3585 | 98.328 | |
| | | 0.6314 | 4.0 | 1060 | 0.4053 | 0.3198 | 0.1474 | 0.3222 | 0.3179 | 98.4565 | |
| | | 0.4551 | 5.0 | 1325 | 0.4025 | 0.363 | 0.1659 | 0.3732 | 0.3694 | 98.3507 | |
| | | 1.1978 | 6.0 | 1590 | 0.3960 | 0.3611 | 0.1386 | 0.3589 | 0.3577 | 98.3043 | |
| | | 1.078 | 7.0 | 1855 | 0.3902 | 0.3158 | 0.1445 | 0.3112 | 0.3074 | 98.3809 | |
| | | 0.2222 | 8.0 | 2120 | 0.3846 | 0.4959 | 0.2242 | 0.494 | 0.4793 | 98.2212 | |
| | | 0.811 | 9.0 | 2385 | 0.3811 | 0.4641 | 0.2215 | 0.464 | 0.4499 | 98.2457 | |
| | | 0.4816 | 10.0 | 2650 | 0.3713 | 0.436 | 0.217 | 0.439 | 0.4368 | 98.1881 | |
| | | 0.2396 | 11.0 | 2915 | 0.3650 | 0.556 | 0.2677 | 0.5563 | 0.5475 | 98.2571 | |
| | | 0.1897 | 12.0 | 3180 | 0.3601 | 0.6718 | 0.4061 | 0.6712 | 0.6631 | 98.1597 | |
| | | 0.6071 | 13.0 | 3445 | 0.3498 | 0.5639 | 0.294 | 0.5623 | 0.5554 | 98.1096 | |
| | | 0.3386 | 14.0 | 3710 | 0.3416 | 0.4915 | 0.2933 | 0.5002 | 0.4954 | 98.069 | |
| | | 0.2921 | 15.0 | 3975 | 0.3342 | 0.4391 | 0.2676 | 0.4381 | 0.4342 | 97.7353 | |
| | | 1.4814 | 16.0 | 4240 | 0.3261 | 0.5389 | 0.2966 | 0.5542 | 0.5466 | 98.0945 | |
| | | 0.1891 | 17.0 | 4505 | 0.3167 | 0.4885 | 0.2725 | 0.5044 | 0.4923 | 98.2146 | |
| | | 0.4877 | 18.0 | 4770 | 0.3090 | 0.6391 | 0.3774 | 0.6378 | 0.6224 | 98.2098 | |
| | | 0.6804 | 19.0 | 5035 | 0.3016 | 0.766 | 0.4274 | 0.7649 | 0.7553 | 97.8828 | |
| | | 0.1395 | 20.0 | 5300 | 0.2930 | 0.7208 | 0.3954 | 0.7478 | 0.7245 | 98.0955 | |
| | | 0.4395 | 21.0 | 5565 | 0.2866 | 0.7457 | 0.406 | 0.7629 | 0.7453 | 97.9509 | |
| | | 0.2215 | 22.0 | 5830 | 0.2820 | 0.6278 | 0.3099 | 0.6447 | 0.6288 | 98.0255 | |
| | | 0.6845 | 23.0 | 6095 | 0.2775 | 0.7815 | 0.3541 | 0.7789 | 0.7629 | 98.1692 | |
| | | 0.3637 | 24.0 | 6360 | 0.2753 | 0.819 | 0.3989 | 0.8195 | 0.8062 | 98.328 | |
| | | 0.4836 | 25.0 | 6625 | 0.2748 | 0.7615 | 0.3638 | 0.7644 | 0.7534 | 98.2164 | |
| | |
| | |
| | ### Framework versions |
| | |
| | - Transformers 4.37.2 |
| | - Pytorch 2.1.0.dev20230811+cu121 |
| | - Datasets 2.17.0 |
| | - Tokenizers 0.15.2 |
| | |
