| --- |
| license: apache-2.0 |
| base_model: google/flan-t5-base |
| tags: |
| - generated_from_trainer |
| metrics: |
| - rouge |
| model-index: |
| - name: flant5action |
| results: [] |
| --- |
| |
| <!-- This model card has been generated automatically according to the information the Trainer had access to. You |
| should probably proofread and complete it, then remove this comment. --> |
|
|
| # flant5action |
|
|
| This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset. |
| It achieves the following results on the evaluation set: |
| - Loss: 0.1428 |
| - Rouge1: 56.0664 |
| - Rouge2: 34.7343 |
| - Rougel: 56.0394 |
| - Rougelsum: 56.0313 |
| - Gen Len: 18.9852 |
|
|
| ## Model description |
|
|
| More information needed |
|
|
| ## Intended uses & limitations |
|
|
| More information needed |
|
|
| ## Training and evaluation data |
|
|
| More information needed |
|
|
| ## Training procedure |
|
|
| ### Training hyperparameters |
|
|
| The following hyperparameters were used during training: |
| - learning_rate: 5e-05 |
| - train_batch_size: 8 |
| - eval_batch_size: 8 |
| - seed: 42 |
| - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
| - lr_scheduler_type: linear |
| - num_epochs: 25 |
|
|
| ### Training results |
|
|
| | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len | |
| |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:| |
| | 0.2525 | 1.0 | 674 | 0.2294 | 53.2181 | 29.8509 | 53.1635 | 53.1474 | 19.0 | |
| | 0.2434 | 2.0 | 1348 | 0.2240 | 53.5453 | 30.1367 | 53.4479 | 53.44 | 18.9970 | |
| | 0.2281 | 3.0 | 2022 | 0.2135 | 53.1901 | 30.3456 | 53.0849 | 53.0759 | 18.9970 | |
| | 0.2221 | 4.0 | 2696 | 0.2056 | 52.0669 | 29.4321 | 51.9567 | 51.9512 | 18.9881 | |
| | 0.2145 | 5.0 | 3370 | 0.2012 | 54.484 | 31.6451 | 54.4213 | 54.4144 | 18.9970 | |
| | 0.2121 | 6.0 | 4044 | 0.1961 | 54.1219 | 31.2019 | 54.0701 | 54.0668 | 18.9970 | |
| | 0.1979 | 7.0 | 4718 | 0.1901 | 54.9091 | 32.2416 | 54.8482 | 54.8318 | 18.9911 | |
| | 0.2086 | 8.0 | 5392 | 0.1846 | 54.9615 | 32.4701 | 54.8836 | 54.8821 | 18.9970 | |
| | 0.1985 | 9.0 | 6066 | 0.1795 | 55.2027 | 32.5792 | 55.1531 | 55.1431 | 18.9970 | |
| | 0.2027 | 10.0 | 6740 | 0.1746 | 54.4079 | 32.2598 | 54.38 | 54.3697 | 18.9970 | |
| | 0.1922 | 11.0 | 7414 | 0.1707 | 55.4814 | 33.2069 | 55.4428 | 55.4298 | 18.9970 | |
| | 0.1806 | 12.0 | 8088 | 0.1660 | 55.7189 | 33.831 | 55.6796 | 55.6702 | 18.9970 | |
| | 0.1834 | 13.0 | 8762 | 0.1623 | 55.6253 | 33.9516 | 55.5925 | 55.585 | 18.9941 | |
| | 0.1795 | 14.0 | 9436 | 0.1596 | 55.6786 | 33.7589 | 55.6232 | 55.6183 | 18.9911 | |
| | 0.1767 | 15.0 | 10110 | 0.1553 | 55.8132 | 34.1603 | 55.795 | 55.7873 | 18.9911 | |
| | 0.1792 | 16.0 | 10784 | 0.1539 | 55.9694 | 34.4612 | 55.9454 | 55.9323 | 18.9792 | |
| | 0.1785 | 17.0 | 11458 | 0.1521 | 56.2202 | 34.6224 | 56.1781 | 56.1706 | 18.9941 | |
| | 0.1705 | 18.0 | 12132 | 0.1496 | 56.4102 | 34.7821 | 56.3911 | 56.3789 | 18.9911 | |
| | 0.1668 | 19.0 | 12806 | 0.1478 | 56.1222 | 34.6804 | 56.0821 | 56.077 | 18.9881 | |
| | 0.1729 | 20.0 | 13480 | 0.1459 | 56.1605 | 34.8596 | 56.1349 | 56.1221 | 18.9852 | |
| | 0.1759 | 21.0 | 14154 | 0.1451 | 56.1232 | 34.8956 | 56.1054 | 56.0994 | 18.9852 | |
| | 0.1713 | 22.0 | 14828 | 0.1439 | 55.9801 | 34.6435 | 55.9556 | 55.9482 | 18.9763 | |
| | 0.1751 | 23.0 | 15502 | 0.1436 | 56.2088 | 34.8754 | 56.1771 | 56.1758 | 18.9852 | |
| | 0.1626 | 24.0 | 16176 | 0.1431 | 56.0657 | 34.7302 | 56.04 | 56.0317 | 18.9852 | |
| | 0.1696 | 25.0 | 16850 | 0.1428 | 56.0664 | 34.7343 | 56.0394 | 56.0313 | 18.9852 | |
|
|
|
|
| ### Framework versions |
|
|
| - Transformers 4.31.0 |
| - Pytorch 2.0.1+cu118 |
| - Datasets 2.14.3 |
| - Tokenizers 0.13.3 |
|
|
