CitrusPrincess/Fine-tuning the model with the all Senate and House bills dataset.

README.md

@@ -4,6 +4,8 @@ license: apache-2.0
 base_model: google-t5/t5-small
 tags:
 - generated_from_trainer
+metrics:
+- rouge
 model-index:
 - name: MTSUSpring2025SoftwareEngineering
   results: []
@@ -15,6 +17,13 @@ should probably proofread and complete it, then remove this comment. -->
 # MTSUSpring2025SoftwareEngineering
 
 This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.1089
+- Rouge1: 0.3231
+- Rouge2: 0.2685
+- Rougel: 0.313
+- Rougelsum: 0.313
+- Gen Len: 19.8572
 
 ## Model description
 
@@ -33,7 +42,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
+- learning_rate: 0.0002
 - train_batch_size: 4
 - eval_batch_size: 4
 - seed: 42
@@ -42,6 +51,17 @@ The following hyperparameters were used during training:
 - num_epochs: 5
 - mixed_precision_training: Native AMP
 
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
+| 1.4692        | 1.0   | 14778 | 1.3005          | 0.3197 | 0.2609 | 0.3087 | 0.3087    | 19.8338 |
+| 1.3442        | 2.0   | 29556 | 1.2153          | 0.321  | 0.2648 | 0.3108 | 0.3108    | 19.8476 |
+| 1.2638        | 3.0   | 44334 | 1.1495          | 0.3214 | 0.2659 | 0.3112 | 0.3112    | 19.8867 |
+| 1.2194        | 4.0   | 59112 | 1.1216          | 0.323  | 0.2682 | 0.3131 | 0.3131    | 19.8804 |
+| 1.1679        | 5.0   | 73890 | 1.1089          | 0.3231 | 0.2685 | 0.313  | 0.313     | 19.8572 |
+
+
 ### Framework versions
 
 - Transformers 4.48.3

generation_config.json

@@ -1,5 +1,4 @@
 {
-  "_from_model_config": true,
   "decoder_start_token_id": 0,
   "eos_token_id": 1,
   "pad_token_id": 0,

runs/Mar20_15-39-12_ed53a04bf957/events.out.tfevents.1742485179.ed53a04bf957.1845.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6d6b1aaaadd81330ea98f564a45ddd742ec56203b13d5e42800157c5df1ff793
-size 39758
+oid sha256:7ce3abd5da359593cfd2bfd945584ac580c656eec0d8d8a022a112d8499b24fc
+size 40653