Model save

README.md

@@ -14,11 +14,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/mbart-large-cc25](https://huggingface.co/facebook/mbart-large-cc25) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.0624
-- Gen Len: 18.0733
-- Rouge-1: 39.3253
-- Rouge-2: 21.9098
-- Rouge-l: 38.5872
+- Loss: 3.1215
+- Gen Len: 17.3533
+- Rouge-1: 39.1861
+- Rouge-2: 22.0975
+- Rouge-l: 38.4014
 
 ## Model description
 
@@ -51,14 +51,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Gen Len | Rouge-1 | Rouge-2 | Rouge-l |
 |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:-------:|
-| No log        | 1.0   | 642  | 3.1848          | 26.2222 | 33.9748 | 18.3088 | 33.4231 |
-| No log        | 2.0   | 1284 | 3.0025          | 20.3911 | 37.1532 | 19.9004 | 36.5443 |
-| No log        | 3.0   | 1926 | 2.9040          | 19.3489 | 39.3585 | 22.1712 | 38.6987 |
-| No log        | 4.0   | 2568 | 2.9437          | 19.2956 | 39.0962 | 21.9264 | 38.3542 |
-| No log        | 5.0   | 3210 | 2.9452          | 17.7667 | 38.377  | 21.3498 | 37.5445 |
-| No log        | 6.0   | 3852 | 2.9731          | 19.7756 | 37.8249 | 21.0556 | 37.3231 |
-| No log        | 7.0   | 4494 | 3.0167          | 18.5222 | 38.291  | 20.6795 | 37.3757 |
-| 2.8376        | 8.0   | 5136 | 3.0624          | 18.0733 | 39.3253 | 21.9098 | 38.5872 |
+| No log        | 1.0   | 642  | 3.3523          | 22.5622 | 28.8044 | 14.6813 | 28.1959 |
+| No log        | 2.0   | 1284 | 2.9887          | 22.7422 | 36.6353 | 19.681  | 35.9403 |
+| No log        | 3.0   | 1926 | 2.9367          | 20.0578 | 38.6433 | 21.0943 | 37.9327 |
+| No log        | 4.0   | 2568 | 2.9503          | 18.5644 | 38.6509 | 21.3031 | 37.8452 |
+| No log        | 5.0   | 3210 | 2.9366          | 17.1689 | 38.8973 | 21.9518 | 38.3012 |
+| No log        | 6.0   | 3852 | 2.9782          | 19.2489 | 39.5578 | 22.3324 | 38.9385 |
+| No log        | 7.0   | 4494 | 3.0080          | 19.0422 | 38.1388 | 21.5059 | 37.4054 |
+| 2.8286        | 8.0   | 5136 | 3.0908          | 18.4667 | 38.7921 | 21.3614 | 38.0183 |
+| 2.8286        | 9.0   | 5778 | 3.1191          | 18.2978 | 39.3199 | 22.3807 | 38.6943 |
+| 2.8286        | 10.0  | 6420 | 3.1215          | 17.3533 | 39.1861 | 22.0975 | 38.4014 |
 
 
 ### Framework versions

mbart-large-cc25_prefix_tuning_12_par_bn_rf_4_hiru_structured_first3/adapter_config.json

@@ -4,14 +4,14 @@
     "configs": [
       {
         "architecture": "prefix_tuning",
-        "bottleneck_size": 800,
+        "bottleneck_size": 1000,
         "cross_prefix": true,
         "dropout": 0.0,
         "encoder_prefix": true,
         "flat": false,
         "leave_out": [],
         "non_linearity": "tanh",
-        "prefix_length": 12,
+        "prefix_length": 15,
         "shared_gating": true,
         "use_gating": false
       },
@@ -49,7 +49,7 @@
       }
     ]
   },
-  "config_id": "566272bc29d5691d",
+  "config_id": "40d3ac678e297941",
   "hidden_size": 1024,
   "model_class": "MBartForConditionalGeneration",
   "model_name": "facebook/mbart-large-cc25",

mbart-large-cc25_prefix_tuning_12_par_bn_rf_4_hiru_structured_first3/pytorch_adapter.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:97191af8ec4d40fea939d2a682d8069fd1cc5882ac3a629196be1e1e35a0c731
-size 296855468
+oid sha256:0afacd01c1f930016f895cc5a21b021f935ed534936f1f162b7c3a2f1442f539
+size 358334636