Finished finetuning grade 9

README.md

@@ -12,14 +12,12 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/r287j4vq)
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/o968fmfk)
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/vwj89krn)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/fqk06uhr)
 # text-simplification
 
 This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.8006
+- Loss: 0.5755
 
 ## Model description
 
@@ -50,12 +48,11 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.8367        | 1.0   | 612  | 0.8025          |
-| 0.8301        | 2.0   | 1224 | 0.8006          |
-| 0.8267        | 3.0   | 1836 | 0.8000          |
-| 0.8225        | 4.0   | 2448 | 0.7992          |
-| 0.8202        | 5.0   | 3060 | 0.7985          |
-| 0.8182        | 6.0   | 3672 | 0.8006          |
+| 0.6211        | 1.0   | 898  | 0.5805          |
+| 0.6157        | 2.0   | 1796 | 0.5763          |
+| 0.6128        | 3.0   | 2694 | 0.5742          |
+| 0.6102        | 4.0   | 3592 | 0.5738          |
+| 0.6073        | 5.0   | 4490 | 0.5755          |
 
 
 ### Framework versions

gpt2-grade-9-finetuned/adapter_config.json

@@ -23,9 +23,9 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "c_fc",
     "c_attn",
     "c_proj",
+    "c_fc",
     "lm_head"
   ],
   "task_type": "CAUSAL_LM",

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c67f657783f5b0ada1deacd98b03b4f6f547951c16b9f8762b68a3dc20cc57c1
+oid sha256:233d27052f3274bf965374919fe126018adf5670e5b612f5f26c9ccbde9b8a09
 size 5496