Finished finetuning grade 5

README.md

@@ -15,11 +15,12 @@ should probably proofread and complete it, then remove this comment. -->
 [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/gd6mkxtp)
 [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/s2qn3a6p)
 [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/qz6551rc)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/lm55kzij)
 # text-simplification
 
 This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.4367
+- Loss: 0.5203
 
 ## Model description
 
@@ -50,10 +51,8 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 0.4643        | 1.0   | 1174 | 0.4399          |
-| 0.4581        | 2.0   | 2348 | 0.4360          |
-| 0.4547        | 3.0   | 3522 | 0.4342          |
-| 0.452         | 4.0   | 4696 | 0.4367          |
+| 0.5464        | 1.0   | 775  | 0.5197          |
+| 0.5402        | 2.0   | 1550 | 0.5203          |
 
 
 ### Framework versions

gpt2-grade-5-finetuned/adapter_config.json

@@ -23,10 +23,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "c_attn",
-    "c_fc",
     "lm_head",
-    "c_proj"
+    "c_proj",
+    "c_fc",
+    "c_attn"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

gpt2-grade-5-finetuned/adapter_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7ca0e1c4334a463fa63c8f116f298e2e46287a70bb485bba6168d4cf35703e27
+oid sha256:8d43880788644a7f5a455e4c7f67b6f77363678065630f467b34e076065961bc
 size 160776023

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f1b97724ceb70fca675f96eca43940412e55a799ca8009715a5e4327361f3363
+oid sha256:6541f06e89dc26ef2d9baa29792b43a2ddc3dbe3b5ff119019273887c9d4332c
 size 5496