williamplacroix commited on
Commit
11eec3c
·
verified ·
1 Parent(s): 08ebb98

Finished finetuning grade 2

Browse files
README.md CHANGED
@@ -12,12 +12,12 @@ model-index:
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
 
15
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/42n7wyjl)
16
  # text-simplification
17
 
18
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.3608
21
 
22
  ## Model description
23
 
@@ -51,13 +51,6 @@ The following hyperparameters were used during training:
51
  | 0.4017 | 1.0 | 469 | 0.3665 |
52
  | 0.3951 | 2.0 | 938 | 0.3640 |
53
  | 0.3907 | 3.0 | 1407 | 0.3641 |
54
- | 0.3892 | 4.0 | 1876 | 0.3623 |
55
- | 0.3864 | 5.0 | 2345 | 0.3606 |
56
- | 0.3847 | 6.0 | 2814 | 0.3614 |
57
- | 0.383 | 7.0 | 3283 | 0.3606 |
58
- | 0.3821 | 8.0 | 3752 | 0.3609 |
59
- | 0.3815 | 9.0 | 4221 | 0.3610 |
60
- | 0.3806 | 10.0 | 4690 | 0.3608 |
61
 
62
 
63
  ### Framework versions
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
 
15
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/uds/Graded%20text%20simplification%20training/runs/gd6mkxtp)
16
  # text-simplification
17
 
18
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.3641
21
 
22
  ## Model description
23
 
 
51
  | 0.4017 | 1.0 | 469 | 0.3665 |
52
  | 0.3951 | 2.0 | 938 | 0.3640 |
53
  | 0.3907 | 3.0 | 1407 | 0.3641 |
 
 
 
 
 
 
 
54
 
55
 
56
  ### Framework versions
gpt2-grade-2-finetuned/adapter_config.json CHANGED
@@ -23,10 +23,10 @@
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
- "c_fc",
27
- "c_attn",
28
  "lm_head",
29
- "c_proj"
 
 
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
 
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
 
 
26
  "lm_head",
27
+ "c_proj",
28
+ "c_fc",
29
+ "c_attn"
30
  ],
31
  "task_type": "CAUSAL_LM",
32
  "use_dora": false,
gpt2-grade-2-finetuned/adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4befae71d3ecf37f12917a3a0825b40c7f14e9517932cb7691543736d133d327
3
  size 160776023
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1dbef794e1e4e345121b8aa9f50fa59e3c58c8ec07e72c09c3aafac6bc721fcb
3
  size 160776023
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b5faedaca63599a9ee5c38b36992fc6e39d2ddac460d824c93451e91a85592a3
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a11b1d4789c0a45c02b736aef3ae5657d38b50123ac84144adff993f3cf8e80
3
  size 5496