be2be2 commited on
Commit
a74a80c
·
verified ·
1 Parent(s): b609132

be2be2/et5-typos-maker-ver2

Browse files
README.md CHANGED
@@ -18,12 +18,12 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [j5ng/et5-typos-corrector](https://huggingface.co/j5ng/et5-typos-corrector) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.9276
22
  - Rouge1: 0.0
23
  - Rouge2: 0.0
24
  - Rougel: 0.0
25
  - Rougelsum: 0.0
26
- - Gen Len: 12.1935
27
 
28
  ## Model description
29
 
@@ -55,26 +55,46 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
- | 2.7078 | 0.1 | 100 | 1.7370 | 0.0 | 0.0 | 0.0 | 0.0 | 11.7045 |
59
- | 1.7594 | 0.2 | 200 | 1.4867 | 0.0 | 0.0 | 0.0 | 0.0 | 11.7515 |
60
- | 1.5496 | 0.3 | 300 | 1.3286 | 0.0 | 0.0 | 0.0 | 0.0 | 11.834 |
61
- | 1.429 | 0.4 | 400 | 1.2470 | 0.0 | 0.0 | 0.0 | 0.0 | 12.003 |
62
- | 1.3714 | 0.5 | 500 | 1.1811 | 0.0 | 0.0 | 0.0 | 0.0 | 12.0145 |
63
- | 1.2822 | 0.6 | 600 | 1.1452 | 0.0 | 0.0 | 0.0 | 0.0 | 11.999 |
64
- | 1.2407 | 0.7 | 700 | 1.0803 | 0.0 | 0.0 | 0.0 | 0.0 | 12.092 |
65
- | 1.1908 | 0.8 | 800 | 1.0616 | 0.0 | 0.0 | 0.0 | 0.0 | 12.023 |
66
- | 1.1535 | 0.9 | 900 | 1.0261 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1115 |
67
- | 1.1341 | 1.0 | 1000 | 1.0039 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1475 |
68
- | 0.9145 | 1.1 | 1100 | 0.9805 | 0.0 | 0.0 | 0.0 | 0.0 | 12.185 |
69
- | 0.9111 | 1.2 | 1200 | 0.9741 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3435 |
70
- | 0.8736 | 1.3 | 1300 | 0.9667 | 0.0 | 0.0 | 0.0 | 0.0 | 12.147 |
71
- | 0.855 | 1.4 | 1400 | 0.9600 | 0.0 | 0.0 | 0.0 | 0.0 | 12.21 |
72
- | 0.8754 | 1.5 | 1500 | 0.9506 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1465 |
73
- | 0.8576 | 1.6 | 1600 | 0.9418 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1645 |
74
- | 0.8518 | 1.7 | 1700 | 0.9329 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2435 |
75
- | 0.8322 | 1.8 | 1800 | 0.9321 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1975 |
76
- | 0.8275 | 1.9 | 1900 | 0.9304 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1885 |
77
- | 0.8157 | 2.0 | 2000 | 0.9276 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1935 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
78
 
79
 
80
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [j5ng/et5-typos-corrector](https://huggingface.co/j5ng/et5-typos-corrector) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7980
22
  - Rouge1: 0.0
23
  - Rouge2: 0.0
24
  - Rougel: 0.0
25
  - Rougelsum: 0.0
26
+ - Gen Len: 12.393
27
 
28
  ## Model description
29
 
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
57
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
58
+ | 2.6767 | 0.05 | 100 | 1.7986 | 0.0 | 0.0 | 0.0 | 0.0 | 11.7733 |
59
+ | 1.8043 | 0.1 | 200 | 1.5141 | 0.0 | 0.0 | 0.0 | 0.0 | 11.96 |
60
+ | 1.5302 | 0.15 | 300 | 1.3564 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1402 |
61
+ | 1.4056 | 0.2 | 400 | 1.2753 | 0.0 | 0.0 | 0.0 | 0.0 | 12.152 |
62
+ | 1.3319 | 0.25 | 500 | 1.1993 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1468 |
63
+ | 1.2765 | 0.3 | 600 | 1.1429 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1095 |
64
+ | 1.2172 | 0.35 | 700 | 1.1243 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1418 |
65
+ | 1.1631 | 0.4 | 800 | 1.0812 | 0.0 | 0.0 | 0.0 | 0.0 | 12.138 |
66
+ | 1.1409 | 0.45 | 900 | 1.0510 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1267 |
67
+ | 1.1012 | 0.5 | 1000 | 1.0116 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2747 |
68
+ | 1.0973 | 0.55 | 1100 | 0.9905 | 0.0 | 0.0 | 0.0 | 0.0 | 12.358 |
69
+ | 1.0126 | 0.6 | 1200 | 0.9786 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3313 |
70
+ | 1.0697 | 0.65 | 1300 | 0.9535 | 0.0 | 0.0 | 0.0 | 0.0 | 12.252 |
71
+ | 1.0192 | 0.7 | 1400 | 0.9333 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2155 |
72
+ | 1.0312 | 0.75 | 1500 | 0.9366 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2265 |
73
+ | 0.9608 | 0.8 | 1600 | 0.9175 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2825 |
74
+ | 1.0319 | 0.85 | 1700 | 0.8935 | 0.0 | 0.0 | 0.0 | 0.0 | 12.32 |
75
+ | 1.002 | 0.9 | 1800 | 0.8972 | 0.0 | 0.0 | 0.0 | 0.0 | 12.1375 |
76
+ | 0.9787 | 0.95 | 1900 | 0.8744 | 0.0 | 0.0 | 0.0 | 0.0 | 12.2127 |
77
+ | 0.973 | 1.0 | 2000 | 0.8654 | 0.0 | 0.0 | 0.0 | 0.0 | 12.377 |
78
+ | 0.7704 | 1.05 | 2100 | 0.8659 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4095 |
79
+ | 0.7728 | 1.1 | 2200 | 0.8607 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4428 |
80
+ | 0.7539 | 1.15 | 2300 | 0.8510 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4315 |
81
+ | 0.7358 | 1.2 | 2400 | 0.8562 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3308 |
82
+ | 0.7533 | 1.25 | 2500 | 0.8423 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4243 |
83
+ | 0.7437 | 1.3 | 2600 | 0.8412 | 0.0 | 0.0 | 0.0 | 0.0 | 12.395 |
84
+ | 0.7368 | 1.35 | 2700 | 0.8301 | 0.0 | 0.0 | 0.0 | 0.0 | 12.381 |
85
+ | 0.7089 | 1.4 | 2800 | 0.8304 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3552 |
86
+ | 0.7399 | 1.45 | 2900 | 0.8226 | 0.0 | 0.0 | 0.0 | 0.0 | 12.423 |
87
+ | 0.7027 | 1.5 | 3000 | 0.8255 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3588 |
88
+ | 0.6931 | 1.55 | 3100 | 0.8173 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4135 |
89
+ | 0.7254 | 1.6 | 3200 | 0.8141 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4155 |
90
+ | 0.7203 | 1.65 | 3300 | 0.8102 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4065 |
91
+ | 0.676 | 1.7 | 3400 | 0.8107 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3648 |
92
+ | 0.7369 | 1.75 | 3500 | 0.8021 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4313 |
93
+ | 0.6942 | 1.8 | 3600 | 0.8040 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3852 |
94
+ | 0.7023 | 1.85 | 3700 | 0.7997 | 0.0 | 0.0 | 0.0 | 0.0 | 12.4072 |
95
+ | 0.6866 | 1.9 | 3800 | 0.8003 | 0.0 | 0.0 | 0.0 | 0.0 | 12.3915 |
96
+ | 0.7067 | 1.95 | 3900 | 0.7985 | 0.0 | 0.0 | 0.0 | 0.0 | 12.398 |
97
+ | 0.7163 | 2.0 | 4000 | 0.7980 | 0.0 | 0.0 | 0.0 | 0.0 | 12.393 |
98
 
99
 
100
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd5e64fcf29664febf34ed4db70f3278a128b9993d29bb5004fef078f6a7d7c5
3
  size 1296537480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93feadb385c1bf7648add6dab12def32e064092292f239e444ed28e124225d21
3
  size 1296537480
runs/Aug17_23-00-12_e9973efb959a/events.out.tfevents.1755471646.e9973efb959a.997.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6c9960fdf91f56cc732add735427d0344f79a6b04417bfe3b81e50ddfe2549d
3
+ size 12836
runs/Aug18_01-35-55_e9973efb959a/events.out.tfevents.1755480969.e9973efb959a.40288.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a7d5c4c09078a37cdba180f94956aa6f4c468fce71ef36220067851d2167abd
3
+ size 35059
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4a678f2d2f76ee1c999dac9c37a8841cfb2e15cd25ddabc5d5a6149c3dc1f3cc
3
  size 5496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f743223aa56dceb0f5f75700c36808300e587884e244f2b24d8aeca46f483695
3
  size 5496