maud-dr commited on
Commit
ece0d51
·
verified ·
1 Parent(s): f2a8640

End of training

Browse files
Files changed (3) hide show
  1. README.md +24 -12
  2. model.safetensors +1 -1
  3. tokenizer.json +1 -8
README.md CHANGED
@@ -20,10 +20,10 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: nan
24
- - Precision: 0.0
25
- - Recall: 0.0
26
- - F1: 0.0
27
 
28
  ## Model description
29
 
@@ -43,20 +43,32 @@ More information needed
43
 
44
  The following hyperparameters were used during training:
45
  - learning_rate: 0.0003
46
- - train_batch_size: 16
47
- - eval_batch_size: 16
48
  - seed: 42
49
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
51
- - num_epochs: 2
52
- - mixed_precision_training: Native AMP
53
 
54
  ### Training results
55
 
56
- | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 |
57
- |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:---:|
58
- | 0.0 | 1.0 | 224 | nan | 0.0 | 0.0 | 0.0 |
59
- | 0.0 | 2.0 | 448 | nan | 0.0 | 0.0 | 0.0 |
 
 
 
 
 
 
 
 
 
 
 
 
 
60
 
61
 
62
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 3.8181
24
+ - Precision: 0.5895
25
+ - Recall: 0.6920
26
+ - F1: 0.6367
27
 
28
  ## Model description
29
 
 
43
 
44
  The following hyperparameters were used during training:
45
  - learning_rate: 0.0003
46
+ - train_batch_size: 8
47
+ - eval_batch_size: 8
48
  - seed: 42
49
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
51
+ - num_epochs: 15
 
52
 
53
  ### Training results
54
 
55
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 |
56
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|
57
+ | 0.6793 | 1.0 | 447 | 0.6713 | 0.5639 | 0.7355 | 0.6384 |
58
+ | 0.6342 | 2.0 | 894 | 0.6474 | 0.5714 | 0.7971 | 0.6657 |
59
+ | 0.5915 | 3.0 | 1341 | 0.7200 | 0.5845 | 0.7391 | 0.6528 |
60
+ | 0.551 | 4.0 | 1788 | 0.7096 | 0.5890 | 0.8152 | 0.6839 |
61
+ | 0.4821 | 5.0 | 2235 | 0.8309 | 0.5695 | 0.7717 | 0.6554 |
62
+ | 0.4188 | 6.0 | 2682 | 0.8327 | 0.6174 | 0.6957 | 0.6542 |
63
+ | 0.3621 | 7.0 | 3129 | 1.1130 | 0.5914 | 0.5978 | 0.5946 |
64
+ | 0.3069 | 8.0 | 3576 | 1.4566 | 0.5828 | 0.6884 | 0.6312 |
65
+ | 0.2551 | 9.0 | 4023 | 1.8830 | 0.5848 | 0.6993 | 0.6370 |
66
+ | 0.2014 | 10.0 | 4470 | 2.3017 | 0.5855 | 0.6449 | 0.6138 |
67
+ | 0.1637 | 11.0 | 4917 | 2.6628 | 0.5796 | 0.6993 | 0.6338 |
68
+ | 0.1029 | 12.0 | 5364 | 3.0285 | 0.5852 | 0.6594 | 0.6201 |
69
+ | 0.124 | 13.0 | 5811 | 3.3504 | 0.6055 | 0.6341 | 0.6195 |
70
+ | 0.0737 | 14.0 | 6258 | 3.6600 | 0.6013 | 0.6667 | 0.6323 |
71
+ | 0.0508 | 15.0 | 6705 | 3.8181 | 0.5895 | 0.6920 | 0.6367 |
72
 
73
 
74
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9c84aab1cfc3a8f46af5178dd8131f1748a08abea3df334b8c9b081533d50ff3
3
  size 894020048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0164c81fa40de7d8c838351f6f8e3e30d0b0e02c11b3938d517436615c976226
3
  size 894020048
tokenizer.json CHANGED
@@ -6,14 +6,7 @@
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
- "padding": {
10
- "strategy": "BatchLongest",
11
- "direction": "Right",
12
- "pad_to_multiple_of": null,
13
- "pad_id": 0,
14
- "pad_type_id": 0,
15
- "pad_token": "<pad>"
16
- },
17
  "added_tokens": [
18
  {
19
  "id": 0,
 
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
+ "padding": null,
 
 
 
 
 
 
 
10
  "added_tokens": [
11
  {
12
  "id": 0,