akkaro commited on
Commit
29aa038
·
verified ·
1 Parent(s): e75c2d4

End of training

Browse files
Files changed (1) hide show
  1. README.md +13 -3
README.md CHANGED
@@ -15,6 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
15
  # git-base-pokemon
16
 
17
  This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
 
 
 
18
 
19
  ## Model description
20
 
@@ -34,11 +37,11 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 5e-05
37
- - train_batch_size: 8
38
- - eval_batch_size: 8
39
  - seed: 42
40
  - gradient_accumulation_steps: 2
41
- - total_train_batch_size: 16
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
  - num_epochs: 5
@@ -46,6 +49,13 @@ The following hyperparameters were used during training:
46
 
47
  ### Training results
48
 
 
 
 
 
 
 
 
49
 
50
 
51
  ### Framework versions
 
15
  # git-base-pokemon
16
 
17
  This model is a fine-tuned version of [microsoft/git-base](https://huggingface.co/microsoft/git-base) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 4.4131
20
+ - Wer Score: 24.1207
21
 
22
  ## Model description
23
 
 
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 5e-05
40
+ - train_batch_size: 4
41
+ - eval_batch_size: 4
42
  - seed: 42
43
  - gradient_accumulation_steps: 2
44
+ - total_train_batch_size: 8
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
  - num_epochs: 5
 
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss | Wer Score |
53
+ |:-------------:|:------:|:----:|:---------------:|:---------:|
54
+ | 6.6954 | 0.9474 | 9 | 6.1194 | 24.2241 |
55
+ | 5.8759 | 1.8947 | 18 | 5.4065 | 24.1552 |
56
+ | 5.2401 | 2.8421 | 27 | 4.8795 | 24.1379 |
57
+ | 4.7997 | 3.7895 | 36 | 4.5462 | 24.1034 |
58
+ | 4.5467 | 4.7368 | 45 | 4.4131 | 24.1207 |
59
 
60
 
61
  ### Framework versions