tarashagarwal commited on
Commit
deee7f4
·
verified ·
1 Parent(s): 9055be0

End of training

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -39,7 +39,7 @@ The following hyperparameters were used during training:
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
42
- - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
43
  - lr_scheduler_type: linear
44
  - num_epochs: 2
45
  - mixed_precision_training: Native AMP
@@ -48,13 +48,13 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 0.0286 | 1.0 | 574 | 0.0000 |
52
  | 0.0001 | 2.0 | 1148 | 0.0000 |
53
 
54
 
55
  ### Framework versions
56
 
57
- - Transformers 4.50.3
58
- - Pytorch 2.6.0+cu124
59
- - Datasets 3.5.0
60
- - Tokenizers 0.21.1
 
39
  - train_batch_size: 8
40
  - eval_batch_size: 8
41
  - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
  - num_epochs: 2
45
  - mixed_precision_training: Native AMP
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 0.0331 | 1.0 | 574 | 0.0000 |
52
  | 0.0001 | 2.0 | 1148 | 0.0000 |
53
 
54
 
55
  ### Framework versions
56
 
57
+ - Transformers 4.44.2
58
+ - Pytorch 2.8.0+cu128
59
+ - Datasets 4.0.0
60
+ - Tokenizers 0.19.1