kkboy1 commited on
Commit
521bfa8
·
1 Parent(s): 6eedfd8

Model save

Browse files
README.md CHANGED
@@ -38,10 +38,11 @@ The following hyperparameters were used during training:
38
  - gradient_accumulation_steps: 4
39
  - total_train_batch_size: 4
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
- - lr_scheduler_type: constant
42
  - lr_scheduler_warmup_ratio: 0.05
43
  - lr_scheduler_warmup_steps: 2
44
  - num_epochs: 2.0
 
45
 
46
  ### Training results
47
 
@@ -49,7 +50,7 @@ The following hyperparameters were used during training:
49
 
50
  ### Framework versions
51
 
52
- - Transformers 4.34.1
53
  - Pytorch 2.1.0+cu118
54
  - Datasets 2.14.6
55
  - Tokenizers 0.14.1
 
38
  - gradient_accumulation_steps: 4
39
  - total_train_batch_size: 4
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
+ - lr_scheduler_type: cosine
42
  - lr_scheduler_warmup_ratio: 0.05
43
  - lr_scheduler_warmup_steps: 2
44
  - num_epochs: 2.0
45
+ - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
 
50
 
51
  ### Framework versions
52
 
53
+ - Transformers 4.35.0
54
  - Pytorch 2.1.0+cu118
55
  - Datasets 2.14.6
56
  - Tokenizers 0.14.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e0eaf587bfb84298ae56f6bbbdb9cfdb68bbb42278a32e756ae85a6f35268c91
3
  size 170142632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b57a7c58e027a7a7989ddc8afe27536a432481f80618a3e6943ca083c3f3de73
3
  size 170142632
runs/Nov07_04-15-54_d180f3562c9b/events.out.tfevents.1699330555.d180f3562c9b.1083.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bca74f6263e9da492cbe4a4acebd478cde0241969f0dbda9a3a55c12b86a5d0d
3
- size 12499
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68a4440da46f233deb839fd69ecb52007d42abacd15fcd69cf84047d23880a4e
3
+ size 13481