kkboy1 commited on
Commit
ac858c8
·
1 Parent(s): 2c922b3

Model save

Browse files
README.md CHANGED
@@ -31,17 +31,16 @@ More information needed
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
34
- - learning_rate: 0.0002
35
- - train_batch_size: 1
36
  - eval_batch_size: 8
37
  - seed: 42
38
  - gradient_accumulation_steps: 4
39
- - total_train_batch_size: 4
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
- - lr_scheduler_type: cosine
42
- - lr_scheduler_warmup_ratio: 0.05
43
- - lr_scheduler_warmup_steps: 2
44
- - num_epochs: 3.0
45
  - mixed_precision_training: Native AMP
46
 
47
  ### Training results
@@ -50,7 +49,7 @@ The following hyperparameters were used during training:
50
 
51
  ### Framework versions
52
 
53
- - Transformers 4.35.0
54
  - Pytorch 2.1.0+cu118
55
- - Datasets 2.14.6
56
- - Tokenizers 0.14.1
 
31
  ### Training hyperparameters
32
 
33
  The following hyperparameters were used during training:
34
+ - learning_rate: 5e-07
35
+ - train_batch_size: 2
36
  - eval_batch_size: 8
37
  - seed: 42
38
  - gradient_accumulation_steps: 4
39
+ - total_train_batch_size: 8
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
+ - lr_scheduler_type: linear
42
+ - lr_scheduler_warmup_ratio: 0.1
43
+ - num_epochs: 2.0
 
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
 
49
 
50
  ### Framework versions
51
 
52
+ - Transformers 4.35.2
53
  - Pytorch 2.1.0+cu118
54
+ - Datasets 2.15.0
55
+ - Tokenizers 0.15.0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:009e90f420dbec580b2dad89769b9639a09032d2549f3c6fd611e67612d528ce
3
  size 170142632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b26d332054db0e9ee943a6e591f04e9611f2bfe186eb9fbf6990a5985f529d4
3
  size 170142632
runs/Nov29_06-14-31_e7845c1b9cd0/events.out.tfevents.1701238472.e7845c1b9cd0.1902.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a520a4479328cf8d295d82392b6034586ae4e1761d67e44c942a1a2382cc382
3
- size 5448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ee264620841e2b704893520b6f7ed7ddbc0d44b0fde82fcb7faab24d2b6687c
3
+ size 5802