Noor0 commited on
Commit
e1c88da
·
1 Parent(s): 6b90a3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -14
README.md CHANGED
@@ -15,7 +15,8 @@ This model was trained from scratch on an unknown dataset.
15
 
16
  ## Model description
17
 
18
- More information needed
 
19
 
20
  ## Intended uses & limitations
21
 
@@ -27,20 +28,23 @@ More information needed
27
 
28
  ## Training procedure
29
 
 
 
 
 
 
 
30
  ### Training hyperparameters
31
 
32
  The following hyperparameters were used during training:
33
- - learning_rate: 5e-05
34
- - train_batch_size: 8
35
- - eval_batch_size: 8
36
- - seed: 42
37
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
38
- - lr_scheduler_type: linear
39
- - num_epochs: 3.0
40
-
 
 
41
  ### Framework versions
42
-
43
- - Transformers 4.36.0
44
- - Pytorch 2.1.0+cu118
45
- - Datasets 2.11.0
46
- - Tokenizers 0.15.0
 
15
 
16
  ## Model description
17
 
18
+ 0.502831
19
+ 0.798512
20
 
21
  ## Intended uses & limitations
22
 
 
28
 
29
  ## Training procedure
30
 
31
+ Epoch Training Loss Validation Loss Accuracy
32
+ 2 0.451100 0.502831 0.798512
33
+ 3 0.365500 0.576118 0.795456
34
+ 4 0.301900 0.625391 0.798512
35
+ 5 0.246600 0.835689 0.797963
36
+
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ metric_for_best_model='accuracy',
41
+ learning_rate=2e-5,
42
+ num_train_epochs=20,
43
+ weight_decay=0.01,
44
+ per_device_train_batch_size=16, # batch size per device during training
45
+ per_device_eval_batch_size=16, # batch size for evaluation
46
+ evaluation_strategy="epoch",
47
+ save_strategy="epoch",
48
+ save_total_limit = 2,
49
+ load_best_model_at_end=True)
50
  ### Framework versions