Hemg commited on
Commit
090e5d4
·
verified ·
1 Parent(s): 2366083

Model save

Browse files
Files changed (2) hide show
  1. README.md +8 -7
  2. model.safetensors +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.4576
22
- - Accuracy: 0.5678
23
 
24
  ## Model description
25
 
@@ -38,7 +38,7 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 2e-05
42
  - train_batch_size: 16
43
  - eval_batch_size: 16
44
  - seed: 42
@@ -47,15 +47,16 @@ The following hyperparameters were used during training:
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
  - num_epochs: 4
 
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:------:|:----:|:---------------:|:--------:|
55
- | 8.1859 | 1.0 | 543 | 1.5953 | 0.5530 |
56
- | 6.0232 | 2.0 | 1086 | 1.4822 | 0.5670 |
57
- | 5.3585 | 3.0 | 1629 | 1.4554 | 0.5708 |
58
- | 5.0356 | 3.9931 | 2168 | 1.4576 | 0.5678 |
59
 
60
 
61
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.4255
22
+ - Accuracy: 0.5729
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 3e-05
42
  - train_batch_size: 16
43
  - eval_batch_size: 16
44
  - seed: 42
 
47
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
48
  - lr_scheduler_type: linear
49
  - num_epochs: 4
50
+ - mixed_precision_training: Native AMP
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
55
  |:-------------:|:------:|:----:|:---------------:|:--------:|
56
+ | 7.7135 | 1.0 | 543 | 1.5099 | 0.5584 |
57
+ | 5.677 | 2.0 | 1086 | 1.4271 | 0.5716 |
58
+ | 4.9715 | 3.0 | 1629 | 1.4126 | 0.5754 |
59
+ | 4.5051 | 3.9931 | 2168 | 1.4255 | 0.5729 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9832f276035dd86e31707136d4ced0c400676336e4fa4d1227d2296286e983da
3
  size 267912544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6473d30d1cf7b5305dc3b9eca56295116cc047d7da15189645feb3bddc35457f
3
  size 267912544