Hemg commited on
Commit
35f2cf9
·
verified ·
1 Parent(s): eb661f9

Model save

Browse files
README.md CHANGED
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.3936
21
- - Accuracy: 0.9092
22
 
23
  ## Model description
24
 
@@ -38,11 +38,11 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0005
41
- - train_batch_size: 32
42
- - eval_batch_size: 32
43
  - seed: 42
44
- - gradient_accumulation_steps: 4
45
- - total_train_batch_size: 128
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_ratio: 0.1
@@ -53,10 +53,10 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
56
- | 3.1138 | 1.0 | 525 | 1.0237 | 0.7924 |
57
- | 0.7639 | 2.0 | 1050 | 0.6481 | 0.85 |
58
- | 0.4929 | 3.0 | 1575 | 0.4907 | 0.8836 |
59
- | 0.3308 | 4.0 | 2100 | 0.3936 | 0.9092 |
60
 
61
 
62
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [google/vit-base-patch16-224-in21k](https://huggingface.co/google/vit-base-patch16-224-in21k) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.4665
21
+ - Accuracy: 0.9105
22
 
23
  ## Model description
24
 
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0005
41
+ - train_batch_size: 64
42
+ - eval_batch_size: 64
43
  - seed: 42
44
+ - gradient_accumulation_steps: 8
45
+ - total_train_batch_size: 512
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_ratio: 0.1
 
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
56
+ | 4.3875 | 1.0 | 131 | 2.1054 | 0.7873 |
57
+ | 1.1975 | 2.0 | 262 | 0.8185 | 0.8627 |
58
+ | 0.5774 | 2.99 | 393 | 0.5684 | 0.8918 |
59
+ | 0.4082 | 3.99 | 524 | 0.4665 | 0.9105 |
60
 
61
 
62
  ### Framework versions
runs/Mar19_10-17-58_f3b04c87f885/events.out.tfevents.1710843479.f3b04c87f885.34.3 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:09a200995f5410ae7f9682e9499bf10220076e04259121e90e198f432ad8492b
3
- size 37800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:058d70029c79b17a15ace0828d7552803e1029f84a058097dd66d5552ca96ae1
3
+ size 38154