MoonstoneF commited on
Commit
ff36ed7
·
verified ·
1 Parent(s): baaaa65

Trained on correctly labeled 448*224 data.

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [microsoft/kosmos-2-patch14-224](https://huggingface.co/microsoft/kosmos-2-patch14-224) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.0873
19
 
20
  ## Model description
21
 
@@ -38,27 +38,23 @@ The following hyperparameters were used during training:
38
  - train_batch_size: 2
39
  - eval_batch_size: 2
40
  - seed: 42
41
- - gradient_accumulation_steps: 2
42
- - total_train_batch_size: 4
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - lr_scheduler_warmup_ratio: 0.1
46
- - training_steps: 1000
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
- | 0.1715 | 0.0160 | 100 | 0.1546 |
53
- | 0.1624 | 0.0319 | 200 | 0.1357 |
54
- | 0.1415 | 0.0479 | 300 | 0.1256 |
55
- | 0.1295 | 0.0638 | 400 | 0.1157 |
56
- | 0.1226 | 0.0798 | 500 | 0.1068 |
57
- | 0.1119 | 0.0957 | 600 | 0.1007 |
58
- | 0.1067 | 0.1117 | 700 | 0.0980 |
59
- | 0.1032 | 0.1276 | 800 | 0.0914 |
60
- | 0.099 | 0.1436 | 900 | 0.0882 |
61
- | 0.0965 | 0.1596 | 1000 | 0.0873 |
62
 
63
 
64
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [microsoft/kosmos-2-patch14-224](https://huggingface.co/microsoft/kosmos-2-patch14-224) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.0708
19
 
20
  ## Model description
21
 
 
38
  - train_batch_size: 2
39
  - eval_batch_size: 2
40
  - seed: 42
41
+ - gradient_accumulation_steps: 4
42
+ - total_train_batch_size: 8
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - lr_scheduler_warmup_ratio: 0.1
46
+ - training_steps: 1200
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss |
51
  |:-------------:|:------:|:----:|:---------------:|
52
+ | No log | 0.0558 | 200 | 0.1314 |
53
+ | 1.0995 | 0.1117 | 400 | 0.1034 |
54
+ | 0.1154 | 0.1675 | 600 | 0.0912 |
55
+ | 0.097 | 0.2234 | 800 | 0.0785 |
56
+ | 0.0849 | 0.2792 | 1000 | 0.0728 |
57
+ | 0.0849 | 0.3351 | 1200 | 0.0708 |
 
 
 
 
58
 
59
 
60
  ### Framework versions
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4932181b0cce09fc255d8412690b1771822e380f2167945124aaa57312ff3070
3
  size 4999738624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f52463b357ccd7b0855caf74ceed0b625099f929e62896a087a59db8b01b823
3
  size 4999738624
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:20e10a9551a9a505a2df622decc92c2f6c23328adda1c64ad6c5cd92fd033f6c
3
  size 1658313704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cf86183b70a488d46fe8915b128fe662dce93d9f74f26110f5a5e6a165f37cf
3
  size 1658313704