Hugging Face's logo

TomasFAV
/
LiLTInvoiceCzechV0

Token Classification
Transformers
TensorBoard
Safetensors
lilt
Generated from Trainer
invoice-processing
information-extraction
czech-language
document-ai
layout-aware-model
synthetic-data
Model card Files
xet
 Metrics Community
TomasFAV commited on
Commit
3e39b4b
·
verified ·
1 Parent(s): e61f454

Model save

Browse files
Files changed (3) hide show
  1. README.md +17 -17
  2. model.safetensors +1 -1
  3. runs/Mar08_22-25-11_7e44ac7b5aa4/events.out.tfevents.1773009546.7e44ac7b5aa4.432.1 +3 -0
README.md CHANGED
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on an unknown dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.1580
25
- - Precision: 0.4632
26
- - Recall: 0.7243
27
- - F1: 0.5650
28
- - Accuracy: 0.9631
29
 
30
  ## Model description
31
 
@@ -44,8 +44,8 @@ More information needed
44
  ### Training hyperparameters
45
 
46
  The following hyperparameters were used during training:
47
- - learning_rate: 1e-05
48
- - train_batch_size: 8
49
  - eval_batch_size: 2
50
  - seed: 42
51
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
@@ -58,16 +58,16 @@ The following hyperparameters were used during training:
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
61
- | No log | 1.0 | 150 | 0.1841 | 0.2174 | 0.2572 | 0.2356 | 0.9522 |
62
- | No log | 2.0 | 300 | 0.1209 | 0.4441 | 0.5391 | 0.4870 | 0.9671 |
63
- | No log | 3.0 | 450 | 0.1384 | 0.4197 | 0.6564 | 0.5120 | 0.9616 |
64
- | 0.3880 | 4.0 | 600 | 0.1374 | 0.4705 | 0.6893 | 0.5593 | 0.9654 |
65
- | 0.3880 | 5.0 | 750 | 0.1600 | 0.4423 | 0.7099 | 0.5450 | 0.9599 |
66
- | 0.3880 | 6.0 | 900 | 0.1579 | 0.4612 | 0.7222 | 0.5630 | 0.9629 |
67
- | 0.0242 | 7.0 | 1050 | 0.1597 | 0.4446 | 0.6852 | 0.5393 | 0.9626 |
68
- | 0.0242 | 8.0 | 1200 | 0.1556 | 0.4620 | 0.6996 | 0.5565 | 0.9641 |
69
- | 0.0242 | 9.0 | 1350 | 0.1603 | 0.4582 | 0.6996 | 0.5537 | 0.9635 |
70
- | 0.0146 | 10.0 | 1500 | 0.1600 | 0.4608 | 0.7016 | 0.5563 | 0.9638 |
71
 
72
 
73
  ### Framework versions
 
21
 
22
  This model is a fine-tuned version of [SCUT-DLVCLab/lilt-roberta-en-base](https://huggingface.co/SCUT-DLVCLab/lilt-roberta-en-base) on an unknown dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 0.1929
25
+ - Precision: 0.6036
26
+ - Recall: 0.7355
27
+ - F1: 0.6631
28
+ - Accuracy: 0.9645
29
 
30
  ## Model description
31
 
 
44
  ### Training hyperparameters
45
 
46
  The following hyperparameters were used during training:
47
+ - learning_rate: 3e-05
48
+ - train_batch_size: 16
49
  - eval_batch_size: 2
50
  - seed: 42
51
  - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
60
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
61
+ | No log | 1.0 | 75 | 0.2174 | 0.2653 | 0.3038 | 0.2832 | 0.9430 |
62
+ | No log | 2.0 | 150 | 0.1504 | 0.5052 | 0.5751 | 0.5379 | 0.9642 |
63
+ | No log | 3.0 | 225 | 0.1508 | 0.5626 | 0.6365 | 0.5973 | 0.9650 |
64
+ | No log | 4.0 | 300 | 0.1742 | 0.5192 | 0.6689 | 0.5846 | 0.9593 |
65
+ | No log | 5.0 | 375 | 0.1863 | 0.5153 | 0.6877 | 0.5892 | 0.9579 |
66
+ | No log | 6.0 | 450 | 0.1878 | 0.5557 | 0.7065 | 0.6221 | 0.9605 |
67
+ | 0.1991 | 7.0 | 525 | 0.2189 | 0.5435 | 0.7253 | 0.6213 | 0.9578 |
68
+ | 0.1991 | 8.0 | 600 | 0.1927 | 0.6036 | 0.7355 | 0.6631 | 0.9645 |
69
+ | 0.1991 | 9.0 | 675 | 0.2133 | 0.5357 | 0.7167 | 0.6131 | 0.9583 |
70
+ | 0.1991 | 10.0 | 750 | 0.2198 | 0.5235 | 0.7235 | 0.6074 | 0.9569 |
71
 
72
 
73
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce23e74fa13ad61f6cf032ef426a3f46bf9cc6a145e41d79b783b6c38e0448f3
3
  size 520801340
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2c915e18132ee03c0755b659530a5b6ee28f1fd77ed7cf9a359863322315f6c
3
  size 520801340
runs/Mar08_22-25-11_7e44ac7b5aa4/events.out.tfevents.1773009546.7e44ac7b5aa4.432.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e067a8d2e7ebf5a142b1848f53bcdf3b5be27e5678bd302ac7a95ac2c4e6c5c
3
+ size 560