Hugging Face's logo

BonySmoke
/
gec_uk_seq2tag

Token Classification
Transformers
PyTorch
TensorBoard
Safetensors
roberta
Generated from Trainer
Model card Files
xet
 Metrics Community
BonySmoke commited on
Commit
94ea110
·
1 Parent(s): bf51180

Fewer tags and more accurate tags

Browse files
Files changed (5) hide show
  1. README.md +16 -11
  2. config.json +0 -0
  3. model.safetensors +2 -2
  4. runs/Dec31_10-50-22_c317a6f66c6a/events.out.tfevents.1704019822.c317a6f66c6a.169.0 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -19,11 +19,11 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [youscan/ukr-roberta-base](https://huggingface.co/youscan/ukr-roberta-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.5918
23
- - Precision: 0.5425
24
- - Recall: 0.3240
25
- - F1: 0.4057
26
- - Accuracy: 0.9379
27
 
28
  ## Model description
29
 
@@ -43,24 +43,29 @@ More information needed
43
 
44
  The following hyperparameters were used during training:
45
  - learning_rate: 2e-05
46
- - train_batch_size: 4
47
  - eval_batch_size: 4
48
  - seed: 42
 
 
49
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
50
  - lr_scheduler_type: linear
51
- - num_epochs: 2
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
56
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
57
- | 0.4017 | 1.0 | 3242 | 0.5699 | 0.5324 | 0.3205 | 0.4001 | 0.9369 |
58
- | 0.3362 | 2.0 | 6484 | 0.5918 | 0.5425 | 0.3240 | 0.4057 | 0.9379 |
 
 
 
59
 
60
 
61
  ### Framework versions
62
 
63
- - Transformers 4.36.1
64
  - Pytorch 2.1.0+cu121
65
- - Datasets 2.15.0
66
  - Tokenizers 0.15.0
 
19
 
20
  This model is a fine-tuned version of [youscan/ukr-roberta-base](https://huggingface.co/youscan/ukr-roberta-base) on the None dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.2849
23
+ - Precision: 0.5985
24
+ - Recall: 0.4289
25
+ - F1: 0.4997
26
+ - Accuracy: 0.9560
27
 
28
  ## Model description
29
 
 
43
 
44
  The following hyperparameters were used during training:
45
  - learning_rate: 2e-05
46
+ - train_batch_size: 10
47
  - eval_batch_size: 4
48
  - seed: 42
49
+ - gradient_accumulation_steps: 4
50
+ - total_train_batch_size: 40
51
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
52
  - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
58
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
59
+ | No log | 1.0 | 324 | 0.3018 | 0.5718 | 0.3530 | 0.4366 | 0.9518 |
60
+ | 0.3361 | 2.0 | 648 | 0.2757 | 0.6054 | 0.3981 | 0.4803 | 0.9554 |
61
+ | 0.3361 | 3.0 | 972 | 0.2762 | 0.5915 | 0.4281 | 0.4967 | 0.9555 |
62
+ | 0.1932 | 4.0 | 1297 | 0.2767 | 0.6009 | 0.4298 | 0.5012 | 0.9561 |
63
+ | 0.161 | 5.0 | 1620 | 0.2849 | 0.5985 | 0.4289 | 0.4997 | 0.9560 |
64
 
65
 
66
  ### Framework versions
67
 
68
+ - Transformers 4.36.2
69
  - Pytorch 2.1.0+cu121
70
+ - Datasets 2.16.1
71
  - Tokenizers 0.15.0
config.json CHANGED
The diff for this file is too large to render. See raw diff
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5706fe56f90ffc355b0db60374e3d18cb66f79cf7e94f3f265908be6bb59cb82
3
- size 517756876
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f59dbf6138bf9dc2a2bac0c6241eb5ace3e60570f3d7bfebde7c4a7714fe2f2
3
+ size 503108956
runs/Dec31_10-50-22_c317a6f66c6a/events.out.tfevents.1704019822.c317a6f66c6a.169.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a86bdc0f02c37bed12a43b0545308022112bab36ea79498d45d8a3868e195ee0
3
+ size 65444
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:878091251d5f3c074d2973a30d38699a2d82f13245936f6929be361082b6cebd
3
  size 4728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7be16e717d8f9daf051d65f597fc9380acdd59e57d992011f0f7fdc009974ba7
3
  size 4728