Hugging Face's logo

morten-j
/
fine_tuned_mBERT_old

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
morten-j commited on
Commit
28f7e21
·
verified ·
1 Parent(s): f626c8d

mehdie/fine_tuned_mBERT

Browse files
Files changed (6) hide show
  1. README.md +16 -16
  2. model.safetensors +1 -1
  3. runs/Mar25_09-34-10_yoga/events.out.tfevents.1711355651.yoga.3477.0 +3 -0
  4. runs/Mar25_09-35-14_yoga/events.out.tfevents.1711355715.yoga.3575.0 +3 -0
  5. runs/Mar25_09-35-14_yoga/events.out.tfevents.1711355766.yoga.3575.1 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [google-bert/bert-base-multilingual-cased](https://huggingface.co/google-bert/bert-base-multilingual-cased) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.6623
24
- - F1: 0.0
25
- - Precision: 0.0
26
- - Recall: 0.0
27
- - Accuracy: 0.6379
28
 
29
  ## Model description
30
 
@@ -43,7 +43,7 @@ More information needed
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
- - learning_rate: 0.005
47
  - train_batch_size: 32
48
  - eval_batch_size: 32
49
  - seed: 42
@@ -56,16 +56,16 @@ The following hyperparameters were used during training:
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | F1 | Precision | Recall | Accuracy |
58
  |:-------------:|:-----:|:----:|:---------------:|:------:|:---------:|:------:|:--------:|
59
- | No log | 1.0 | 15 | 0.6791 | 0.0 | 0.0 | 0.0 | 0.7069 |
60
- | No log | 2.0 | 30 | 0.6996 | 0.4533 | 0.2931 | 1.0 | 0.2931 |
61
- | No log | 3.0 | 45 | 0.7002 | 0.0 | 0.0 | 0.0 | 0.7069 |
62
- | No log | 4.0 | 60 | 0.6243 | 0.0 | 0.0 | 0.0 | 0.7069 |
63
- | No log | 5.0 | 75 | 0.6051 | 0.0 | 0.0 | 0.0 | 0.7069 |
64
- | No log | 6.0 | 90 | 0.6192 | 0.0 | 0.0 | 0.0 | 0.7069 |
65
- | No log | 7.0 | 105 | 0.7878 | 0.4533 | 0.2931 | 1.0 | 0.2931 |
66
- | No log | 8.0 | 120 | 0.6057 | 0.0 | 0.0 | 0.0 | 0.7069 |
67
- | No log | 9.0 | 135 | 0.6365 | 0.0 | 0.0 | 0.0 | 0.7069 |
68
- | No log | 10.0 | 150 | 0.6143 | 0.0 | 0.0 | 0.0 | 0.7069 |
69
 
70
 
71
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [google-bert/bert-base-multilingual-cased](https://huggingface.co/google-bert/bert-base-multilingual-cased) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.3681
24
+ - F1: 0.7857
25
+ - Precision: 0.8462
26
+ - Recall: 0.7333
27
+ - Accuracy: 0.8966
28
 
29
  ## Model description
30
 
 
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
+ - learning_rate: 5e-05
47
  - train_batch_size: 32
48
  - eval_batch_size: 32
49
  - seed: 42
 
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | F1 | Precision | Recall | Accuracy |
58
  |:-------------:|:-----:|:----:|:---------------:|:------:|:---------:|:------:|:--------:|
59
+ | No log | 1.0 | 15 | 0.4987 | 0.6875 | 0.6471 | 0.7333 | 0.8276 |
60
+ | No log | 2.0 | 30 | 0.4779 | 0.625 | 0.5882 | 0.6667 | 0.7931 |
61
+ | No log | 3.0 | 45 | 0.4019 | 0.5833 | 0.7778 | 0.4667 | 0.8276 |
62
+ | No log | 4.0 | 60 | 0.6146 | 0.6522 | 0.4839 | 1.0 | 0.7241 |
63
+ | No log | 5.0 | 75 | 0.3311 | 0.7143 | 0.7692 | 0.6667 | 0.8621 |
64
+ | No log | 6.0 | 90 | 0.3877 | 0.7568 | 0.6364 | 0.9333 | 0.8448 |
65
+ | No log | 7.0 | 105 | 0.3971 | 0.7778 | 0.6667 | 0.9333 | 0.8621 |
66
+ | No log | 8.0 | 120 | 0.2041 | 0.8966 | 0.9286 | 0.8667 | 0.9483 |
67
+ | No log | 9.0 | 135 | 0.2831 | 0.875 | 0.8235 | 0.9333 | 0.9310 |
68
+ | No log | 10.0 | 150 | 0.2868 | 0.875 | 0.8235 | 0.9333 | 0.9310 |
69
 
70
 
71
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:832c807965b343ebedf519469e4d38e5c46faf72b1f7321c53e7bc9187fd9897
3
  size 711443456
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2a1acbf250f1176dcdd07814f3f8e55297e6b5ce3c9cf72b073e8b25d1ebcc9
3
  size 711443456
runs/Mar25_09-34-10_yoga/events.out.tfevents.1711355651.yoga.3477.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50c456121485f540738814d8efeb2aca5fbc811a2dfde0e4cf43658473149f83
3
+ size 4838
runs/Mar25_09-35-14_yoga/events.out.tfevents.1711355715.yoga.3575.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8961449abd3dbc59b6a8e18f648d121ead45ec9ab3f05731733b20717b0663cf
3
+ size 9840
runs/Mar25_09-35-14_yoga/events.out.tfevents.1711355766.yoga.3575.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ca5323fe031f4cc2b1dc970fd6757af5f646618e8e14daaac8a95b9dd5ea057
3
+ size 560
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38df59e4cc1fa962ce724e6e735a226595b4beadd950f86b7952775a274252a1
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9da1634f1d718d669472e54aadc27d475b2bf1e2b0590a827868a24eb1026160
3
  size 4920