Noorrabie commited on
Commit
e04fefe
·
verified ·
1 Parent(s): e3a1431

Model save

Browse files
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: aubmindlab/bert-base-arabertv02
3
+ tags:
4
+ - generated_from_trainer
5
+ metrics:
6
+ - accuracy
7
+ model-index:
8
+ - name: 11levels_26977
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # 11levels_26977
16
+
17
+ This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co/aubmindlab/bert-base-arabertv02) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.2826
20
+ - Macro F1: 0.5615
21
+ - Macro Precision: 0.5598
22
+ - Macro Recall: 0.5707
23
+ - Accuracy: 0.6702
24
+
25
+ ## Model description
26
+
27
+ More information needed
28
+
29
+ ## Intended uses & limitations
30
+
31
+ More information needed
32
+
33
+ ## Training and evaluation data
34
+
35
+ More information needed
36
+
37
+ ## Training procedure
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 5e-05
43
+ - train_batch_size: 64
44
+ - eval_batch_size: 16
45
+ - seed: 42
46
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
+ - lr_scheduler_type: linear
48
+ - num_epochs: 6
49
+
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Macro Precision | Macro Recall | Accuracy |
53
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------------:|:------------:|:--------:|
54
+ | No log | 1.0 | 422 | 1.0239 | 0.5139 | 0.5318 | 0.5450 | 0.6583 |
55
+ | 1.2083 | 2.0 | 844 | 0.9638 | 0.5598 | 0.5557 | 0.5921 | 0.6787 |
56
+ | 0.8027 | 3.0 | 1266 | 0.9719 | 0.5608 | 0.5761 | 0.5539 | 0.6833 |
57
+ | 0.5643 | 4.0 | 1688 | 1.1153 | 0.5600 | 0.5591 | 0.5718 | 0.6714 |
58
+ | 0.3806 | 5.0 | 2110 | 1.2091 | 0.5698 | 0.5705 | 0.5789 | 0.6712 |
59
+ | 0.2509 | 6.0 | 2532 | 1.2826 | 0.5615 | 0.5598 | 0.5707 | 0.6702 |
60
+
61
+
62
+ ### Framework versions
63
+
64
+ - Transformers 4.43.4
65
+ - Pytorch 2.6.0+cu124
66
+ - Datasets 3.4.1
67
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4ef1be6329e8b42ffb23569346a57fb51b451d01937a363489b7ff25d12908f
3
  size 540855364
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:153242e6356aa6ec0e3c22c9f384af8839b4afb6679fef04a0d1b5ce64fba2fa
3
  size 540855364
runs/Mar22_13-35-53_2f827bf749da/events.out.tfevents.1742650564.2f827bf749da.20742.4 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3191ecec664cdcca4c3d4643f2ff3b554f95317745ee84623a71acfed150a884
3
- size 9315
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ad41bc6aa0fc8adb093e6619712374d11384152157d9995a1c1a3c8c95cebf1
3
+ size 10159