Hugging Face's logo

Monda
/
questions

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
Community
Monda commited on
Commit
0568c2a
·
verified ·
1 Parent(s): f8f22c6

Monda/marbert-AraHealthQA-t1s1

Browse files
Files changed (3) hide show
  1. README.md +12 -12
  2. eval_metrics.json +7 -7
  3. model.safetensors +1 -1
README.md CHANGED
@@ -15,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [UBC-NLP/MARBERT](https://huggingface.co/UBC-NLP/MARBERT) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.3773
19
- - Micro F1: 0.6604
20
- - Weighted F1: 0.5871
21
- - Jaccard: 0.5857
22
 
23
  ## Model description
24
 
@@ -49,16 +49,16 @@ The following hyperparameters were used during training:
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Micro F1 | Weighted F1 | Jaccard |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----------:|:-------:|
52
- | 0.5348 | 1.0 | 18 | 0.4242 | 0.6375 | 0.5254 | 0.5017 |
53
- | 0.4411 | 2.0 | 36 | 0.3905 | 0.6575 | 0.5532 | 0.5821 |
54
- | 0.4151 | 3.0 | 54 | 0.3773 | 0.6604 | 0.5871 | 0.5857 |
55
- | 0.3852 | 4.0 | 72 | 0.3773 | 0.6176 | 0.5684 | 0.5476 |
56
- | 0.3691 | 5.0 | 90 | 0.3732 | 0.6244 | 0.5701 | 0.5524 |
57
 
58
 
59
  ### Framework versions
60
 
61
- - Transformers 4.52.4
62
  - Pytorch 2.6.0+cu124
63
- - Datasets 2.14.4
64
- - Tokenizers 0.21.1
 
15
 
16
  This model is a fine-tuned version of [UBC-NLP/MARBERT](https://huggingface.co/UBC-NLP/MARBERT) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.3756
19
+ - Micro F1: 0.6542
20
+ - Weighted F1: 0.5875
21
+ - Jaccard: 0.5726
22
 
23
  ## Model description
24
 
 
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Micro F1 | Weighted F1 | Jaccard |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:-----------:|:-------:|
52
+ | 0.5395 | 1.0 | 18 | 0.4255 | 0.6375 | 0.5254 | 0.5017 |
53
+ | 0.4424 | 2.0 | 36 | 0.3918 | 0.6607 | 0.5539 | 0.5743 |
54
+ | 0.4146 | 3.0 | 54 | 0.3756 | 0.6542 | 0.5875 | 0.5726 |
55
+ | 0.3844 | 4.0 | 72 | 0.3776 | 0.6197 | 0.5665 | 0.5298 |
56
+ | 0.3647 | 5.0 | 90 | 0.3738 | 0.6161 | 0.5609 | 0.5286 |
57
 
58
 
59
  ### Framework versions
60
 
61
+ - Transformers 4.53.3
62
  - Pytorch 2.6.0+cu124
63
+ - Datasets 4.0.0
64
+ - Tokenizers 0.21.2
eval_metrics.json CHANGED
@@ -1,10 +1,10 @@
1
  {
2
- "eval_loss": 0.3773249089717865,
3
- "eval_micro_f1": 0.660377358490566,
4
- "eval_weighted_f1": 0.587091304787934,
5
- "eval_jaccard": 0.5857142857142856,
6
- "eval_runtime": 0.1821,
7
- "eval_samples_per_second": 384.432,
8
- "eval_steps_per_second": 16.476,
9
  "epoch": 5.0
10
  }
 
1
  {
2
+ "eval_loss": 0.3756382167339325,
3
+ "eval_micro_f1": 0.6542056074766355,
4
+ "eval_weighted_f1": 0.5874650856075003,
5
+ "eval_jaccard": 0.5726190476190476,
6
+ "eval_runtime": 0.1825,
7
+ "eval_samples_per_second": 383.472,
8
+ "eval_steps_per_second": 16.435,
9
  "epoch": 5.0
10
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:87d1bc32fd8cac449227a4186c72f915de26d3b25a0ada7d7f9c957e1d262207
3
  size 651410452
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4542022afe90a86c067a481acf4087ec013d7ece1b069bf56d8d60148384ad3d
3
  size 651410452