edloginovad commited on
Commit
09739aa
·
verified ·
1 Parent(s): 6abc4c8

Model save

Browse files
Files changed (1) hide show
  1. README.md +1 -50
README.md CHANGED
@@ -1,13 +1,9 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - multilingual
5
  license: other
6
  base_model: DedalusHealthCare/tinybert-mlm-de
7
  tags:
8
  - generated_from_trainer
9
- datasets:
10
- - ner_demo_de
11
  model-index:
12
  - name: tinybert-demo-de
13
  results: []
@@ -18,17 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  # tinybert-demo-de
20
 
21
- This model is a fine-tuned version of [DedalusHealthCare/tinybert-mlm-de](https://huggingface.co/DedalusHealthCare/tinybert-mlm-de) on the ner_demo_de dataset.
22
- It achieves the following results on the evaluation set:
23
- - Loss: 0.4071
24
- - Disorder Finding Precision: 0.25
25
- - Disorder Finding Recall: 0.1818
26
- - Disorder Finding F1: 0.2105
27
- - Disorder Finding Number: 11
28
- - Overall Precision: 0.25
29
- - Overall Recall: 0.1818
30
- - Overall F1: 0.2105
31
- - Overall Accuracy: 0.9286
32
 
33
  ## Model description
34
 
@@ -68,38 +54,3 @@ The following hyperparameters were used during training:
68
  - Pytorch 2.6.0+cu124
69
  - Datasets 2.16.0
70
  - Tokenizers 0.20.3
71
-
72
-
73
- ## Model Performance
74
-
75
- This model has been evaluated on the **goldset from ner_disorderfinding_de_goldset** using
76
- IO evaluation (sklearn, token level, lenient) with the following results:
77
-
78
- ### Overall Performance
79
-
80
- | Metric | Score |
81
- |--------|-------|
82
- | Precision (Macro) | 0.425082 |
83
- | Recall (Macro) | 0.467785 |
84
- | F1-Score (Macro) | 0.435900 |
85
- | Precision (Weighted) | 0.600185 |
86
- | Recall (Weighted) | 0.698514 |
87
- | F1-Score (Weighted) | 0.640943 |
88
-
89
- **Inference Performance**: 4.91 seconds for evaluation dataset
90
-
91
- ### Entity-Level Performance (IO Evaluation)
92
-
93
- | Entity Type | Precision | Recall | F1-Score | Support |
94
- |-------------|-----------|--------|----------|---------|
95
- | DISORDER_FINDING | 0.753771 | 0.900890 | 0.820790 | N/A |
96
-
97
- ### Evaluation Details
98
-
99
- - **Dataset**: goldset from ner_disorderfinding_de_goldset
100
- - **Dataset Source**: goldset
101
- - **Evaluation Date**: 2025-10-08 11:37:22
102
- - **Language**: de
103
- - **Entities**: DISORDER_FINDING
104
-
105
- *This evaluation section is automatically generated and updated.*
 
1
  ---
2
  library_name: transformers
 
 
3
  license: other
4
  base_model: DedalusHealthCare/tinybert-mlm-de
5
  tags:
6
  - generated_from_trainer
 
 
7
  model-index:
8
  - name: tinybert-demo-de
9
  results: []
 
14
 
15
  # tinybert-demo-de
16
 
17
+ This model is a fine-tuned version of [DedalusHealthCare/tinybert-mlm-de](https://huggingface.co/DedalusHealthCare/tinybert-mlm-de) on the None dataset.
 
 
 
 
 
 
 
 
 
 
18
 
19
  ## Model description
20
 
 
54
  - Pytorch 2.6.0+cu124
55
  - Datasets 2.16.0
56
  - Tokenizers 0.20.3