Update model card with evaluation results from goldset from ner_disorderfinding_de_goldset
Browse files
README.md
CHANGED
|
@@ -188,6 +188,41 @@ This model is intended for:
|
|
| 188 |
- Patient privacy and data protection regulations must be followed
|
| 189 |
- The model may have biases present in the training data
|
| 190 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 191 |
## Citation
|
| 192 |
|
| 193 |
If you use this model, please cite:
|
|
|
|
| 188 |
- Patient privacy and data protection regulations must be followed
|
| 189 |
- The model may have biases present in the training data
|
| 190 |
|
| 191 |
+
|
| 192 |
+
## Model Performance
|
| 193 |
+
|
| 194 |
+
This model has been evaluated on the **goldset from ner_disorderfinding_de_goldset** using
|
| 195 |
+
IO evaluation (sklearn, token level, lenient) with the following results:
|
| 196 |
+
|
| 197 |
+
### Overall Performance
|
| 198 |
+
|
| 199 |
+
| Metric | Score |
|
| 200 |
+
|--------|-------|
|
| 201 |
+
| Precision (Macro) | 0.425502 |
|
| 202 |
+
| Recall (Macro) | 0.467986 |
|
| 203 |
+
| F1-Score (Macro) | 0.436143 |
|
| 204 |
+
| Precision (Weighted) | 0.600423 |
|
| 205 |
+
| Recall (Weighted) | 0.698688 |
|
| 206 |
+
| F1-Score (Weighted) | 0.641115 |
|
| 207 |
+
|
| 208 |
+
**Inference Performance**: 8.36 seconds for evaluation dataset
|
| 209 |
+
|
| 210 |
+
### Entity-Level Performance (IO Evaluation)
|
| 211 |
+
|
| 212 |
+
| Entity Type | Precision | Recall | F1-Score | Support |
|
| 213 |
+
|-------------|-----------|--------|----------|---------|
|
| 214 |
+
| DISORDER_FINDING | 0.097155 | 0.034930 | 0.051386 | N/A |
|
| 215 |
+
|
| 216 |
+
### Evaluation Details
|
| 217 |
+
|
| 218 |
+
- **Dataset**: goldset from ner_disorderfinding_de_goldset
|
| 219 |
+
- **Dataset Source**: goldset
|
| 220 |
+
- **Evaluation Date**: 2025-10-08 12:13:12
|
| 221 |
+
- **Language**: de
|
| 222 |
+
- **Entities**: DISORDER_FINDING
|
| 223 |
+
|
| 224 |
+
*This evaluation section is automatically generated and updated.*
|
| 225 |
+
|
| 226 |
## Citation
|
| 227 |
|
| 228 |
If you use this model, please cite:
|