Update README.md
Browse files
README.md
CHANGED
|
@@ -42,7 +42,7 @@ A fine-tuned DeBERTa-v3 model for classifying marine incident types based on acc
|
|
| 42 |
|
| 43 |
This model is a fine-tuned version of `microsoft/deberta-v3-base` specifically designed to classify marine incidents into 11 different categories. It was trained on the MAIB incident reports dataset and achieves high performance in maritime safety incident classification.
|
| 44 |
|
| 45 |
-
- **Developed by**:
|
| 46 |
- **Model type**: Text Classification
|
| 47 |
- **Language(s)**: English
|
| 48 |
- **License**: Apache 2.0
|
|
@@ -58,21 +58,16 @@ The model achieves the following performance metrics on the test set:
|
|
| 58 |
| **Weighted F1-Score** | 89.0% |
|
| 59 |
| **Macro F1-Score** | 70.2% |
|
| 60 |
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
| Flooding / Foundering | 1.00 | 0.83 | 0.91 | 12 |
|
| 72 |
-
| Grounding / Stranding | 0.90 | 0.90 | 0.90 | 31 |
|
| 73 |
-
| Hull Failure | 0.00 | 0.00 | 0.00 | 0 |
|
| 74 |
-
| Loss Of Control | 0.83 | 0.90 | 0.86 | 42 |
|
| 75 |
-
| Non-accidental Event | 0.00 | 0.00 | 0.00 | 0 |
|
| 76 |
|
| 77 |
## Intended Use
|
| 78 |
|
|
@@ -200,17 +195,6 @@ The model classifies incidents into the following 11 categories:
|
|
| 200 |
9. **Loss Of Control** - Loss of steering or propulsion control
|
| 201 |
10. **Non-accidental Event** - Events not classified as accidents
|
| 202 |
|
| 203 |
-
## Evaluation Results
|
| 204 |
-
|
| 205 |
-
The model evaluation includes comprehensive visualizations:
|
| 206 |
-
|
| 207 |
-
- **Confusion Matrix**: Shows classification accuracy across all incident types
|
| 208 |
-
- **Per-Class F1 Scores**: Displays F1 performance for each incident category
|
| 209 |
-
|
| 210 |
-

|
| 211 |
-
|
| 212 |
-

|
| 213 |
-
|
| 214 |
## Limitations and Bias
|
| 215 |
|
| 216 |
### Known Limitations
|
|
@@ -231,7 +215,7 @@ The model evaluation includes comprehensive visualizations:
|
|
| 231 |
```bibtex
|
| 232 |
@software{maib_classifier,
|
| 233 |
title={MAIB Incident Type Classifier},
|
| 234 |
-
author={
|
| 235 |
year={2024},
|
| 236 |
url={https://huggingface.co/your-username/maib-incident-classifier}
|
| 237 |
}
|
|
|
|
| 42 |
|
| 43 |
This model is a fine-tuned version of `microsoft/deberta-v3-base` specifically designed to classify marine incidents into 11 different categories. It was trained on the MAIB incident reports dataset and achieves high performance in maritime safety incident classification.
|
| 44 |
|
| 45 |
+
- **Developed by**: Ilia Munaev
|
| 46 |
- **Model type**: Text Classification
|
| 47 |
- **Language(s)**: English
|
| 48 |
- **License**: Apache 2.0
|
|
|
|
| 58 |
| **Weighted F1-Score** | 89.0% |
|
| 59 |
| **Macro F1-Score** | 70.2% |
|
| 60 |
|
| 61 |
+
|
| 62 |
+
## Evaluation Results
|
| 63 |
+
|
| 64 |
+
The model evaluation:
|
| 65 |
+
|
| 66 |
+
- **Confusion Matrix**: Shows classification accuracy across all incident types
|
| 67 |
+
- **Per-Class F1 Scores**: Displays F1 performance for each incident category
|
| 68 |
+
|
| 69 |
+
<img src="confusion_matrix.png" alt="Confusion Matrix" width="600">
|
| 70 |
+
<img src="per_class_f1.png" alt="Per-Class F1 Scores" width="600">
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
|
| 72 |
## Intended Use
|
| 73 |
|
|
|
|
| 195 |
9. **Loss Of Control** - Loss of steering or propulsion control
|
| 196 |
10. **Non-accidental Event** - Events not classified as accidents
|
| 197 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 198 |
## Limitations and Bias
|
| 199 |
|
| 200 |
### Known Limitations
|
|
|
|
| 215 |
```bibtex
|
| 216 |
@software{maib_classifier,
|
| 217 |
title={MAIB Incident Type Classifier},
|
| 218 |
+
author={Ilia Munaev},
|
| 219 |
year={2024},
|
| 220 |
url={https://huggingface.co/your-username/maib-incident-classifier}
|
| 221 |
}
|