baker-street commited on
Commit
f50f76d
·
verified ·
1 Parent(s): 805e27a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -28
README.md CHANGED
@@ -42,7 +42,7 @@ A fine-tuned DeBERTa-v3 model for classifying marine incident types based on acc
42
 
43
  This model is a fine-tuned version of `microsoft/deberta-v3-base` specifically designed to classify marine incidents into 11 different categories. It was trained on the MAIB incident reports dataset and achieves high performance in maritime safety incident classification.
44
 
45
- - **Developed by**: MAIB Incident Type Classifier Team
46
  - **Model type**: Text Classification
47
  - **Language(s)**: English
48
  - **License**: Apache 2.0
@@ -58,21 +58,16 @@ The model achieves the following performance metrics on the test set:
58
  | **Weighted F1-Score** | 89.0% |
59
  | **Macro F1-Score** | 70.2% |
60
 
61
- ### Per-Class Performance
62
-
63
- | Incident Type | Precision | Recall | F1-Score | Support |
64
- |---------------|-----------|--------|----------|---------|
65
- | Accident to person(s) | 0.97 | 0.96 | 0.96 | 67 |
66
- | Capsizing / Listing | 0.75 | 0.86 | 0.80 | 7 |
67
- | Collision | 0.76 | 0.87 | 0.81 | 15 |
68
- | Contact | 0.62 | 0.57 | 0.59 | 23 |
69
- | Damage / Loss Of Equipment | 0.94 | 0.92 | 0.93 | 72 |
70
- | Fire / Explosion | 0.95 | 0.95 | 0.95 | 20 |
71
- | Flooding / Foundering | 1.00 | 0.83 | 0.91 | 12 |
72
- | Grounding / Stranding | 0.90 | 0.90 | 0.90 | 31 |
73
- | Hull Failure | 0.00 | 0.00 | 0.00 | 0 |
74
- | Loss Of Control | 0.83 | 0.90 | 0.86 | 42 |
75
- | Non-accidental Event | 0.00 | 0.00 | 0.00 | 0 |
76
 
77
  ## Intended Use
78
 
@@ -200,17 +195,6 @@ The model classifies incidents into the following 11 categories:
200
  9. **Loss Of Control** - Loss of steering or propulsion control
201
  10. **Non-accidental Event** - Events not classified as accidents
202
 
203
- ## Evaluation Results
204
-
205
- The model evaluation includes comprehensive visualizations:
206
-
207
- - **Confusion Matrix**: Shows classification accuracy across all incident types
208
- - **Per-Class F1 Scores**: Displays F1 performance for each incident category
209
-
210
- ![Confusion Matrix](confusion_matrix.png)
211
-
212
- ![Per-Class F1 Scores](per_class_f1.png)
213
-
214
  ## Limitations and Bias
215
 
216
  ### Known Limitations
@@ -231,7 +215,7 @@ The model evaluation includes comprehensive visualizations:
231
  ```bibtex
232
  @software{maib_classifier,
233
  title={MAIB Incident Type Classifier},
234
- author={MAIB Incident Type Classifier Team},
235
  year={2024},
236
  url={https://huggingface.co/your-username/maib-incident-classifier}
237
  }
 
42
 
43
  This model is a fine-tuned version of `microsoft/deberta-v3-base` specifically designed to classify marine incidents into 11 different categories. It was trained on the MAIB incident reports dataset and achieves high performance in maritime safety incident classification.
44
 
45
+ - **Developed by**: Ilia Munaev
46
  - **Model type**: Text Classification
47
  - **Language(s)**: English
48
  - **License**: Apache 2.0
 
58
  | **Weighted F1-Score** | 89.0% |
59
  | **Macro F1-Score** | 70.2% |
60
 
61
+
62
+ ## Evaluation Results
63
+
64
+ The model evaluation:
65
+
66
+ - **Confusion Matrix**: Shows classification accuracy across all incident types
67
+ - **Per-Class F1 Scores**: Displays F1 performance for each incident category
68
+
69
+ <img src="confusion_matrix.png" alt="Confusion Matrix" width="600">
70
+ <img src="per_class_f1.png" alt="Per-Class F1 Scores" width="600">
 
 
 
 
 
71
 
72
  ## Intended Use
73
 
 
195
  9. **Loss Of Control** - Loss of steering or propulsion control
196
  10. **Non-accidental Event** - Events not classified as accidents
197
 
 
 
 
 
 
 
 
 
 
 
 
198
  ## Limitations and Bias
199
 
200
  ### Known Limitations
 
215
  ```bibtex
216
  @software{maib_classifier,
217
  title={MAIB Incident Type Classifier},
218
+ author={Ilia Munaev},
219
  year={2024},
220
  url={https://huggingface.co/your-username/maib-incident-classifier}
221
  }