File size: 1,604 Bytes
4567aa1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 |
---
license: mit
language:
- ko
library_name: transformers
base_model:
- beomi/KcELECTRA-base
model_type: electra
pipeline_tag: text-classification
tags:
- korean
- text-classification
- multi-label-classification
- electra
- kcelectra
- fine-tuned
datasets:
- suicide_related_news_comments_ko
metrics:
- micro-f1
- macro-f1
- subset-accuracy
task_categories:
- text-classification
task_ids:
- multi-label-classification
model-index:
- name: KcELECTRA-base-finetuned-suicide-comments
results:
- task:
type: multi-label text classification
name: Multi-label Text Classification
dataset:
name: suicide_related_news_comments_ko
type: custom
split: "8:1:1 (train 7119 / val 890 / test 890)"
metrics:
- type: micro-f1
value: 0.769
- type: macro-f1
value: 0.758
- type: subset-accuracy
value: 0.516
---
# KcELECTRA-base-finetuned-suicide-comments
# Training Details
- Data Split: 8:1:1 (Train: 7,119 / Validation: 890 / Test: 890)
- Tokenizer: SentencePiece (KcELECTRA tokenizer)
- Max Length: 256
- Learning Rate: 3e-5
- Batch Size: 16
- Epochs: 6
- Early Stopping: Patience = 2
- Optimizer: AdamW
- Threshold Optimization: Independent per-label tuning (criteria = Micro-F1, Macro-F1)
- Thresholds: [0.25, 0.675, 0.8, 0.75, 0.7]
---
# Result
| Metric | Value |
|--------|--------|
| Micro-F1 | 0.769 |
| Macro-F1 | 0.758 |
| Subset Accuracy | 0.516 |
F1-score:
| Emotion | F1-score |
|----------|-----------|
| Dislike | 0.72 |
| Sympathy | 0.81 |
| Sadness | 0.64 |
| Surprised | 0.80 |
| Angry | 0.82 |
---
|