Kaaeun commited on
Commit
4567aa1
·
verified ·
1 Parent(s): cb0794f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +79 -3
README.md CHANGED
@@ -1,3 +1,79 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - ko
5
+ library_name: transformers
6
+ base_model:
7
+ - beomi/KcELECTRA-base
8
+ model_type: electra
9
+ pipeline_tag: text-classification
10
+ tags:
11
+ - korean
12
+ - text-classification
13
+ - multi-label-classification
14
+ - electra
15
+ - kcelectra
16
+ - fine-tuned
17
+ datasets:
18
+ - suicide_related_news_comments_ko
19
+ metrics:
20
+ - micro-f1
21
+ - macro-f1
22
+ - subset-accuracy
23
+ task_categories:
24
+ - text-classification
25
+ task_ids:
26
+ - multi-label-classification
27
+ model-index:
28
+ - name: KcELECTRA-base-finetuned-suicide-comments
29
+ results:
30
+ - task:
31
+ type: multi-label text classification
32
+ name: Multi-label Text Classification
33
+ dataset:
34
+ name: suicide_related_news_comments_ko
35
+ type: custom
36
+ split: "8:1:1 (train 7119 / val 890 / test 890)"
37
+ metrics:
38
+ - type: micro-f1
39
+ value: 0.769
40
+ - type: macro-f1
41
+ value: 0.758
42
+ - type: subset-accuracy
43
+ value: 0.516
44
+ ---
45
+
46
+ # KcELECTRA-base-finetuned-suicide-comments
47
+
48
+ # Training Details
49
+ - Data Split: 8:1:1 (Train: 7,119 / Validation: 890 / Test: 890)
50
+ - Tokenizer: SentencePiece (KcELECTRA tokenizer)
51
+ - Max Length: 256
52
+ - Learning Rate: 3e-5
53
+ - Batch Size: 16
54
+ - Epochs: 6
55
+ - Early Stopping: Patience = 2
56
+ - Optimizer: AdamW
57
+ - Threshold Optimization: Independent per-label tuning (criteria = Micro-F1, Macro-F1)
58
+ - Thresholds: [0.25, 0.675, 0.8, 0.75, 0.7]
59
+
60
+ ---
61
+
62
+ # Result
63
+
64
+ | Metric | Value |
65
+ |--------|--------|
66
+ | Micro-F1 | 0.769 |
67
+ | Macro-F1 | 0.758 |
68
+ | Subset Accuracy | 0.516 |
69
+
70
+ F1-score:
71
+ | Emotion | F1-score |
72
+ |----------|-----------|
73
+ | Dislike | 0.72 |
74
+ | Sympathy | 0.81 |
75
+ | Sadness | 0.64 |
76
+ | Surprised | 0.80 |
77
+ | Angry | 0.82 |
78
+
79
+ ---