Update README.md
Browse files
README.md
CHANGED
|
@@ -20,10 +20,10 @@ AI-Task로는 `text-classification`에 해당합니다.
|
|
| 20 |
---
|
| 21 |
## 2. 🧠 학습 정보
|
| 22 |
|
| 23 |
-
- **Base Model**:
|
| 24 |
-
- **Source**: [
|
| 25 |
- **Model Type**: Casual Language Model
|
| 26 |
-
- **Pre-training (Korean)**: 약
|
| 27 |
- **Fine-tuning (Hate Dataset)**: 약 22.3MB (`TTA-DQA/hate_sentence`)
|
| 28 |
- **Learning Rate**: `5e-6`
|
| 29 |
- **Weight Decay**: `0.01`
|
|
@@ -31,7 +31,7 @@ AI-Task로는 `text-classification`에 해당합니다.
|
|
| 31 |
- **Batch Size**: `16`
|
| 32 |
- **Data Loader Workers**: `2`
|
| 33 |
- **Tokenizer**: `BertWordPieceTokenizer`
|
| 34 |
-
- **Model Size**: 약 `
|
| 35 |
|
| 36 |
---
|
| 37 |
|
|
@@ -76,5 +76,5 @@ results = classifier(sentences)'
|
|
| 76 |
|
| 77 |
# 📈 Results
|
| 78 |
- Task: binary classification (text-classification)
|
| 79 |
-
- F1-score: 0.
|
| 80 |
-
- Accuracy: 0.
|
|
|
|
| 20 |
---
|
| 21 |
## 2. 🧠 학습 정보
|
| 22 |
|
| 23 |
+
- **Base Model**: KcElectra (a pre-trained Korean language model based on Electra)
|
| 24 |
+
- **Source**: [monologg/koelectra-base-v3-discriminator](https://huggingface.co/monologg/koelectra-base-v3-discriminator)
|
| 25 |
- **Model Type**: Casual Language Model
|
| 26 |
+
- **Pre-training (Korean)**: 약 20GB
|
| 27 |
- **Fine-tuning (Hate Dataset)**: 약 22.3MB (`TTA-DQA/hate_sentence`)
|
| 28 |
- **Learning Rate**: `5e-6`
|
| 29 |
- **Weight Decay**: `0.01`
|
|
|
|
| 31 |
- **Batch Size**: `16`
|
| 32 |
- **Data Loader Workers**: `2`
|
| 33 |
- **Tokenizer**: `BertWordPieceTokenizer`
|
| 34 |
+
- **Model Size**: 약 `512MB`
|
| 35 |
|
| 36 |
---
|
| 37 |
|
|
|
|
| 76 |
|
| 77 |
# 📈 Results
|
| 78 |
- Task: binary classification (text-classification)
|
| 79 |
+
- F1-score: 0.9881
|
| 80 |
+
- Accuracy: 0.9881
|