|
|
|
|
|
--- |
|
|
language: |
|
|
- ru |
|
|
- multilingual |
|
|
tags: |
|
|
- text-classification |
|
|
- topic-modeling |
|
|
- xlm-roberta |
|
|
--- |
|
|
|
|
|
# XLM-RoBERTa Base for Topic Classification |
|
|
|
|
|
Model fine-tuned for Russian social media topic classification. |
|
|
- Trained on: 512_posts_24_topics.csv |
|
|
- Epochs: 17 |
|
|
- Learning rate: 2e-05 |
|
|
|
|
|
| Epoch | Training Loss | Validation Loss | Accuracy | F1 Macro | F1 Weighted | |
|
|
|-------|---------------|-----------------|----------|----------|-------------| |
|
|
| 1 | No log | 3.026107 | 0.107527 | 0.018696 | 0.033548 | |
|
|
| 2 | No log | 2.870733 | 0.182796 | 0.052066 | 0.116982 | |
|
|
| 3 | No log | 2.696235 | 0.225806 | 0.062794 | 0.135901 | |
|
|
| 4 | No log | 2.468899 | 0.301075 | 0.117249 | 0.195119 | |
|
|
| 5 | No log | 2.275375 | 0.365591 | 0.164985 | 0.264671 | |
|
|
| 6 | No log | 2.103708 | 0.430108 | 0.246894 | 0.348294 | |
|
|
| 7 | No log | 1.953564 | 0.494624 | 0.297129 | 0.416058 | |
|
|
| 8 | No log | 1.905395 | 0.537634 | 0.356591 | 0.465515 | |
|
|
| 9 | No log | 1.783440 | 0.516129 | 0.349648 | 0.457348 | |
|
|
| 10 | No log | 1.733219 | 0.559140 | 0.385719 | 0.496481 | |
|
|
| 11 | No log | 1.668128 | 0.537634 | 0.361045 | 0.470044 | |
|
|
| 12 | No log | 1.633103 | 0.559140 | 0.387321 | 0.498477 | |
|
|
| 13 | No log | 1.588825 | 0.569892 | 0.392370 | 0.508810 | |
|
|
| 14 | No log | 1.581068 | 0.591398 | 0.410717 | 0.533581 | |
|
|
| 15 | No log | 1.560641 | 0.591398 | 0.413310 | 0.533612 | |
|
|
| 16 | No log | 1.545080 | 0.580645 | 0.403768 | 0.525466 | |
|
|
| 17 | No log | 1.550952 | 0.591398 | 0.410717 | 0.533581 | |
