c-ho/academic_main_text_classifier_de

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [FacebookAI/xlm-roberta-base](https://huggingface.co/FacebookAI/xlm-roberta-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2703
-- Accuracy: 0.9175
-- Precision: 0.9175
-- Recall: 0.9175
-- F1: 0.9175
+- Loss: 0.2714
+- Accuracy: 0.9193
+- Precision: 0.9193
+- Recall: 0.9193
+- F1: 0.9193
 
 ## Model description
 
@@ -44,7 +44,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 2e-05
+- learning_rate: 1e-05
 - train_batch_size: 64
 - eval_batch_size: 64
 - seed: 42
@@ -57,11 +57,11 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
-| No log        | 1.0   | 134  | 0.6320          | 0.7594   | 0.7594    | 0.7594 | 0.7594 |
-| 0.916         | 2.0   | 268  | 0.4240          | 0.8690   | 0.8690    | 0.8690 | 0.8690 |
-| 0.3998        | 3.0   | 402  | 0.3483          | 0.8960   | 0.8960    | 0.8960 | 0.8960 |
-| 0.3998        | 4.0   | 536  | 0.2810          | 0.9072   | 0.9072    | 0.9072 | 0.9072 |
-| 0.2657        | 5.0   | 670  | 0.2703          | 0.9175   | 0.9175    | 0.9175 | 0.9175 |
+| No log        | 1.0   | 134  | 0.7912          | 0.7189   | 0.7189    | 0.7189 | 0.7189 |
+| 1.0163        | 2.0   | 268  | 0.4568          | 0.8517   | 0.8517    | 0.8517 | 0.8517 |
+| 0.5157        | 3.0   | 402  | 0.3827          | 0.8704   | 0.8704    | 0.8704 | 0.8704 |
+| 0.5157        | 4.0   | 536  | 0.2817          | 0.9100   | 0.9100    | 0.9100 | 0.9100 |
+| 0.3219        | 5.0   | 670  | 0.2714          | 0.9193   | 0.9193    | 0.9193 | 0.9193 |
 
 
 ### Framework versions