c-ho/academic_main_text_classifier_de

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [FacebookAI/xlm-roberta-base](https://huggingface.co/FacebookAI/xlm-roberta-base) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.2658
-- Accuracy: 0.9291
-- Precision: 0.9291
-- Recall: 0.9291
-- F1: 0.9291
+- Loss: 0.2703
+- Accuracy: 0.9175
+- Precision: 0.9175
+- Recall: 0.9175
+- F1: 0.9175
 
 ## Model description
 
@@ -45,7 +45,7 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 2e-05
-- train_batch_size: 32
+- train_batch_size: 64
 - eval_batch_size: 64
 - seed: 42
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
@@ -57,11 +57,11 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
-| 0.9706        | 1.0   | 268  | 0.5344          | 0.8      | 0.8       | 0.8    | 0.8    |
-| 0.5155        | 2.0   | 536  | 0.3167          | 0.9040   | 0.9040    | 0.9040 | 0.9040 |
-| 0.2703        | 3.0   | 804  | 0.2677          | 0.9207   | 0.9207    | 0.9207 | 0.9207 |
-| 0.2119        | 4.0   | 1072 | 0.2678          | 0.9231   | 0.9231    | 0.9231 | 0.9231 |
-| 0.172         | 5.0   | 1340 | 0.2658          | 0.9291   | 0.9291    | 0.9291 | 0.9291 |
+| No log        | 1.0   | 134  | 0.6320          | 0.7594   | 0.7594    | 0.7594 | 0.7594 |
+| 0.916         | 2.0   | 268  | 0.4240          | 0.8690   | 0.8690    | 0.8690 | 0.8690 |
+| 0.3998        | 3.0   | 402  | 0.3483          | 0.8960   | 0.8960    | 0.8960 | 0.8960 |
+| 0.3998        | 4.0   | 536  | 0.2810          | 0.9072   | 0.9072    | 0.9072 | 0.9072 |
+| 0.2657        | 5.0   | 670  | 0.2703          | 0.9175   | 0.9175    | 0.9175 | 0.9175 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a66a32f08ee62c5a3fff3ca6163233e8650a1b2c3d997521d4494730ed798a5d
+oid sha256:c0a0a2622f32eabdc71b6023293c4b4401797983b9ba0e193eee999701e9025e
 size 1112211160

runs/Dec02_15-04-17_89439538ec94/events.out.tfevents.1764687860.89439538ec94.43287.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:eb84c07bc60905c831deac8346fde709942b904e9f1063f03b84e013003b5b59
-size 7616
+oid sha256:000e106151b61d57bedd82566e6642c06430364cb3f4658ba9d682310b27fdef
+size 8653