Model save

README.md

@@ -0,0 +1,70 @@
+---
+library_name: transformers
+base_model: Hartunka/tiny_bert_km_10_v2
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+model-index:
+- name: tiny_bert_km_10_v2_qqp
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# tiny_bert_km_10_v2_qqp
+
+This model is a fine-tuned version of [Hartunka/tiny_bert_km_10_v2](https://huggingface.co/Hartunka/tiny_bert_km_10_v2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.5614
+- Accuracy: 0.8253
+- F1: 0.7663
+- Combined Score: 0.7958
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 256
+- eval_batch_size: 256
+- seed: 10
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 50
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Combined Score |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
+| 0.49          | 1.0   | 1422  | 0.4449          | 0.7852   | 0.6797 | 0.7324         |
+| 0.3992        | 2.0   | 2844  | 0.4204          | 0.8038   | 0.7170 | 0.7604         |
+| 0.3367        | 3.0   | 4266  | 0.4118          | 0.8164   | 0.7454 | 0.7809         |
+| 0.2845        | 4.0   | 5688  | 0.4297          | 0.8200   | 0.7449 | 0.7824         |
+| 0.243         | 5.0   | 7110  | 0.4527          | 0.8228   | 0.7637 | 0.7932         |
+| 0.2066        | 6.0   | 8532  | 0.4895          | 0.8199   | 0.7636 | 0.7918         |
+| 0.1782        | 7.0   | 9954  | 0.5355          | 0.8205   | 0.7669 | 0.7937         |
+| 0.1554        | 8.0   | 11376 | 0.5614          | 0.8253   | 0.7663 | 0.7958         |
+
+
+### Framework versions
+
+- Transformers 4.50.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.21.1

logs/events.out.tfevents.1745274093.s_005_m.2836625.24

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f3c1a0051ce03a4afa96326c386fa59776f3c4ffc95a5786fdc96b3c4eb37edc
-size 9447
+oid sha256:bec81232ef689cfa597e3d7474f063f525680f876f54b4ac5661866e722b1b46
+size 10439

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2303c6b9ea83c61726b3ed3f43b665d6707e90c0624a66e347c0cc9324e1e435
+oid sha256:20343e4a26dc67441548fac7c5dc485cd1886cd75fc033b653d00d1115514c70
 size 131856744