Model save

README.md

@@ -0,0 +1,70 @@
+---
+library_name: transformers
+base_model: Hartunka/tiny_bert_km_50_v2
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+model-index:
+- name: tiny_bert_km_50_v2_qqp
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# tiny_bert_km_50_v2_qqp
+
+This model is a fine-tuned version of [Hartunka/tiny_bert_km_50_v2](https://huggingface.co/Hartunka/tiny_bert_km_50_v2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.5383
+- Accuracy: 0.8219
+- F1: 0.7543
+- Combined Score: 0.7881
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 256
+- eval_batch_size: 256
+- seed: 10
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 50
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Combined Score |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
+| 0.4993        | 1.0   | 1422  | 0.4612          | 0.7790   | 0.6616 | 0.7203         |
+| 0.4141        | 2.0   | 2844  | 0.4278          | 0.7986   | 0.7121 | 0.7554         |
+| 0.3569        | 3.0   | 4266  | 0.4256          | 0.8070   | 0.7304 | 0.7687         |
+| 0.3108        | 4.0   | 5688  | 0.4395          | 0.8137   | 0.7326 | 0.7732         |
+| 0.273         | 5.0   | 7110  | 0.4447          | 0.8171   | 0.7535 | 0.7853         |
+| 0.2403        | 6.0   | 8532  | 0.4629          | 0.8187   | 0.7591 | 0.7889         |
+| 0.2117        | 7.0   | 9954  | 0.4907          | 0.8172   | 0.7564 | 0.7868         |
+| 0.1871        | 8.0   | 11376 | 0.5383          | 0.8219   | 0.7543 | 0.7881         |
+
+
+### Framework versions
+
+- Transformers 4.50.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.21.1

logs/events.out.tfevents.1745283923.s_005_m.2836625.60

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:29700c3101e4e5ad5f81a9eedb66d7f0942d8e669bd8d2117c54ab723fd74b50
-size 9447
+oid sha256:af42b609d6c41e71c06c8a2b401fdc9665d86974f39fba64905ec3fa80b3da13
+size 10439

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bfc9c497585d2d5c7524afe8dafdd896c11f32dbf1c9df8c7baa4ff3e3bbc599
+oid sha256:32572686c49b39720a3ad9a37194d6d6ab2f68b7277c4f3fd9e62a4422ac099b
 size 131856744