Model save

README.md

@@ -0,0 +1,69 @@
+---
+base_model: Hartunka/tiny_bert_rand_50_v1
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+model-index:
+- name: tiny_bert_rand_50_v1_qqp
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# tiny_bert_rand_50_v1_qqp
+
+This model is a fine-tuned version of [Hartunka/tiny_bert_rand_50_v1](https://huggingface.co/Hartunka/tiny_bert_rand_50_v1) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.5111
+- Accuracy: 0.8244
+- F1: 0.7624
+- Combined Score: 0.7934
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 256
+- eval_batch_size: 256
+- seed: 10
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 50
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Combined Score |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
+| 0.4963        | 1.0   | 1422  | 0.4507          | 0.7839   | 0.6831 | 0.7335         |
+| 0.4096        | 2.0   | 2844  | 0.4218          | 0.8030   | 0.7173 | 0.7601         |
+| 0.3533        | 3.0   | 4266  | 0.4170          | 0.8145   | 0.7425 | 0.7785         |
+| 0.3086        | 4.0   | 5688  | 0.4283          | 0.8168   | 0.7428 | 0.7798         |
+| 0.2704        | 5.0   | 7110  | 0.4387          | 0.8230   | 0.7552 | 0.7891         |
+| 0.2413        | 6.0   | 8532  | 0.4586          | 0.8187   | 0.7638 | 0.7913         |
+| 0.215         | 7.0   | 9954  | 0.4812          | 0.8247   | 0.7647 | 0.7947         |
+| 0.193         | 8.0   | 11376 | 0.5111          | 0.8244   | 0.7624 | 0.7934         |
+
+
+### Framework versions
+
+- Transformers 4.40.0
+- Pytorch 2.6.0+cu124
+- Datasets 3.5.0
+- Tokenizers 0.19.1

logs/events.out.tfevents.1744824830.s_004_m

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:effdb0ea483efa5f1c0f3799f670ae0829f72ecfd396da5ffe437dced8b40c11
-size 8691
+oid sha256:cd8239e1b2dccc67700c8c2250b7bed80c5306565270c221a9f97cb22bbfa65a
+size 10110

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:09708175df5c1a4229d2915d548cdad07d0b6b352af7a95a9c79e25fcf54d9c5
+oid sha256:58c68a15f996f9e3e4a7792435bd272cc943b2cb477196cd3c417861c30fe0e5
 size 131856744