Model save

README.md

@@ -0,0 +1,69 @@
+---
+library_name: transformers
+base_model: Hartunka/distilbert_rand_100_v2
+tags:
+- generated_from_trainer
+metrics:
+- matthews_correlation
+- accuracy
+model-index:
+- name: distilbert_rand_100_v2_cola
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# distilbert_rand_100_v2_cola
+
+This model is a fine-tuned version of [Hartunka/distilbert_rand_100_v2](https://huggingface.co/Hartunka/distilbert_rand_100_v2) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.0343
+- Matthews Correlation: 0.1314
+- Accuracy: 0.6481
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 256
+- eval_batch_size: 256
+- seed: 10
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 50
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Matthews Correlation | Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:--------------------:|:--------:|
+| 0.6127        | 1.0   | 34   | 0.6148          | 0.0                  | 0.6913   |
+| 0.591         | 2.0   | 68   | 0.6217          | -0.0163              | 0.6884   |
+| 0.5421        | 3.0   | 102  | 0.6132          | 0.0748               | 0.6826   |
+| 0.4864        | 4.0   | 136  | 0.7308          | 0.1075               | 0.6596   |
+| 0.4232        | 5.0   | 170  | 0.7523          | 0.1393               | 0.6577   |
+| 0.3623        | 6.0   | 204  | 0.8275          | 0.1102               | 0.6500   |
+| 0.3196        | 7.0   | 238  | 0.9465          | 0.1025               | 0.6328   |
+| 0.2848        | 8.0   | 272  | 1.0343          | 0.1314               | 0.6481   |
+
+
+### Framework versions
+
+- Transformers 4.50.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.21.1

logs/events.out.tfevents.1745375901.s_005_m.2850345.162

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:132e0a4d37a8e8795cafa409c03db8d257c3fafd2ac2bf1f54cc38b3cfc663d7
-size 9157
+oid sha256:fee33cc893bb2a08274f4def3b8a2f72d928451b0c47a46fab7d8a1bf8cb46a6
+size 10109

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c8f25aea6625180dc2bdc803c2bbbdc1dbbde5c12b693d7cc3089e56a0fd3fa7
+oid sha256:765672475559366c04a1923755eeca6052339b251c82b1252e0f039edb5c3053
 size 267832560