End of training

README.md

@@ -0,0 +1,73 @@
+---
+license: mit
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+model-index:
+- name: clickbait_binary_detection_DeBERTa
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# clickbait_binary_detection_DeBERTa
+
+This model is a fine-tuned version of [microsoft/deberta-v3-large](https://huggingface.co/microsoft/deberta-v3-large) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.7269
+- Macro F1: 0.9010
+- Micro F1: 0.9069
+- Accuracy: 0.9069
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-06
+- train_batch_size: 4
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 8
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Macro F1 | Micro F1 | Accuracy |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:--------:|:--------:|
+| 0.2692        | 1.0   | 5475  | 0.2676          | 0.9051   | 0.9142   | 0.9142   |
+| 0.2492        | 2.0   | 10951 | 0.3331          | 0.9078   | 0.9156   | 0.9156   |
+| 0.2189        | 3.0   | 16426 | 0.3909          | 0.9107   | 0.9169   | 0.9169   |
+| 0.1769        | 4.0   | 21902 | 0.3799          | 0.9114   | 0.9178   | 0.9178   |
+| 0.1479        | 5.0   | 27377 | 0.5103          | 0.8980   | 0.9032   | 0.9032   |
+| 0.108         | 6.0   | 32853 | 0.5215          | 0.9123   | 0.9183   | 0.9183   |
+| 0.0957        | 7.0   | 38328 | 0.6549          | 0.8974   | 0.9028   | 0.9028   |
+| 0.0773        | 8.0   | 43804 | 0.6768          | 0.9044   | 0.9101   | 0.9101   |
+| 0.0586        | 9.0   | 49279 | 0.6837          | 0.9023   | 0.9083   | 0.9083   |
+| 0.0439        | 10.0  | 54750 | 0.7269          | 0.9010   | 0.9069   | 0.9069   |
+
+
+### Framework versions
+
+- Transformers 4.27.1
+- Pytorch 2.0.1+cu118
+- Datasets 2.9.0
+- Tokenizers 0.13.3

added_tokens.json

@@ -0,0 +1,3 @@
+{
+  "[MASK]": 128000
+}

logs/events.out.tfevents.1687468337.e3b85aa49c5f.5566.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9317253fae686d4aaa231bce0dc6693cbc6fe3e5b40ac06f2918082da18f0b8a
-size 25965
+oid sha256:91bdeeacf8d98f3a5a970fe7b41dc9271e9ee636abacd0e4b8a630e2ccbf7c57
+size 26325

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:812d37b1327b0666fe7b08cefea0df6f7b93737201a4ca46424d0fd0ae195481
+oid sha256:c5542be2af567edcb272a974ba207386817eabcee2f9c197d526c72d0824285a
 size 1740396281

special_tokens_map.json

@@ -0,0 +1,9 @@
+{
+  "bos_token": "[CLS]",
+  "cls_token": "[CLS]",
+  "eos_token": "[SEP]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

spm.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c679fbf93643d19aab7ee10c0b99e460bdbc02fedf34b92b05af343b4af586fd
+size 2464616

tokenizer_config.json

@@ -0,0 +1,16 @@
+{
+  "bos_token": "[CLS]",
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "eos_token": "[SEP]",
+  "mask_token": "[MASK]",
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "sp_model_kwargs": {},
+  "special_tokens_map_file": null,
+  "split_by_punct": false,
+  "tokenizer_class": "DebertaV2Tokenizer",
+  "unk_token": "[UNK]",
+  "vocab_type": "spm"
+}