Create README.md

README.md

@@ -0,0 +1,47 @@
+---
+license: mit
+datasets:
+- taskydata/tasky_or_not
+language:
+- en
+metrics:
+- f1
+- accuracy
+- recall
+- precision
+pipeline_tag: text-classification
+---
+
+**Hyperparameters:** 
+
+ - learning rate: 2e-5
+ - weight decay: 0.01
+ - per_device_train_batch_size: 16
+ - per_device_eval_batch_size: 16
+ - gradient_accumulation_steps:1
+ - eval steps: 50000
+ - max_length: 512
+ - num_epochs: 1
+ - hidden_dropout_prob: 0.3
+ - attention_probs_dropout_prob: 0.25
+   
+**Dataset version:** 
+ - taskydata/tasky_or_not
+
+**Checkpoint:** 
+
+ - 455000 steps.
+
+**Results on Validation set:**
+
+| **Step** | **Training Loss** | **Validation Loss** | **Accuracy** | **Precision** | **Recall** |  **F1**  |
+|:--------:|:-----------------:|:-------------------:|:------------:|:-------------:|:----------:|:--------:|
+|   50000  |       0.0148      |       0.10890       |    0.9798    |     0.9755    |   0.9843   |  0.9799  |
+|  100000  |       0.0121      |       0.09090       |    0.9863    |     0.9958    |   0.9767   |  0.9862  |
+|  150000  |       0.0080      |       0.11800       |    0.9863    |     0.9779    |   0.9950   |  0.9864  |
+|  200000  |       0.0116      |       0.08965       |    0.9877    |     0.9905    |   0.9848   |  0.9876  |
+|  250000  |       0.0073      |       3.50100       |    0.6507    |     0.5905    |   0.9830   |  0.7378  |
+|  300000  |       0.0072      |       0.09807       |    0.9850    |     0.9863    |   0.9870   |  0.9849  |
+|  350000  |       0.0053      |       0.09830       |    0.9854    |     0.9939    |   0.9870   |  0.9852  |
+|  400000  |       0.0046      |       0.08130       |    0.9893    |     0.9957    |   0.9828   |  0.9892  |
+|  450000  |       0.0054      |       0.61280       |    0.9095    |     0.5835    |   0.9888   |  0.9162  |