Model save

README.md

@@ -1,7 +1,5 @@
 ---
 library_name: transformers
-language:
-- en
 license: apache-2.0
 base_model: Mardiyyah/variant-tapt_freeze_llrd-LR_5e-05
 tags:
@@ -21,13 +19,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 # variant_tapt_freeze_llrd_LR_5e
 
-This model is a fine-tuned version of [Mardiyyah/variant-tapt_freeze_llrd-LR_5e-05](https://huggingface.co/Mardiyyah/variant-tapt_freeze_llrd-LR_5e-05) on the OTAR3088/Variants_IOB-V2 dataset.
+This model is a fine-tuned version of [Mardiyyah/variant-tapt_freeze_llrd-LR_5e-05](https://huggingface.co/Mardiyyah/variant-tapt_freeze_llrd-LR_5e-05) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3584
-- Precision: 0.3820
-- Recall: 0.1575
-- F1: 0.2231
-- Accuracy: 0.8545
+- Loss: 0.0616
+- Precision: 0.8462
+- Recall: 0.8618
+- F1: 0.8539
+- Accuracy: 0.9862
 
 ## Model description
 
@@ -53,14 +51,23 @@ The following hyperparameters were used during training:
 - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_ratio: 0.1
-- num_epochs: 1
+- num_epochs: 10
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| 0.5777        | 1.0   | 34   | 0.3566          | 0.3820    | 0.1575 | 0.2231 | 0.8545   |
+| 0.5514        | 1.0   | 34   | 0.2347          | 0.2767    | 0.2028 | 0.2340 | 0.9168   |
+| 0.1451        | 2.0   | 68   | 0.0934          | 0.6139    | 0.7327 | 0.6681 | 0.9716   |
+| 0.0725        | 3.0   | 102  | 0.0718          | 0.8148    | 0.8111 | 0.8129 | 0.9812   |
+| 0.0485        | 4.0   | 136  | 0.0651          | 0.8136    | 0.8249 | 0.8192 | 0.9831   |
+| 0.0321        | 5.0   | 170  | 0.0605          | 0.8378    | 0.8571 | 0.8474 | 0.9850   |
+| 0.0243        | 6.0   | 204  | 0.0646          | 0.8493    | 0.8571 | 0.8532 | 0.9852   |
+| 0.0181        | 7.0   | 238  | 0.0641          | 0.8468    | 0.8664 | 0.8565 | 0.9864   |
+| 0.0161        | 8.0   | 272  | 0.0603          | 0.8584    | 0.8664 | 0.8624 | 0.9858   |
+| 0.0125        | 9.0   | 306  | 0.0584          | 0.8386    | 0.8618 | 0.85   | 0.9858   |
+| 0.0118        | 10.0  | 340  | 0.0616          | 0.8462    | 0.8618 | 0.8539 | 0.9862   |
 
 
 ### Framework versions

config.json

@@ -9,16 +9,16 @@
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "id2label": {
-    "0": "B-mutant",
-    "1": "O",
+    "0": "O",
+    "1": "B-mutant",
     "2": "I-mutant"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "label2id": {
-    "B-mutant": 0,
+    "B-mutant": 1,
     "I-mutant": 2,
-    "O": 1
+    "O": 0
   },
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:64f9156291715821f26bc666a36baebf3fcff0896b9befe284e20db2589e59d6
+oid sha256:5d4c77af75d457edb383e59e494800eb4bce0055d07bb513c09025466afadefb
 size 439531324

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2a852e038246ba5d9a152e2353db116322de332a574f47bcf97fe1c717f4a1a7
+oid sha256:0d5c0fe58e4f6d36fb05c04bedfae045dc2f3ef364059dd8d9a7e02f1d369cf4
 size 5688