Model save

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [SI2M-Lab/DarijaBERT](https://huggingface.co/SI2M-Lab/DarijaBERT) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0106
-- Accuracy: 0.9982
+- Loss: 0.0
+- Accuracy: 1.0
 
 ## Model description
 
@@ -41,7 +41,7 @@ The following hyperparameters were used during training:
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
-- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 6
 
@@ -49,17 +49,17 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 281  | 0.0242          | 0.9947   |
-| 0.0937        | 2.0   | 562  | 0.0167          | 0.9982   |
-| 0.0937        | 3.0   | 843  | 0.0245          | 0.9947   |
-| 0.0022        | 4.0   | 1124 | 0.0239          | 0.9964   |
-| 0.0022        | 5.0   | 1405 | 0.0181          | 0.9982   |
-| 0.0003        | 6.0   | 1686 | 0.0106          | 0.9982   |
+| No log        | 1.0   | 92   | 0.0000          | 1.0      |
+| No log        | 2.0   | 184  | 0.0             | 1.0      |
+| No log        | 3.0   | 276  | 0.0             | 1.0      |
+| No log        | 4.0   | 368  | 0.0             | 1.0      |
+| No log        | 5.0   | 460  | 0.0             | 1.0      |
+| 0.0           | 6.0   | 552  | 0.0             | 1.0      |
 
 
 ### Framework versions
 
-- Transformers 4.44.2
-- Pytorch 2.4.0+cu121
+- Transformers 4.47.1
+- Pytorch 2.5.1+cu121
 - Datasets 2.21.0
-- Tokenizers 0.19.1
+- Tokenizers 0.21.0

config.json

@@ -12,14 +12,14 @@
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "id2label": {
-    "0": "*6",
-    "1": "autre"
+    "0": "not a question",
+    "1": "question"
   },
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "label2id": {
-    "*6": 0,
-    "autre": 1
+    "not a question": 0,
+    "question": 1
   },
   "layer_norm_eps": 1e-12,
   "mask_token": "[MASK]",
@@ -35,7 +35,7 @@
   "problem_type": "single_label_classification",
   "sep_token": "[SEP]",
   "torch_dtype": "float32",
-  "transformers_version": "4.44.2",
+  "transformers_version": "4.47.1",
   "type_vocab_size": 2,
   "unk_token": "[UNK]",
   "use_cache": true,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8cedc757f7ee16bc187a86d3d8a932c04a1aa572a1da43d5aa5fbc9a1e20e3e5
+oid sha256:91c2ecdba8711398d2343cf4758f4a07c208fb92d942406aa0f63e26d4340acb
 size 589955072

runs/Dec25_15-34-36_d3d9efa2cf77/events.out.tfevents.1735140879.d3d9efa2cf77.743.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d49afc6e15886268051feb7c615bbcfb3df1350ffb01173117dd25d099e8c4a
+size 7947

runs/Dec25_15-34-36_d3d9efa2cf77/events.out.tfevents.1735141012.d3d9efa2cf77.743.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3124ec60a60ee727d7d40bb0d3b5679f0f2cc932e27a4dff6d4321c60489cca9
+size 411

tokenizer_config.json

@@ -41,10 +41,11 @@
       "special": true
     }
   },
-  "clean_up_tokenization_spaces": true,
+  "clean_up_tokenization_spaces": false,
   "cls_token": "[CLS]",
   "do_basic_tokenize": true,
   "do_lower_case": true,
+  "extra_special_tokens": {},
   "mask_token": "[MASK]",
   "model_max_length": 1000000000000000019884624838656,
   "never_split": null,

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6df38197662ca5ddd415754ac8ebc6a93e899e6465f25524d1298ff0a04dd1f6
-size 5176
+oid sha256:e843fdbaca198f0d7717a7846e90d7530f0f8f82be30824c553304f6008ec345
+size 5368