tool-bert

README.md

@@ -1,11 +1,13 @@
 ---
 library_name: transformers
 license: apache-2.0
-base_model: google-bert/bert-base-multilingual-uncased
+base_model: bert-base-multilingual-uncased
 tags:
 - generated_from_trainer
 metrics:
 - accuracy
+- precision
+- f1
 model-index:
 - name: tool-bert
   results: []
@@ -16,10 +18,12 @@ should probably proofread and complete it, then remove this comment. -->
 
 # tool-bert
 
-This model is a fine-tuned version of [google-bert/bert-base-multilingual-uncased](https://huggingface.co/google-bert/bert-base-multilingual-uncased) on an unknown dataset.
+This model is a fine-tuned version of [bert-base-multilingual-uncased](https://huggingface.co/bert-base-multilingual-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0165
-- Accuracy: 0.9980
+- Loss: 0.0049
+- Accuracy: 1.0
+- Precision: 1.0
+- F1: 1.0
 
 ## Model description
 
@@ -38,22 +42,28 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 5e-05
+- learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 4
+- num_epochs: 10
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Accuracy |
-|:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 63   | 0.3853          | 0.9701   |
-| No log        | 2.0   | 126  | 0.0449          | 0.9960   |
-| No log        | 3.0   | 189  | 0.0412          | 0.9940   |
-| No log        | 4.0   | 252  | 0.0165          | 0.9980   |
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | F1     |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|
+| 1.0122        | 1.0   | 50   | 0.8306          | 0.9307   | 0.9382    | 0.9321 |
+| 0.2625        | 2.0   | 100  | 0.1804          | 0.9802   | 0.9823    | 0.9802 |
+| 0.1518        | 3.0   | 150  | 0.1622          | 0.9406   | 0.9524    | 0.9375 |
+| 0.0276        | 4.0   | 200  | 0.0422          | 0.9901   | 0.9906    | 0.9901 |
+| 0.0152        | 5.0   | 250  | 0.0463          | 0.9901   | 0.9906    | 0.9901 |
+| 0.0116        | 6.0   | 300  | 0.0083          | 1.0      | 1.0       | 1.0    |
+| 0.0082        | 7.0   | 350  | 0.0065          | 1.0      | 1.0       | 1.0    |
+| 0.0075        | 8.0   | 400  | 0.0055          | 1.0      | 1.0       | 1.0    |
+| 0.0068        | 9.0   | 450  | 0.0050          | 1.0      | 1.0       | 1.0    |
+| 0.0071        | 10.0  | 500  | 0.0049          | 1.0      | 1.0       | 1.0    |
 
 
 ### Framework versions

config.json

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "google-bert/bert-base-multilingual-uncased",
+  "_name_or_path": "bert-base-multilingual-uncased",
   "architectures": [
     "BertForSequenceClassification"
   ],

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ee0a259b317bce7580f10277bdc7db7c86c2a92a8a114701ff9e50b67f669233
+oid sha256:6515443dab978e1216f56fb869e96c57a01655316796fa2aa8159a34cfeb9350
 size 669464588

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,56 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d9c0c3edf476a5fd51fb955692c8710d018c5c4aa7aa58474cd0d26ff101d020
+oid sha256:572ac2b03b6d3c5957a58934df98908f6798f4b93f79ed52c97956549fdc201e
 size 5304