End of training

README.md

@@ -0,0 +1,116 @@
+---
+library_name: transformers
+base_model: google-bert/bert-base-chinese
+tags:
+- generated_from_trainer
+metrics:
+- precision
+- recall
+- f1
+- accuracy
+model-index:
+- name: ner_based_bert-base-chinese
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# ner_based_bert-base-chinese
+
+This model is a fine-tuned version of [google-bert/bert-base-chinese](https://huggingface.co/google-bert/bert-base-chinese) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.1461
+- Precision: 0.9651
+- Recall: 0.9712
+- F1: 0.9681
+- Accuracy: 0.9873
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 50
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1     | Accuracy |
+|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
+| No log        | 1.0   | 367   | 0.1262          | 0.9355    | 0.9449 | 0.9401 | 0.9738   |
+| 0.0701        | 2.0   | 734   | 0.0725          | 0.9663    | 0.9687 | 0.9675 | 0.9867   |
+| 0.0494        | 3.0   | 1101  | 0.0769          | 0.9663    | 0.9712 | 0.9688 | 0.9871   |
+| 0.0494        | 4.0   | 1468  | 0.0902          | 0.9653    | 0.9749 | 0.9701 | 0.9880   |
+| 0.0306        | 5.0   | 1835  | 0.0796          | 0.9665    | 0.9749 | 0.9707 | 0.9876   |
+| 0.0245        | 6.0   | 2202  | 0.0968          | 0.9509    | 0.9699 | 0.9603 | 0.9847   |
+| 0.0221        | 7.0   | 2569  | 0.0956          | 0.9638    | 0.9674 | 0.9656 | 0.9864   |
+| 0.0221        | 8.0   | 2936  | 0.0983          | 0.9698    | 0.9662 | 0.9680 | 0.9877   |
+| 0.0154        | 9.0   | 3303  | 0.0958          | 0.9589    | 0.9649 | 0.9619 | 0.9867   |
+| 0.0145        | 10.0  | 3670  | 0.1168          | 0.9614    | 0.9674 | 0.9644 | 0.9861   |
+| 0.0104        | 11.0  | 4037  | 0.1010          | 0.9653    | 0.9762 | 0.9707 | 0.9883   |
+| 0.0104        | 12.0  | 4404  | 0.1306          | 0.9554    | 0.9674 | 0.9614 | 0.9841   |
+| 0.0115        | 13.0  | 4771  | 0.1135          | 0.9540    | 0.9612 | 0.9576 | 0.9855   |
+| 0.0099        | 14.0  | 5138  | 0.0968          | 0.9675    | 0.9699 | 0.9687 | 0.9889   |
+| 0.0066        | 15.0  | 5505  | 0.1148          | 0.9636    | 0.9624 | 0.9630 | 0.9864   |
+| 0.0066        | 16.0  | 5872  | 0.0903          | 0.9650    | 0.9687 | 0.9669 | 0.9894   |
+| 0.0049        | 17.0  | 6239  | 0.1217          | 0.9649    | 0.9649 | 0.9649 | 0.9853   |
+| 0.0049        | 18.0  | 6606  | 0.1147          | 0.9626    | 0.9674 | 0.965  | 0.9865   |
+| 0.0049        | 19.0  | 6973  | 0.1154          | 0.9675    | 0.9712 | 0.9694 | 0.9874   |
+| 0.0022        | 20.0  | 7340  | 0.1007          | 0.9676    | 0.9737 | 0.9706 | 0.9885   |
+| 0.0024        | 21.0  | 7707  | 0.1255          | 0.9687    | 0.9699 | 0.9693 | 0.9877   |
+| 0.0015        | 22.0  | 8074  | 0.1439          | 0.9651    | 0.9699 | 0.9675 | 0.9853   |
+| 0.0015        | 23.0  | 8441  | 0.1346          | 0.9688    | 0.9724 | 0.9706 | 0.9873   |
+| 0.003         | 24.0  | 8808  | 0.1243          | 0.9676    | 0.9724 | 0.97   | 0.9868   |
+| 0.0016        | 25.0  | 9175  | 0.1278          | 0.9640    | 0.9737 | 0.9688 | 0.9874   |
+| 0.0025        | 26.0  | 9542  | 0.1216          | 0.9593    | 0.9737 | 0.9664 | 0.9880   |
+| 0.0025        | 27.0  | 9909  | 0.1290          | 0.9652    | 0.9737 | 0.9694 | 0.9880   |
+| 0.0007        | 28.0  | 10276 | 0.1389          | 0.9613    | 0.9662 | 0.9637 | 0.9861   |
+| 0.0013        | 29.0  | 10643 | 0.1306          | 0.9637    | 0.9662 | 0.9650 | 0.9867   |
+| 0.0015        | 30.0  | 11010 | 0.1452          | 0.9613    | 0.9662 | 0.9637 | 0.9867   |
+| 0.0015        | 31.0  | 11377 | 0.1405          | 0.9673    | 0.9649 | 0.9661 | 0.9861   |
+| 0.0014        | 32.0  | 11744 | 0.1428          | 0.9626    | 0.9674 | 0.965  | 0.9870   |
+| 0.0002        | 33.0  | 12111 | 0.1530          | 0.9650    | 0.9662 | 0.9656 | 0.9867   |
+| 0.0002        | 34.0  | 12478 | 0.1525          | 0.9699    | 0.9687 | 0.9693 | 0.9867   |
+| 0.0006        | 35.0  | 12845 | 0.1372          | 0.9688    | 0.9712 | 0.9700 | 0.9874   |
+| 0.0004        | 36.0  | 13212 | 0.1359          | 0.9689    | 0.9762 | 0.9725 | 0.9885   |
+| 0.0005        | 37.0  | 13579 | 0.1432          | 0.9688    | 0.9737 | 0.9713 | 0.9879   |
+| 0.0005        | 38.0  | 13946 | 0.1443          | 0.9676    | 0.9724 | 0.97   | 0.9876   |
+| 0.0006        | 39.0  | 14313 | 0.1414          | 0.9688    | 0.9724 | 0.9706 | 0.9880   |
+| 0.0005        | 40.0  | 14680 | 0.1511          | 0.9663    | 0.9687 | 0.9675 | 0.9871   |
+| 0.0003        | 41.0  | 15047 | 0.1438          | 0.9639    | 0.9712 | 0.9675 | 0.9873   |
+| 0.0003        | 42.0  | 15414 | 0.1519          | 0.9650    | 0.9687 | 0.9669 | 0.9873   |
+| 0.0001        | 43.0  | 15781 | 0.1580          | 0.9638    | 0.9687 | 0.9662 | 0.9867   |
+| 0.0004        | 44.0  | 16148 | 0.1462          | 0.9650    | 0.9687 | 0.9669 | 0.9868   |
+| 0.0001        | 45.0  | 16515 | 0.1478          | 0.9651    | 0.9699 | 0.9675 | 0.9868   |
+| 0.0001        | 46.0  | 16882 | 0.1461          | 0.9663    | 0.9712 | 0.9688 | 0.9870   |
+| 0.0002        | 47.0  | 17249 | 0.1456          | 0.9663    | 0.9712 | 0.9688 | 0.9870   |
+| 0.0001        | 48.0  | 17616 | 0.1451          | 0.9651    | 0.9712 | 0.9681 | 0.9871   |
+| 0.0001        | 49.0  | 17983 | 0.1456          | 0.9651    | 0.9712 | 0.9681 | 0.9871   |
+| 0.0001        | 50.0  | 18350 | 0.1461          | 0.9651    | 0.9712 | 0.9681 | 0.9873   |
+
+
+### Framework versions
+
+- Transformers 4.48.3
+- Pytorch 2.6.0+cu126
+- Datasets 3.2.0
+- Tokenizers 0.21.0

config.json

@@ -0,0 +1,79 @@
+{
+  "_name_or_path": "google-bert/bert-base-chinese",
+  "architectures": [
+    "BertForTokenClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "directionality": "bidi",
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "O",
+    "1": "B-phone",
+    "2": "I-phone",
+    "3": "E-phone",
+    "4": "B-name",
+    "5": "I-name",
+    "6": "E-name",
+    "7": "S-name",
+    "8": "B-area",
+    "9": "I-area",
+    "10": "E-area",
+    "11": "S-area",
+    "12": "B-sex",
+    "13": "E-sex",
+    "14": "S-sex",
+    "15": "B-wechat",
+    "16": "I-wechat",
+    "17": "E-wechat",
+    "18": "B-age",
+    "19": "I-age",
+    "20": "E-age",
+    "21": "S-age"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "label2id": {
+    "B-age": 18,
+    "B-area": 8,
+    "B-name": 4,
+    "B-phone": 1,
+    "B-sex": 12,
+    "B-wechat": 15,
+    "E-age": 20,
+    "E-area": 10,
+    "E-name": 6,
+    "E-phone": 3,
+    "E-sex": 13,
+    "E-wechat": 17,
+    "I-age": 19,
+    "I-area": 9,
+    "I-name": 5,
+    "I-phone": 2,
+    "I-wechat": 16,
+    "O": 0,
+    "S-age": 21,
+    "S-area": 11,
+    "S-name": 7,
+    "S-sex": 14
+  },
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "pooler_fc_size": 768,
+  "pooler_num_attention_heads": 12,
+  "pooler_num_fc_layers": 3,
+  "pooler_size_per_head": 128,
+  "pooler_type": "first_token_transform",
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.48.3",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 21128
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:827aea98f9f26a3bdcda7be81c9bcf80aa9cfd39ebb7ce2ccb70c20b26d63bac
+size 406799208

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,56 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_lower_case": false,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f11b13ef1af56d399e23912bb77d77fe4739a93cc8ab0a27824ef4fa91df99e
+size 5304