Retrain from scratch on dataset 4 (notebook pipeline)

README.md

@@ -0,0 +1,33 @@
+---
+license: mit
+language: en
+pipeline_tag: token-classification
+tags:
+- ner
+- resume-parsing
+- cv-parser
+base_model: roberta-base
+---
+
+# CV Parser NER — roberta-base (v2)
+
+Token-classification model that extracts **Job Titles**, **Skills**, and
+**Education** from resumes/CVs using a BIO tag scheme.
+
+## Provenance
+- **Trained from scratch on dataset 4** (`resume_bio_annotated_full.csv`,
+  2,483 resumes — 1,739 train / 372 val / 372 test), the team's finalized
+  AI-Studio/Vertex-relabelled dataset.
+- Reproduced end-to-end with the project notebooks/scripts
+  (`retokenize.py` + `train_bert_run.py`).
+- Base model: `roberta-base` · epochs: 5 · learning rate: 3e-5 ·
+  max_length 512 · stride 128 · seed 42.
+
+## Resume-level performance (dataset-4 splits)
+| split | precision | recall | F1 |
+|-------|-----------|--------|----|
+| validation | — | — | 0.6397 |
+| test       | — | — | 0.6563 |
+
+## Labels
+`O, B-JOB_TITLE, I-JOB_TITLE, B-SKILL, I-SKILL, B-EDUCATION, I-EDUCATION`

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a113d6dd0296fbbcb9f6f0011fba69fae471e0f5be3bdfa958002be67bc08c8d
+oid sha256:15966e2ea940bd56fbaa92d2935d2c102cafd4706e75afc990bfcad8163d2ae1
 size 496265620

special_tokens_map.json

@@ -1,7 +1,25 @@
 {
-  "bos_token": "<s>",
-  "cls_token": "<s>",
-  "eos_token": "</s>",
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
   "mask_token": {
     "content": "<mask>",
     "lstrip": true,
@@ -9,7 +27,25 @@
     "rstrip": false,
     "single_word": false
   },
-  "pad_token": "<pad>",
-  "sep_token": "</s>",
-  "unk_token": "<unk>"
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  }
 }