Kl1en3ver/cv-job-classifier

README.md

@@ -0,0 +1,73 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: distilbert-base-uncased
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+- precision
+- recall
+model-index:
+- name: checkpoints
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# checkpoints
+
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.2531
+- Accuracy: 0.8663
+- F1: 0.8484
+- Precision: 0.8453
+- Recall: 0.8572
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 200
+- num_epochs: 5
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| No log        | 1.0   | 380  | 1.6631          | 0.7684   | 0.7529 | 0.7712    | 0.7652 |
+| 2.4099        | 2.0   | 760  | 1.3388          | 0.8217   | 0.8075 | 0.8006    | 0.8296 |
+| 1.2523        | 3.0   | 1140 | 1.3015          | 0.8454   | 0.8348 | 0.8357    | 0.8448 |
+| 1.0863        | 4.0   | 1520 | 1.2908          | 0.8513   | 0.8387 | 0.8355    | 0.8500 |
+| 1.0863        | 5.0   | 1900 | 1.2800          | 0.8579   | 0.8457 | 0.8421    | 0.8552 |
+
+
+### Framework versions
+
+- Transformers 5.0.0
+- Pytorch 2.10.0+cu128
+- Datasets 4.0.0
+- Tokenizers 0.22.2

config.json

@@ -0,0 +1,79 @@
+{
+  "activation": "gelu",
+  "architectures": [
+    "DistilBertForSequenceClassification"
+  ],
+  "attention_dropout": 0.1,
+  "bos_token_id": null,
+  "dim": 768,
+  "dropout": 0.1,
+  "dtype": "float32",
+  "eos_token_id": null,
+  "hidden_dim": 3072,
+  "id2label": {
+    "0": "ACCOUNTANT",
+    "1": "ADVOCATE",
+    "2": "AGRICULTURE",
+    "3": "APPAREL",
+    "4": "ARTS",
+    "5": "AUTOMOBILE",
+    "6": "AVIATION",
+    "7": "BANKING",
+    "8": "BPO",
+    "9": "BUSINESS-DEVELOPMENT",
+    "10": "CHEF",
+    "11": "CONSTRUCTION",
+    "12": "CONSULTANT",
+    "13": "DESIGNER",
+    "14": "DIGITAL-MEDIA",
+    "15": "ENGINEERING",
+    "16": "FINANCE",
+    "17": "FITNESS",
+    "18": "HEALTHCARE",
+    "19": "HR",
+    "20": "INFORMATION-TECHNOLOGY",
+    "21": "PUBLIC-RELATIONS",
+    "22": "SALES",
+    "23": "TEACHER"
+  },
+  "initializer_range": 0.02,
+  "label2id": {
+    "ACCOUNTANT": 0,
+    "ADVOCATE": 1,
+    "AGRICULTURE": 2,
+    "APPAREL": 3,
+    "ARTS": 4,
+    "AUTOMOBILE": 5,
+    "AVIATION": 6,
+    "BANKING": 7,
+    "BPO": 8,
+    "BUSINESS-DEVELOPMENT": 9,
+    "CHEF": 10,
+    "CONSTRUCTION": 11,
+    "CONSULTANT": 12,
+    "DESIGNER": 13,
+    "DIGITAL-MEDIA": 14,
+    "ENGINEERING": 15,
+    "FINANCE": 16,
+    "FITNESS": 17,
+    "HEALTHCARE": 18,
+    "HR": 19,
+    "INFORMATION-TECHNOLOGY": 20,
+    "PUBLIC-RELATIONS": 21,
+    "SALES": 22,
+    "TEACHER": 23
+  },
+  "max_position_embeddings": 512,
+  "model_type": "distilbert",
+  "n_heads": 12,
+  "n_layers": 6,
+  "pad_token_id": 0,
+  "qa_dropout": 0.1,
+  "seq_classif_dropout": 0.2,
+  "sinusoidal_pos_embds": false,
+  "tie_weights_": true,
+  "tie_word_embeddings": true,
+  "transformers_version": "5.0.0",
+  "use_cache": false,
+  "vocab_size": 30522
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:048971045cd89c6127b8283b1839a787346cfa8ee223609bc5cca8eb54c0d826
+size 267900240

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e5bd8c632134435094962c9977b12c5933bdd4c617e338629d8e5ddf9a486ca
+size 5201