eskayML/interview_classifier

README.md

@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.5132
-- Accuracy: 0.5128
+- Loss: 0.4205
+- Accuracy: 0.8684
 
 ## Model description
 
@@ -44,17 +44,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
-- num_epochs: 5
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 468  | 1.4160          | 0.4658   |
-| 1.5252        | 2.0   | 936  | 1.2773          | 0.5299   |
-| 1.2542        | 3.0   | 1404 | 1.3040          | 0.5385   |
-| 0.9887        | 4.0   | 1872 | 1.4397          | 0.5299   |
-| 0.7766        | 5.0   | 2340 | 1.5132          | 0.5128   |
+| No log        | 1.0   | 95   | 0.8682          | 0.7105   |
+| No log        | 2.0   | 190  | 0.6114          | 0.7632   |
+| No log        | 3.0   | 285  | 0.5425          | 0.8421   |
+| No log        | 4.0   | 380  | 0.5898          | 0.8421   |
+| No log        | 5.0   | 475  | 0.5797          | 0.8421   |
+| 0.6499        | 6.0   | 570  | 0.5694          | 0.8421   |
+| 0.6499        | 7.0   | 665  | 0.5204          | 0.8421   |
+| 0.6499        | 8.0   | 760  | 0.4596          | 0.8421   |
+| 0.6499        | 9.0   | 855  | 0.4310          | 0.8684   |
+| 0.6499        | 10.0  | 950  | 0.4205          | 0.8684   |
 
 
 ### Framework versions

config.json

@@ -9,23 +9,15 @@
   "dropout": 0.1,
   "hidden_dim": 3072,
   "id2label": {
-    "0": "EXTERNAL ENVIRONMENT",
-    "1": "ORGANIZATIONAL CHARACTERISTICS",
-    "2": "PATIENT CHARACTERISTICS",
-    "3": "IMPLEMENTATION SUSTAINABILITY INFRASTRUCTURE",
-    "4": "CLINICIAN PERSPECTIVE",
-    "5": "PATIENT PERSPECTIVES",
-    "6": "STAFF CHARACTERISTICS"
+    "0": "multi_level_org_char",
+    "1": "multi_level_org_perspect",
+    "2": "impl_sust_infra"
   },
   "initializer_range": 0.02,
   "label2id": {
-    "CLINICIAN PERSPECTIVE": 4,
-    "EXTERNAL ENVIRONMENT": 0,
-    "IMPLEMENTATION SUSTAINABILITY INFRASTRUCTURE": 3,
-    "ORGANIZATIONAL CHARACTERISTICS": 1,
-    "PATIENT CHARACTERISTICS": 2,
-    "PATIENT PERSPECTIVES": 5,
-    "STAFF CHARACTERISTICS": 6
+    "impl_sust_infra": 2,
+    "multi_level_org_char": 0,
+    "multi_level_org_perspect": 1
   },
   "max_position_embeddings": 512,
   "model_type": "distilbert",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c102e0d9508ae4a0a6920b933c1e8a72a94e8deaf94ebdfe8db2ff147b5be991
-size 267847948
+oid sha256:3e8ff202dd05489f7f736a32e68873846680f058d44943090bd6c1eb4a528454
+size 267835644