File size: 1,861 Bytes
95a35a9
4b13037
eabdb8e
b7f0657
eabdb8e
95a35a9
26bdbbe
b7f0657
26bdbbe
bdf4fbf
26bdbbe
 
4b13037
eabdb8e
4b13037
 
26bdbbe
4b13037
 
 
b7f0657
4b13037
 
 
 
 
 
 
 
 
 
26bdbbe
ec66b4d
26bdbbe
 
 
 
 
 
 
 
 
 
eabdb8e
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
---
language: en
tags:
- "distilbert-base-uncased-finetuned-sst-2-english"
license: apache-2.0
widget:
- text: "Sales Account Manager"
  example_title: "sales,management,account_management"
- text: "Registered Nurse – Medical Surgical l"
  example_title: "healthcare"
- text: "$24/hr | Oil & Gas Accounting Specialist"  
  example_title: "oil_and_gas,accounting,human_resources"	
---

# Job Classification

This model will predict job leaf class(es) 

## Model description

As above, pre-trained on ```"distilbert-base-uncased-finetuned-sst-2-english"```

## Training data

pretrained on RL job data


## Evaluation results

When fine-tuned on downstream tasks, this model achieves the following results:

| **Epoch** | **Training Loss** | **Validation Loss** | **F1**   | **Roc Auc** | **Accuracy** |
|-----------|-------------------|---------------------|----------|-------------|--------------|
| 1         | 0.001700          | 0.001172            | 0.889403 | 0.918269    | 0.676408     |
| 2         | 0.000800          | 0.000575            | 0.945118 | 0.959073    | 0.827609     |
| 3         | 0.000500          | 0.000371            | 0.965682 | 0.975373    | 0.889090     |
| 4         | 0.000300          | 0.000265            | 0.975741 | 0.984176    | 0.920520     |
| 5         | 0.000200          | 0.000217            | 0.980912 | 0.987641    | 0.938598     |
| 6         | 0.000100          | 0.000188            | 0.984096 | 0.989826    | 0.948720     |
| 7         | 0.000100          | 0.000174            | 0.986366 | 0.990944    | 0.956243     |
| 8         | 0.000100          | 0.000159            | 0.987374 | 0.992371    | 0.960260     |
| 9         | 0.000100          | 0.000153            | 0.987939 | 0.992148    | 0.961954     |
| 10        | 0.000100          | 0.000152            | 0.988216 | 0.992329    | 0.963293     |