| --- |
| language: en |
| tags: |
| - "distilbert-base-uncased-finetuned-sst-2-english" |
| license: apache-2.0 |
| widget: |
| - text: "Sales Account Manager" |
| example_title: "sales,management,account_management" |
| - text: "Registered Nurse – Medical Surgical l" |
| example_title: "healthcare" |
| - text: "$24/hr | Oil & Gas Accounting Specialist" |
| example_title: "oil_and_gas,accounting,human_resources" |
| --- |
| |
| # Job Classification |
|
|
| This model will predict job leaf class(es) |
|
|
| ## Model description |
|
|
| As above, pre-trained on ```"distilbert-base-uncased-finetuned-sst-2-english"``` |
|
|
| ## Training data |
|
|
| pretrained on RL job data |
|
|
|
|
| ## Evaluation results |
|
|
| When fine-tuned on downstream tasks, this model achieves the following results: |
|
|
| | **Epoch** | **Training Loss** | **Validation Loss** | **F1** | **Roc Auc** | **Accuracy** | |
| |-----------|-------------------|---------------------|----------|-------------|--------------| |
| | 1 | 0.001700 | 0.001172 | 0.889403 | 0.918269 | 0.676408 | |
| | 2 | 0.000800 | 0.000575 | 0.945118 | 0.959073 | 0.827609 | |
| | 3 | 0.000500 | 0.000371 | 0.965682 | 0.975373 | 0.889090 | |
| | 4 | 0.000300 | 0.000265 | 0.975741 | 0.984176 | 0.920520 | |
| | 5 | 0.000200 | 0.000217 | 0.980912 | 0.987641 | 0.938598 | |
| | 6 | 0.000100 | 0.000188 | 0.984096 | 0.989826 | 0.948720 | |
| | 7 | 0.000100 | 0.000174 | 0.986366 | 0.990944 | 0.956243 | |
| | 8 | 0.000100 | 0.000159 | 0.987374 | 0.992371 | 0.960260 | |
| | 9 | 0.000100 | 0.000153 | 0.987939 | 0.992148 | 0.961954 | |
| | 10 | 0.000100 | 0.000152 | 0.988216 | 0.992329 | 0.963293 | |
|
|
|
|