rosherd/job_classification

Job Classification

This model will predict job leaf class(es)

Model description

As above, pre-trained on "distilbert-base-uncased-finetuned-sst-2-english"

Training data

pretrained on RL job data

Evaluation results

When fine-tuned on downstream tasks, this model achieves the following results:

Epoch	Training Loss	Validation Loss	F1	Roc Auc	Accuracy
1	0.001700	0.001172	0.889403	0.918269	0.676408
2	0.000800	0.000575	0.945118	0.959073	0.827609
3	0.000500	0.000371	0.965682	0.975373	0.889090
4	0.000300	0.000265	0.975741	0.984176	0.920520
5	0.000200	0.000217	0.980912	0.987641	0.938598
6	0.000100	0.000188	0.984096	0.989826	0.948720
7	0.000100	0.000174	0.986366	0.990944	0.956243
8	0.000100	0.000159	0.987374	0.992371	0.960260
9	0.000100	0.000153	0.987939	0.992148	0.961954
10	0.000100	0.000152	0.988216	0.992329	0.963293