Update README.md
Browse files
README.md
CHANGED
|
@@ -56,6 +56,18 @@ The model returns a list containing a single classification result with the pred
|
|
| 56 |
- `LABEL_0`: The text is not a valid task statement.
|
| 57 |
- `LABEL_1`: The text is a task statement.
|
| 58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
## Citation
|
| 60 |
|
| 61 |
If you find this model useful in your work, please consider citing:
|
|
|
|
| 56 |
- `LABEL_0`: The text is not a valid task statement.
|
| 57 |
- `LABEL_1`: The text is a task statement.
|
| 58 |
|
| 59 |
+
|
| 60 |
+
## Evaluation
|
| 61 |
+
|
| 62 |
+
The performance of ``task-classifier-mini-v3`` was evaluated against the previous iteration (`task-classifier-mini-improved2`) using the [loyoladatamining/usajobs_validation](https://huggingface.co/datasets/loyoladatamining/usajobs_validation) dataset.
|
| 63 |
+
|
| 64 |
+
This model demonstrates a significant improvement across on the task portion of the validation set:
|
| 65 |
+
|
| 66 |
+
| Model | Accuracy | F1 |
|
| 67 |
+
| :--- | :---: | :---: |
|
| 68 |
+
| [task-classifier-mini-improved2](https://huggingface.co/loyoladatamining/task-classifier-mini-improved2) | 0.8358 | 0.8253 |
|
| 69 |
+
| **[task-classifier-mini-v3](https://huggingface.co/loyoladatamining/task-classifier-mini-v3)** | **0.9583** | **0.9585** |
|
| 70 |
+
|
| 71 |
## Citation
|
| 72 |
|
| 73 |
If you find this model useful in your work, please consider citing:
|