Overview of v8

One of the major changes in this model update was the modification of the training dataset for the NORMAL_TEXT label. We removed News articles from the dataset, which has contributed to the enhanced performance of the model.

Model Improvements

The model's accuracy now stands at 0.8376, precision at 0.8744, and recall at 0.8376. The F1-score, a measure of the model's accuracy considering both precision and recall, is now 0.8478. The evaluation loss, a measure of the difference between the model's predictions and the actual values, has been reduced to 0.5616, indicating an improvement in the model's performance. During the evaluation, the model was able to process approximately 101.886 samples per second. The total runtime of the evaluation was 855.4327 seconds, with the model performing approximately 0.796 evaluation steps per second.