Text Classification
Transformers
TensorBoard
Safetensors
roberta
Generated from Trainer
text-embeddings-inference
Instructions to use xshubhamx/roberta-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use xshubhamx/roberta-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="xshubhamx/roberta-base")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("xshubhamx/roberta-base") model = AutoModelForSequenceClassification.from_pretrained("xshubhamx/roberta-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
End of training
Browse files
README.md
CHANGED
|
@@ -17,21 +17,21 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
This model was trained from scratch on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
-
- Loss: 1.
|
| 21 |
-
- Accuracy: 0.
|
| 22 |
-
- Precision: 0.
|
| 23 |
-
- Recall: 0.
|
| 24 |
-
- Precision Macro: 0.
|
| 25 |
-
- Recall Macro: 0.
|
| 26 |
-
- Macro Fpr: 0.
|
| 27 |
-
- Weighted Fpr: 0.
|
| 28 |
-
- Weighted Specificity: 0.
|
| 29 |
-
- Macro Specificity: 0.
|
| 30 |
-
- Weighted Sensitivity: 0.
|
| 31 |
-
- Macro Sensitivity: 0.
|
| 32 |
-
- F1 Micro: 0.
|
| 33 |
-
- F1 Macro: 0.
|
| 34 |
-
- F1 Weighted: 0.
|
| 35 |
|
| 36 |
## Model description
|
| 37 |
|
|
@@ -63,21 +63,21 @@ The following hyperparameters were used during training:
|
|
| 63 |
|
| 64 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | Precision Macro | Recall Macro | Macro Fpr | Weighted Fpr | Weighted Specificity | Macro Specificity | Weighted Sensitivity | Macro Sensitivity | F1 Micro | F1 Macro | F1 Weighted |
|
| 65 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:---------------:|:------------:|:---------:|:------------:|:--------------------:|:-----------------:|:--------------------:|:-----------------:|:--------:|:--------:|:-----------:|
|
| 66 |
-
|
|
| 67 |
-
|
|
| 68 |
-
|
|
| 69 |
-
|
|
| 70 |
-
|
|
| 71 |
-
|
|
| 72 |
-
|
|
| 73 |
-
|
|
| 74 |
-
|
|
| 75 |
-
|
|
| 76 |
-
| 0.
|
| 77 |
-
| 0.
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
|
| 82 |
|
| 83 |
### Framework versions
|
|
|
|
| 17 |
|
| 18 |
This model was trained from scratch on an unknown dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 1.4960
|
| 21 |
+
- Accuracy: 0.8187
|
| 22 |
+
- Precision: 0.8203
|
| 23 |
+
- Recall: 0.8187
|
| 24 |
+
- Precision Macro: 0.7709
|
| 25 |
+
- Recall Macro: 0.7766
|
| 26 |
+
- Macro Fpr: 0.0161
|
| 27 |
+
- Weighted Fpr: 0.0156
|
| 28 |
+
- Weighted Specificity: 0.9773
|
| 29 |
+
- Macro Specificity: 0.9864
|
| 30 |
+
- Weighted Sensitivity: 0.8187
|
| 31 |
+
- Macro Sensitivity: 0.7766
|
| 32 |
+
- F1 Micro: 0.8187
|
| 33 |
+
- F1 Macro: 0.7673
|
| 34 |
+
- F1 Weighted: 0.8188
|
| 35 |
|
| 36 |
## Model description
|
| 37 |
|
|
|
|
| 63 |
|
| 64 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | Precision Macro | Recall Macro | Macro Fpr | Weighted Fpr | Weighted Specificity | Macro Specificity | Weighted Sensitivity | Macro Sensitivity | F1 Micro | F1 Macro | F1 Weighted |
|
| 65 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:---------------:|:------------:|:---------:|:------------:|:--------------------:|:-----------------:|:--------------------:|:-----------------:|:--------:|:--------:|:-----------:|
|
| 66 |
+
| 1.3582 | 1.0 | 643 | 1.0091 | 0.6871 | 0.6460 | 0.6871 | 0.4145 | 0.4143 | 0.0338 | 0.0315 | 0.9470 | 0.9756 | 0.6871 | 0.4143 | 0.6871 | 0.4011 | 0.6558 |
|
| 67 |
+
| 0.8822 | 2.0 | 1286 | 0.8978 | 0.7227 | 0.7088 | 0.7227 | 0.4656 | 0.5103 | 0.0271 | 0.0267 | 0.9708 | 0.9796 | 0.7227 | 0.5103 | 0.7227 | 0.4745 | 0.7052 |
|
| 68 |
+
| 0.7632 | 3.0 | 1929 | 1.1579 | 0.7351 | 0.7535 | 0.7351 | 0.6166 | 0.5729 | 0.0251 | 0.0251 | 0.9646 | 0.9800 | 0.7351 | 0.5729 | 0.7351 | 0.5561 | 0.7214 |
|
| 69 |
+
| 0.5103 | 4.0 | 2572 | 0.8608 | 0.7901 | 0.8043 | 0.7901 | 0.6758 | 0.6482 | 0.0189 | 0.0186 | 0.9751 | 0.9843 | 0.7901 | 0.6482 | 0.7901 | 0.6239 | 0.7866 |
|
| 70 |
+
| 0.4212 | 5.0 | 3215 | 1.1346 | 0.7668 | 0.7546 | 0.7668 | 0.5721 | 0.5941 | 0.0216 | 0.0213 | 0.9723 | 0.9826 | 0.7668 | 0.5941 | 0.7668 | 0.5717 | 0.7546 |
|
| 71 |
+
| 0.3384 | 6.0 | 3858 | 1.1846 | 0.7870 | 0.8033 | 0.7870 | 0.7459 | 0.7345 | 0.0193 | 0.0190 | 0.9754 | 0.9842 | 0.7870 | 0.7345 | 0.7870 | 0.7302 | 0.7893 |
|
| 72 |
+
| 0.2476 | 7.0 | 4501 | 1.1805 | 0.8125 | 0.8057 | 0.8125 | 0.7293 | 0.7175 | 0.0169 | 0.0162 | 0.9730 | 0.9857 | 0.8125 | 0.7175 | 0.8125 | 0.7214 | 0.8076 |
|
| 73 |
+
| 0.1763 | 8.0 | 5144 | 1.3168 | 0.8009 | 0.8136 | 0.8009 | 0.7409 | 0.7448 | 0.0179 | 0.0174 | 0.9752 | 0.9851 | 0.8009 | 0.7448 | 0.8009 | 0.7378 | 0.8023 |
|
| 74 |
+
| 0.1345 | 9.0 | 5787 | 1.3788 | 0.8133 | 0.8249 | 0.8133 | 0.7776 | 0.7864 | 0.0165 | 0.0161 | 0.9766 | 0.9860 | 0.8133 | 0.7864 | 0.8133 | 0.7718 | 0.8155 |
|
| 75 |
+
| 0.123 | 10.0 | 6430 | 1.4001 | 0.8087 | 0.8132 | 0.8087 | 0.7727 | 0.7841 | 0.0172 | 0.0166 | 0.9755 | 0.9856 | 0.8087 | 0.7841 | 0.8087 | 0.7660 | 0.8081 |
|
| 76 |
+
| 0.0668 | 11.0 | 7073 | 1.4279 | 0.8172 | 0.8155 | 0.8172 | 0.7789 | 0.7834 | 0.0165 | 0.0157 | 0.9747 | 0.9861 | 0.8172 | 0.7834 | 0.8172 | 0.7713 | 0.8143 |
|
| 77 |
+
| 0.0606 | 12.0 | 7716 | 1.5104 | 0.8149 | 0.8186 | 0.8149 | 0.7756 | 0.7845 | 0.0166 | 0.0160 | 0.9757 | 0.9860 | 0.8149 | 0.7845 | 0.8149 | 0.7701 | 0.8153 |
|
| 78 |
+
| 0.0396 | 13.0 | 8359 | 1.4985 | 0.8156 | 0.8163 | 0.8156 | 0.7824 | 0.7854 | 0.0165 | 0.0159 | 0.9759 | 0.9861 | 0.8156 | 0.7854 | 0.8156 | 0.7748 | 0.8143 |
|
| 79 |
+
| 0.0191 | 14.0 | 9002 | 1.5025 | 0.8172 | 0.8199 | 0.8172 | 0.7659 | 0.7763 | 0.0162 | 0.0157 | 0.9776 | 0.9863 | 0.8172 | 0.7763 | 0.8172 | 0.7660 | 0.8178 |
|
| 80 |
+
| 0.013 | 15.0 | 9645 | 1.4960 | 0.8187 | 0.8203 | 0.8187 | 0.7709 | 0.7766 | 0.0161 | 0.0156 | 0.9773 | 0.9864 | 0.8187 | 0.7766 | 0.8187 | 0.7673 | 0.8188 |
|
| 81 |
|
| 82 |
|
| 83 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 498652812
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ca2aa89e3bcccac0dcdd6ab9427083c343ea41268446f41859ab3882c5fee36
|
| 3 |
size 498652812
|
runs/Apr14_03-57-02_3e1d3a604afe/events.out.tfevents.1713067023.3e1d3a604afe.34.4
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4be1d9a6ec665752859f622c2c202aee4ebbb67317bcf10bb9fbac82eff99c39
|
| 3 |
+
size 25605
|