Text Classification
Transformers
Safetensors
distilbert
Generated from Trainer
text-embeddings-inference
Instructions to use tinutmap/categor_ai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use tinutmap/categor_ai with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="tinutmap/categor_ai")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("tinutmap/categor_ai") model = AutoModelForSequenceClassification.from_pretrained("tinutmap/categor_ai", device_map="auto") - Notebooks
- Google Colab
- Kaggle
End of training
Browse files- README.md +103 -23
- model.safetensors +1 -1
README.md
CHANGED
|
@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
-
- Loss: 0.
|
| 21 |
-
- Accuracy: 0.
|
| 22 |
|
| 23 |
## Model description
|
| 24 |
|
|
@@ -43,32 +43,112 @@ The following hyperparameters were used during training:
|
|
| 43 |
- seed: 42
|
| 44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 45 |
- lr_scheduler_type: linear
|
| 46 |
-
- num_epochs:
|
| 47 |
|
| 48 |
### Training results
|
| 49 |
|
| 50 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 51 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
| 52 |
-
| No log | 1.0 | 13 | 2.
|
| 53 |
-
| No log | 2.0 | 26 | 2.
|
| 54 |
-
| No log | 3.0 | 39 | 1.
|
| 55 |
-
| No log | 4.0 | 52 | 1.
|
| 56 |
-
| No log | 5.0 | 65 | 1.
|
| 57 |
-
| No log | 6.0 | 78 | 1.
|
| 58 |
-
| No log | 7.0 | 91 |
|
| 59 |
-
| No log | 8.0 | 104 | 0.
|
| 60 |
-
| No log | 9.0 | 117 | 0.
|
| 61 |
-
| No log | 10.0 | 130 | 0.
|
| 62 |
-
| No log | 11.0 | 143 | 0.
|
| 63 |
-
| No log | 12.0 | 156 | 0.
|
| 64 |
-
| No log | 13.0 | 169 | 0.
|
| 65 |
-
| No log | 14.0 | 182 | 0.
|
| 66 |
-
| No log | 15.0 | 195 | 0.
|
| 67 |
-
| No log | 16.0 | 208 | 0.
|
| 68 |
-
| No log | 17.0 | 221 | 0.
|
| 69 |
-
| No log | 18.0 | 234 | 0.
|
| 70 |
-
| No log | 19.0 | 247 | 0.
|
| 71 |
-
| No log | 20.0 | 260 | 0.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 72 |
|
| 73 |
|
| 74 |
### Framework versions
|
|
|
|
| 17 |
|
| 18 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
| 19 |
It achieves the following results on the evaluation set:
|
| 20 |
+
- Loss: 0.5024
|
| 21 |
+
- Accuracy: 0.8778
|
| 22 |
|
| 23 |
## Model description
|
| 24 |
|
|
|
|
| 43 |
- seed: 42
|
| 44 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 45 |
- lr_scheduler_type: linear
|
| 46 |
+
- num_epochs: 100
|
| 47 |
|
| 48 |
### Training results
|
| 49 |
|
| 50 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
| 51 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
| 52 |
+
| No log | 1.0 | 13 | 2.3799 | 0.4556 |
|
| 53 |
+
| No log | 2.0 | 26 | 2.0506 | 0.6889 |
|
| 54 |
+
| No log | 3.0 | 39 | 1.7473 | 0.7778 |
|
| 55 |
+
| No log | 4.0 | 52 | 1.4873 | 0.7889 |
|
| 56 |
+
| No log | 5.0 | 65 | 1.2484 | 0.7778 |
|
| 57 |
+
| No log | 6.0 | 78 | 1.0468 | 0.8444 |
|
| 58 |
+
| No log | 7.0 | 91 | 0.9031 | 0.8444 |
|
| 59 |
+
| No log | 8.0 | 104 | 0.7793 | 0.8556 |
|
| 60 |
+
| No log | 9.0 | 117 | 0.7284 | 0.8444 |
|
| 61 |
+
| No log | 10.0 | 130 | 0.6379 | 0.8333 |
|
| 62 |
+
| No log | 11.0 | 143 | 0.5547 | 0.8556 |
|
| 63 |
+
| No log | 12.0 | 156 | 0.5551 | 0.8556 |
|
| 64 |
+
| No log | 13.0 | 169 | 0.4907 | 0.8556 |
|
| 65 |
+
| No log | 14.0 | 182 | 0.5155 | 0.8556 |
|
| 66 |
+
| No log | 15.0 | 195 | 0.4732 | 0.8667 |
|
| 67 |
+
| No log | 16.0 | 208 | 0.4599 | 0.8667 |
|
| 68 |
+
| No log | 17.0 | 221 | 0.4919 | 0.8556 |
|
| 69 |
+
| No log | 18.0 | 234 | 0.4649 | 0.8667 |
|
| 70 |
+
| No log | 19.0 | 247 | 0.4718 | 0.8778 |
|
| 71 |
+
| No log | 20.0 | 260 | 0.4769 | 0.8667 |
|
| 72 |
+
| No log | 21.0 | 273 | 0.4732 | 0.8556 |
|
| 73 |
+
| No log | 22.0 | 286 | 0.4587 | 0.8556 |
|
| 74 |
+
| No log | 23.0 | 299 | 0.4615 | 0.8667 |
|
| 75 |
+
| No log | 24.0 | 312 | 0.4694 | 0.8667 |
|
| 76 |
+
| No log | 25.0 | 325 | 0.4666 | 0.8667 |
|
| 77 |
+
| No log | 26.0 | 338 | 0.4916 | 0.8556 |
|
| 78 |
+
| No log | 27.0 | 351 | 0.4907 | 0.8556 |
|
| 79 |
+
| No log | 28.0 | 364 | 0.4886 | 0.8667 |
|
| 80 |
+
| No log | 29.0 | 377 | 0.4891 | 0.8667 |
|
| 81 |
+
| No log | 30.0 | 390 | 0.4811 | 0.8667 |
|
| 82 |
+
| No log | 31.0 | 403 | 0.4628 | 0.8667 |
|
| 83 |
+
| No log | 32.0 | 416 | 0.4755 | 0.8667 |
|
| 84 |
+
| No log | 33.0 | 429 | 0.4687 | 0.8667 |
|
| 85 |
+
| No log | 34.0 | 442 | 0.4633 | 0.8667 |
|
| 86 |
+
| No log | 35.0 | 455 | 0.4734 | 0.8667 |
|
| 87 |
+
| No log | 36.0 | 468 | 0.4750 | 0.8556 |
|
| 88 |
+
| No log | 37.0 | 481 | 0.4763 | 0.8667 |
|
| 89 |
+
| No log | 38.0 | 494 | 0.4648 | 0.8667 |
|
| 90 |
+
| 0.4152 | 39.0 | 507 | 0.4881 | 0.8556 |
|
| 91 |
+
| 0.4152 | 40.0 | 520 | 0.4587 | 0.8778 |
|
| 92 |
+
| 0.4152 | 41.0 | 533 | 0.4781 | 0.8556 |
|
| 93 |
+
| 0.4152 | 42.0 | 546 | 0.4622 | 0.8778 |
|
| 94 |
+
| 0.4152 | 43.0 | 559 | 0.4885 | 0.8667 |
|
| 95 |
+
| 0.4152 | 44.0 | 572 | 0.4898 | 0.8667 |
|
| 96 |
+
| 0.4152 | 45.0 | 585 | 0.4959 | 0.8667 |
|
| 97 |
+
| 0.4152 | 46.0 | 598 | 0.4911 | 0.8667 |
|
| 98 |
+
| 0.4152 | 47.0 | 611 | 0.4795 | 0.8667 |
|
| 99 |
+
| 0.4152 | 48.0 | 624 | 0.4869 | 0.8667 |
|
| 100 |
+
| 0.4152 | 49.0 | 637 | 0.4937 | 0.8667 |
|
| 101 |
+
| 0.4152 | 50.0 | 650 | 0.4954 | 0.8667 |
|
| 102 |
+
| 0.4152 | 51.0 | 663 | 0.4992 | 0.8667 |
|
| 103 |
+
| 0.4152 | 52.0 | 676 | 0.5022 | 0.8667 |
|
| 104 |
+
| 0.4152 | 53.0 | 689 | 0.4891 | 0.8778 |
|
| 105 |
+
| 0.4152 | 54.0 | 702 | 0.5037 | 0.8667 |
|
| 106 |
+
| 0.4152 | 55.0 | 715 | 0.5084 | 0.8667 |
|
| 107 |
+
| 0.4152 | 56.0 | 728 | 0.5007 | 0.8667 |
|
| 108 |
+
| 0.4152 | 57.0 | 741 | 0.4938 | 0.8778 |
|
| 109 |
+
| 0.4152 | 58.0 | 754 | 0.4899 | 0.8778 |
|
| 110 |
+
| 0.4152 | 59.0 | 767 | 0.4952 | 0.8667 |
|
| 111 |
+
| 0.4152 | 60.0 | 780 | 0.4916 | 0.8778 |
|
| 112 |
+
| 0.4152 | 61.0 | 793 | 0.4947 | 0.8778 |
|
| 113 |
+
| 0.4152 | 62.0 | 806 | 0.4890 | 0.8778 |
|
| 114 |
+
| 0.4152 | 63.0 | 819 | 0.4863 | 0.8778 |
|
| 115 |
+
| 0.4152 | 64.0 | 832 | 0.4887 | 0.8778 |
|
| 116 |
+
| 0.4152 | 65.0 | 845 | 0.4946 | 0.8778 |
|
| 117 |
+
| 0.4152 | 66.0 | 858 | 0.4961 | 0.8778 |
|
| 118 |
+
| 0.4152 | 67.0 | 871 | 0.4947 | 0.8778 |
|
| 119 |
+
| 0.4152 | 68.0 | 884 | 0.4940 | 0.8778 |
|
| 120 |
+
| 0.4152 | 69.0 | 897 | 0.4927 | 0.8778 |
|
| 121 |
+
| 0.4152 | 70.0 | 910 | 0.4930 | 0.8667 |
|
| 122 |
+
| 0.4152 | 71.0 | 923 | 0.4998 | 0.8778 |
|
| 123 |
+
| 0.4152 | 72.0 | 936 | 0.5011 | 0.8778 |
|
| 124 |
+
| 0.4152 | 73.0 | 949 | 0.5031 | 0.8778 |
|
| 125 |
+
| 0.4152 | 74.0 | 962 | 0.5045 | 0.8778 |
|
| 126 |
+
| 0.4152 | 75.0 | 975 | 0.5020 | 0.8778 |
|
| 127 |
+
| 0.4152 | 76.0 | 988 | 0.5015 | 0.8778 |
|
| 128 |
+
| 0.0244 | 77.0 | 1001 | 0.5006 | 0.8778 |
|
| 129 |
+
| 0.0244 | 78.0 | 1014 | 0.5018 | 0.8778 |
|
| 130 |
+
| 0.0244 | 79.0 | 1027 | 0.5059 | 0.8778 |
|
| 131 |
+
| 0.0244 | 80.0 | 1040 | 0.5056 | 0.8778 |
|
| 132 |
+
| 0.0244 | 81.0 | 1053 | 0.5033 | 0.8778 |
|
| 133 |
+
| 0.0244 | 82.0 | 1066 | 0.5048 | 0.8778 |
|
| 134 |
+
| 0.0244 | 83.0 | 1079 | 0.5036 | 0.8778 |
|
| 135 |
+
| 0.0244 | 84.0 | 1092 | 0.5043 | 0.8778 |
|
| 136 |
+
| 0.0244 | 85.0 | 1105 | 0.5069 | 0.8778 |
|
| 137 |
+
| 0.0244 | 86.0 | 1118 | 0.5073 | 0.8778 |
|
| 138 |
+
| 0.0244 | 87.0 | 1131 | 0.5049 | 0.8778 |
|
| 139 |
+
| 0.0244 | 88.0 | 1144 | 0.5026 | 0.8778 |
|
| 140 |
+
| 0.0244 | 89.0 | 1157 | 0.5027 | 0.8778 |
|
| 141 |
+
| 0.0244 | 90.0 | 1170 | 0.5040 | 0.8778 |
|
| 142 |
+
| 0.0244 | 91.0 | 1183 | 0.5041 | 0.8778 |
|
| 143 |
+
| 0.0244 | 92.0 | 1196 | 0.5029 | 0.8778 |
|
| 144 |
+
| 0.0244 | 93.0 | 1209 | 0.5027 | 0.8778 |
|
| 145 |
+
| 0.0244 | 94.0 | 1222 | 0.5023 | 0.8778 |
|
| 146 |
+
| 0.0244 | 95.0 | 1235 | 0.5023 | 0.8778 |
|
| 147 |
+
| 0.0244 | 96.0 | 1248 | 0.5024 | 0.8778 |
|
| 148 |
+
| 0.0244 | 97.0 | 1261 | 0.5028 | 0.8778 |
|
| 149 |
+
| 0.0244 | 98.0 | 1274 | 0.5027 | 0.8778 |
|
| 150 |
+
| 0.0244 | 99.0 | 1287 | 0.5025 | 0.8778 |
|
| 151 |
+
| 0.0244 | 100.0 | 1300 | 0.5024 | 0.8778 |
|
| 152 |
|
| 153 |
|
| 154 |
### Framework versions
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 267872556
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d95b91d86ec0af80be75b1a65209b865107d57bf31d493a98c300d6ee8d1e7e1
|
| 3 |
size 267872556
|