Hugging Face's logo

HamidBekam
/
g-patentsbertav2-e2e

Text Classification
Transformers
TensorBoard
Safetensors
mpnet
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
HamidBekam commited on
Commit
973c09e
·
verified ·
1 Parent(s): 58e7fb2

Fine-tuned mpnet-base for patent-claim binary classification MPNetv2

Browse files
Files changed (2) hide show
  1. README.md +33 -34
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,7 +1,6 @@
1
  ---
2
  library_name: transformers
3
- license: apache-2.0
4
- base_model: sentence-transformers/all-mpnet-base-v2
5
  tags:
6
  - generated_from_trainer
7
  metrics:
@@ -19,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  # g-patentsbertav2-e2e
21
 
22
- This model is a fine-tuned version of [sentence-transformers/all-mpnet-base-v2](https://huggingface.co/sentence-transformers/all-mpnet-base-v2) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.4387
25
- - Accuracy: 0.8371
26
- - Precision: 0.2972
27
- - Recall: 0.8459
28
- - F1: 0.4399
29
 
30
  ## Model description
31
 
@@ -58,32 +57,32 @@ The following hyperparameters were used during training:
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
60
  |:-------------:|:------:|:-----:|:---------------:|:--------:|:---------:|:------:|:------:|
61
- | 0.4401 | 0.1866 | 2000 | 0.4557 | 0.7894 | 0.7523 | 0.8519 | 0.7990 |
62
- | 0.4181 | 0.3731 | 4000 | 0.4274 | 0.8087 | 0.8607 | 0.7286 | 0.7892 |
63
- | 0.4080 | 0.5597 | 6000 | 0.4020 | 0.8175 | 0.7987 | 0.8406 | 0.8191 |
64
- | 0.3969 | 0.7463 | 8000 | 0.4103 | 0.8213 | 0.8173 | 0.8197 | 0.8185 |
65
- | 0.3874 | 0.9328 | 10000 | 0.3896 | 0.8246 | 0.8018 | 0.8544 | 0.8272 |
66
- | 0.3614 | 1.1194 | 12000 | 0.4005 | 0.8284 | 0.8151 | 0.8417 | 0.8282 |
67
- | 0.3517 | 1.3060 | 14000 | 0.4018 | 0.8260 | 0.7995 | 0.8620 | 0.8296 |
68
- | 0.3470 | 1.4925 | 16000 | 0.4015 | 0.8312 | 0.8065 | 0.8636 | 0.8341 |
69
- | 0.3774 | 1.6791 | 18000 | 0.3919 | 0.8347 | 0.8587 | 0.7944 | 0.8253 |
70
- | 0.3593 | 1.8657 | 20000 | 0.3715 | 0.8430 | 0.8469 | 0.8307 | 0.8387 |
71
- | 0.3198 | 2.0522 | 22000 | 0.3839 | 0.8405 | 0.8289 | 0.8510 | 0.8398 |
72
- | 0.2912 | 2.2388 | 24000 | 0.4009 | 0.8337 | 0.8008 | 0.8807 | 0.8389 |
73
- | 0.2953 | 2.4254 | 26000 | 0.4144 | 0.8397 | 0.8334 | 0.8422 | 0.8378 |
74
- | 0.3261 | 2.6119 | 28000 | 0.3815 | 0.8409 | 0.8194 | 0.8674 | 0.8428 |
75
- | 0.3158 | 2.7985 | 30000 | 0.3827 | 0.8448 | 0.8336 | 0.8548 | 0.8441 |
76
- | 0.2791 | 2.9851 | 32000 | 0.4061 | 0.8431 | 0.8296 | 0.8569 | 0.8430 |
77
- | 0.2507 | 3.1716 | 34000 | 0.4266 | 0.8419 | 0.8256 | 0.8600 | 0.8424 |
78
- | 0.2573 | 3.3582 | 36000 | 0.4363 | 0.8424 | 0.8352 | 0.8463 | 0.8407 |
79
- | 0.2646 | 3.5448 | 38000 | 0.4232 | 0.8428 | 0.8511 | 0.8244 | 0.8375 |
80
- | 0.2435 | 3.7313 | 40000 | 0.4292 | 0.8415 | 0.8505 | 0.8219 | 0.8360 |
81
- | 0.2529 | 3.9179 | 42000 | 0.4354 | 0.8469 | 0.8368 | 0.8553 | 0.8459 |
82
- | 0.2130 | 4.1045 | 44000 | 0.4787 | 0.8417 | 0.8320 | 0.8494 | 0.8406 |
83
- | 0.2134 | 4.2910 | 46000 | 0.4849 | 0.8438 | 0.8446 | 0.8359 | 0.8402 |
84
- | 0.2109 | 4.4776 | 48000 | 0.4941 | 0.8419 | 0.8380 | 0.8408 | 0.8394 |
85
- | 0.1968 | 4.6642 | 50000 | 0.4864 | 0.8435 | 0.8307 | 0.8560 | 0.8431 |
86
- | 0.2075 | 4.8507 | 52000 | 0.5032 | 0.8455 | 0.8350 | 0.8544 | 0.8446 |
87
 
88
 
89
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ base_model: AAUBS/PatentSBERTa_V2
 
4
  tags:
5
  - generated_from_trainer
6
  metrics:
 
18
 
19
  # g-patentsbertav2-e2e
20
 
21
+ This model is a fine-tuned version of [AAUBS/PatentSBERTa_V2](https://huggingface.co/AAUBS/PatentSBERTa_V2) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.4385
24
+ - Accuracy: 0.8350
25
+ - Precision: 0.2942
26
+ - Recall: 0.8453
27
+ - F1: 0.4365
28
 
29
  ## Model description
30
 
 
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
59
  |:-------------:|:------:|:-----:|:---------------:|:--------:|:---------:|:------:|:------:|
60
+ | 0.4397 | 0.1866 | 2000 | 0.4432 | 0.7928 | 0.7523 | 0.8625 | 0.8036 |
61
+ | 0.4168 | 0.3731 | 4000 | 0.4196 | 0.8100 | 0.8480 | 0.7473 | 0.7945 |
62
+ | 0.4098 | 0.5597 | 6000 | 0.4036 | 0.8172 | 0.7941 | 0.8478 | 0.8201 |
63
+ | 0.4003 | 0.7463 | 8000 | 0.4040 | 0.8204 | 0.8322 | 0.7949 | 0.8131 |
64
+ | 0.3876 | 0.9328 | 10000 | 0.3855 | 0.8256 | 0.7981 | 0.8636 | 0.8296 |
65
+ | 0.3634 | 1.1194 | 12000 | 0.4008 | 0.8283 | 0.8099 | 0.8501 | 0.8295 |
66
+ | 0.3531 | 1.3060 | 14000 | 0.3921 | 0.8334 | 0.8050 | 0.8722 | 0.8373 |
67
+ | 0.3448 | 1.4925 | 16000 | 0.3845 | 0.8329 | 0.8110 | 0.8607 | 0.8351 |
68
+ | 0.3741 | 1.6791 | 18000 | 0.3875 | 0.8379 | 0.8525 | 0.8104 | 0.8309 |
69
+ | 0.3558 | 1.8657 | 20000 | 0.3771 | 0.8416 | 0.8416 | 0.8348 | 0.8382 |
70
+ | 0.3137 | 2.0522 | 22000 | 0.3830 | 0.8415 | 0.8304 | 0.8512 | 0.8407 |
71
+ | 0.2852 | 2.2388 | 24000 | 0.4188 | 0.8359 | 0.8102 | 0.8699 | 0.8390 |
72
+ | 0.2933 | 2.4254 | 26000 | 0.4280 | 0.8426 | 0.8333 | 0.8496 | 0.8414 |
73
+ | 0.3250 | 2.6119 | 28000 | 0.3846 | 0.8383 | 0.8162 | 0.8659 | 0.8403 |
74
+ | 0.3087 | 2.7985 | 30000 | 0.3822 | 0.8418 | 0.8313 | 0.8508 | 0.8409 |
75
+ | 0.2794 | 2.9851 | 32000 | 0.3997 | 0.8398 | 0.8267 | 0.8528 | 0.8395 |
76
+ | 0.2409 | 3.1716 | 34000 | 0.4402 | 0.8354 | 0.8198 | 0.8523 | 0.8358 |
77
+ | 0.2451 | 3.3582 | 36000 | 0.4359 | 0.8408 | 0.8340 | 0.8440 | 0.8390 |
78
+ | 0.2557 | 3.5448 | 38000 | 0.4241 | 0.8383 | 0.8382 | 0.8314 | 0.8348 |
79
+ | 0.2409 | 3.7313 | 40000 | 0.4388 | 0.8420 | 0.8482 | 0.8264 | 0.8372 |
80
+ | 0.2493 | 3.9179 | 42000 | 0.4319 | 0.8468 | 0.8357 | 0.8566 | 0.8460 |
81
+ | 0.2013 | 4.1045 | 44000 | 0.4871 | 0.8409 | 0.8329 | 0.8460 | 0.8394 |
82
+ | 0.2074 | 4.2910 | 46000 | 0.4942 | 0.8401 | 0.8373 | 0.8375 | 0.8374 |
83
+ | 0.2205 | 4.4776 | 48000 | 0.5179 | 0.8421 | 0.8388 | 0.8402 | 0.8395 |
84
+ | 0.1912 | 4.6642 | 50000 | 0.4978 | 0.8385 | 0.8274 | 0.8483 | 0.8377 |
85
+ | 0.1933 | 4.8507 | 52000 | 0.5141 | 0.8391 | 0.8238 | 0.8557 | 0.8395 |
86
 
87
 
88
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b30de7ddfb873ad78d5f1851a65be09e9fcec4d3ee12705b64455394804d3d11
3
  size 437975176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b11826874b4b52f5cabf5c1de6ee199c1f86a2565c87b842f07af599dc269524
3
  size 437975176