Update README.md
Browse files
README.md
CHANGED
|
@@ -28,9 +28,9 @@ widget:
|
|
| 28 |
|
| 29 |
# SecureBERT+
|
| 30 |
|
| 31 |
-
**SecureBERT+** is an enhanced version of [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT), trained on a corpus **
|
| 32 |
|
| 33 |
-
This model delivers an **average
|
| 34 |
|
| 35 |
---
|
| 36 |
|
|
|
|
| 28 |
|
| 29 |
# SecureBERT+
|
| 30 |
|
| 31 |
+
**SecureBERT+** is an enhanced version of [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT), trained on a corpus **five times larger** than its predecessor and leveraging the computational power of **8×A100 GPUs**.
|
| 32 |
|
| 33 |
+
This model delivers an **average 6% improvement** in Masked Language Modeling (MLM) performance compared to SecureBERT, representing a significant advancement in language understanding and representation within the cybersecurity domain.
|
| 34 |
|
| 35 |
---
|
| 36 |
|