Update README.md
Browse files
README.md
CHANGED
|
@@ -48,6 +48,14 @@ torch.Size([1, 27, 768])
|
|
| 48 |
|
| 49 |
```
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
### Training hyperparameters
|
| 52 |
|
| 53 |
The following hyperparameters were used during training:
|
|
|
|
| 48 |
|
| 49 |
```
|
| 50 |
|
| 51 |
+
|
| 52 |
+
# Citation
|
| 53 |
+
If you're using CyBERTuned please cite the following paper:
|
| 54 |
+
|
| 55 |
+
```
|
| 56 |
+
Eugene Jang, Jian Cui, Dayeon Yim, Youngjin Jin, Jin-Woo Chung, Seungwon Shin, and Yongjae Lee. 2024. Ignore Me But Don’t Replace Me: Utilizing Non-Linguistic Elements for Pretraining on the Cybersecurity Domain. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 29–42, Mexico City, Mexico. Association for Computational Linguistics.
|
| 57 |
+
```
|
| 58 |
+
|
| 59 |
### Training hyperparameters
|
| 60 |
|
| 61 |
The following hyperparameters were used during training:
|