Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,38 @@ language:
|
|
| 4 |
base_model:
|
| 5 |
- google-bert/bert-base-uncased
|
| 6 |
pipeline_tag: text-classification
|
| 7 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
base_model:
|
| 5 |
- google-bert/bert-base-uncased
|
| 6 |
pipeline_tag: text-classification
|
| 7 |
+
---
|
| 8 |
+
# CBSI-BERT Models
|
| 9 |
+
|
| 10 |
+
This model is trained on the replication data of [Nițoi et al. (2023)](https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/40JFEK).
|
| 11 |
+
Check out their [paper](https://www.sciencedirect.com/science/article/abs/pii/S2214635023000230) and [website](https://sites.google.com/view/bert-cbsi/) for more information.
|
| 12 |
+
|
| 13 |
+
The model is trained with the hyperparameters used by [Nițoi et al. (2023)](https://www.sciencedirect.com/science/article/abs/pii/S2214635023000230).
|
| 14 |
+
In addition, different hyperparameters, seeds, and reinitialization of the first L layers were tested. The performance seems relatively stable across hyperparameter settings.
|
| 15 |
+
|
| 16 |
+
Alongside these models, FinBERT, different versions of RoBERTa, and EconBERT were tested. The performance of the BERT-based models reported here is significantly better.
|
| 17 |
+
|
| 18 |
+
## Results
|
| 19 |
+
|
| 20 |
+
| Model | F1 Score | Accuracy | Loss |
|
| 21 |
+
|------------------------------------------------------------------------|----------|----------|------|
|
| 22 |
+
| [CBSI-bert-base-uncased](https://huggingface.co/brjoey/CBSI-bert-base-uncased) | 0.88 | 0.88 | 0.49 |
|
| 23 |
+
| [CBSI-bert-large-uncased](https://huggingface.co/brjoey/CBSI-bert-large-uncased) | 0.92 | 0.92 | 0.45 |
|
| 24 |
+
|
| 25 |
+
## How to use
|
| 26 |
+
|
| 27 |
+
```python
|
| 28 |
+
```
|
| 29 |
+
---
|
| 30 |
+
# Citation
|
| 31 |
+
If you use this model, please cite: \
|
| 32 |
+
Data:\
|
| 33 |
+
Nițoi Mihai; Pochea Maria-Miruna; Radu Ștefan-Constantin, 2023, \
|
| 34 |
+
"Replication Data for: Unveiling the sentiment behind central bank narratives: A novel deep learning index", \
|
| 35 |
+
https://doi.org/10.7910/DVN/40JFEK, Harvard Dataverse, V1
|
| 36 |
+
|
| 37 |
+
Model / Paper: \
|
| 38 |
+
Mihai Niţoi, Maria-Miruna Pochea, Ştefan-Constantin Radu, \
|
| 39 |
+
Unveiling the sentiment behind central bank narratives: A novel deep learning index, \
|
| 40 |
+
Journal of Behavioral and Experimental Finance, Volume 38, 2023, 100809, ISSN 2214-6350. \
|
| 41 |
+
https://doi.org/10.1016/j.jbef.2023.100809
|