Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language: en
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
tags:
|
| 5 |
+
- finance
|
| 6 |
+
- esg
|
| 7 |
+
- sentiment-analysis
|
| 8 |
+
- bert
|
| 9 |
+
metrics:
|
| 10 |
+
- f1
|
| 11 |
+
- accuracy
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# finbert_esg_sentiment_classifier
|
| 15 |
+
|
| 16 |
+
## Overview
|
| 17 |
+
This model is a specialized BERT-based classifier fine-tuned for Environmental, Social, and Governance (ESG) sentiment analysis in financial reports. It categorizes text into specific ESG pillars or identifies neutral financial statements.
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
## Model Architecture
|
| 22 |
+
The model utilizes a **BERT-Base-Uncased** backbone with a sequence classification head.
|
| 23 |
+
- **Encoder**: 12-layer Transformer.
|
| 24 |
+
- **Hidden Dimensions**: 768.
|
| 25 |
+
- **Head**: Linear layer followed by Softmax for 4-class categorization.
|
| 26 |
+
- **Optimization**: Trained using the Cross-Entropy loss function:
|
| 27 |
+
$$\mathcal{L} = -\sum_{c=1}^{M} y_{o,c} \ln(p_{o,c})$$
|
| 28 |
+
|
| 29 |
+
## Intended Use
|
| 30 |
+
- **Investment Research**: Automating the extraction of ESG signals from 10-K filings and earnings transcripts.
|
| 31 |
+
- **Compliance**: Monitoring corporate communications for ESG-related disclosures.
|
| 32 |
+
- **Sustainable Finance**: Providing data for ESG scoring algorithms.
|
| 33 |
+
|
| 34 |
+
## Limitations
|
| 35 |
+
- **Context Window**: Restricted to 512 tokens. Long documents must be processed in chunks.
|
| 36 |
+
- **Language**: Optimized for English financial terminology; performance on other languages or casual text is not guaranteed.
|
| 37 |
+
- **Factuality**: Classification is based on linguistic patterns, not external fact-checking of the corporate claims.
|