Shoriful025 commited on
Commit
c15b5a0
·
verified ·
1 Parent(s): 4d95d9d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: apache-2.0
4
+ tags:
5
+ - finance
6
+ - esg
7
+ - sentiment-analysis
8
+ - bert
9
+ metrics:
10
+ - f1
11
+ - accuracy
12
+ ---
13
+
14
+ # finbert_esg_sentiment_classifier
15
+
16
+ ## Overview
17
+ This model is a specialized BERT-based classifier fine-tuned for Environmental, Social, and Governance (ESG) sentiment analysis in financial reports. It categorizes text into specific ESG pillars or identifies neutral financial statements.
18
+
19
+
20
+
21
+ ## Model Architecture
22
+ The model utilizes a **BERT-Base-Uncased** backbone with a sequence classification head.
23
+ - **Encoder**: 12-layer Transformer.
24
+ - **Hidden Dimensions**: 768.
25
+ - **Head**: Linear layer followed by Softmax for 4-class categorization.
26
+ - **Optimization**: Trained using the Cross-Entropy loss function:
27
+ $$\mathcal{L} = -\sum_{c=1}^{M} y_{o,c} \ln(p_{o,c})$$
28
+
29
+ ## Intended Use
30
+ - **Investment Research**: Automating the extraction of ESG signals from 10-K filings and earnings transcripts.
31
+ - **Compliance**: Monitoring corporate communications for ESG-related disclosures.
32
+ - **Sustainable Finance**: Providing data for ESG scoring algorithms.
33
+
34
+ ## Limitations
35
+ - **Context Window**: Restricted to 512 tokens. Long documents must be processed in chunks.
36
+ - **Language**: Optimized for English financial terminology; performance on other languages or casual text is not guaranteed.
37
+ - **Factuality**: Classification is based on linguistic patterns, not external fact-checking of the corporate claims.