Update README.md

README.md

@@ -27,6 +27,13 @@ This project fine-tunes the **ModernBERT** model on the **FinGPT** sentiment dat
 - **Task**: Multi-class sentiment classification (9 categories)
 - **Domain**: Financial text analysis
 
+### ModernBert
+ModernBERT is a modernized bidirectional encoder-only Transformer model (BERT-style) pre-trained on 2 trillion tokens of English and code data with a native context length of up to 8,192 tokens. 
+It leverages architectural improvements such as Rotary Positional Embeddings (RoPE) for long-context support, Local-Global Alternating Attention for efficiency on long inputs, Unpadding and Flash Attention for efficient inference.
+
+### FinGPT Sentiment Analysis Dataset
+Contains 76,772 test rows (17,919,695 tokens)
+
 ## Sentiment Categories
 
 The model classifies text into 9 fine-grained sentiment levels:
@@ -111,4 +118,10 @@ The model classifies text into 9 fine-grained sentiment levels:
 ## Deployment Options
 - **API Deployment**: Create REST API using FastAPI
 - **Batch Processing**: Set up automated sentiment analysis pipeline
-- **Real-time Analysis**: Integrate with financial data streams
+- **Real-time Analysis**: Integrate with financial data streams
+
+## References
+- [ModernBERT Paper](https://arxiv.org/abs/2412.13663)
+- [FinGPT Project](https://github.com/AI4Finance-Foundation/FinGPT)
+- [Hugging Face Transformers](https://huggingface.co/docs/transformers)
+- [Financial Sentiment Analysis Survey](https://arxiv.org/abs/2212.14197)