--- language: - en license: apache-2.0 tags: - text-classification - finance - sentiment-analysis datasets: - financial_phrasebank metrics: - f1 - accuracy base_model: ProsusAI/finbert pipeline_tag: text-classification --- # FinBERT Sentiment Analyzer (Fine-Tuned) ## Model Description This is a fine-tuned version of `ProsusAI/finbert` designed specifically for classifying the sentiment of financial news headlines into three distinct categories: **Positive, Negative, and Neutral**. This model serves as the core inference engine for the FinBERT Sentiment Analyzer FastAPI backend. ## Dataset & Class Imbalance Strategy The model was trained on a heavily cleaned and preprocessed version of the Financial PhraseBank dataset. During exploratory data analysis, a severe class imbalance was identified, with the **Neutral** class representing roughly 61% of the data. To prevent the model from collapsing into a majority-class predictor, we implemented a custom MLOps training strategy: 1. **Dynamic Class Weights:** Penalty weights were calculated using the balanced heuristic ($N / (C \times n_i)$). 2. **Custom Loss Function:** A custom Hugging Face `Trainer` subclass was built to inject these weights directly into a PyTorch `CrossEntropyLoss` function during gradient descent, heavily penalizing misclassifications of the minority (Positive/Negative) classes. ## Evaluation Results The model was evaluated on a strictly segregated test set (1,000 samples) pulled directly from the Hugging Face Hub to ensure zero data leakage. * **Macro F1-Score:** `0.9394` * **Accuracy:** `0.9600` * **Validation Loss:** `0.1891` *(Note: Macro F1-Score was prioritized over standard accuracy to validate true performance across the minority classes).* ## Intended Use This model is intended to be loaded into a FastAPI application for real-time financial sentiment inference. The heavy weight files (`.safetensors`) are hosted on the Hugging Face Hub under the repository name `finbert-finetuned`, while the tokenizer configurations and application logic reside in the associated GitHub repository. ## Developer **Muyiwa J. Obadara** Data Scientist & AI Engineer