vantigeai/ModernBERT-Biz-Trinary-Classifier

ModernBERT-BizClassifier - Business Relevance Classifier

📌 Overview

ModernBERT-BizClassifier is a fine-tuned ModernBERT model that classifies text from any source (social media, news, reports, etc.) and determines whether it is useful for businesses.

The model distinguishes between:

• Business_Action_Direct: Clearly relevant business information (e.g., financial reports, earnings, funding rounds).
• Business_Intelligence_Indirect: Text that implies business relevance (e.g., regulatory news, economic trends, emerging markets).
• Not_Business_Relevant: Text that contains no useful business insights.

🛠 Model Details

Hyperparameter	Value
Base Model	ModernBERT-base
Max Context Length	8192 tokens
Batch Size	32
Learning Rate	1e-5
Weight Decay	0.005
Epochs	2.0
Warmup Ratio	0.1
Precision Used	BF16 if CUDA available
Problem Type	Multi-label classification

📊 Evaluation Results

Metric	Score
Final Validation Loss	0.2940
Micro F1 Score	0.8049
Macro F1 Score	0.8042
Evaluation Runtime	3.48 seconds
Samples Processed Per Second	239.09
Steps Processed Per Second	7.48

🏗 Model Card

• Tags: business-classification, BERT, financial-analysis, text-classification

{
    1: "Business_Action_Direct",
    2: "Business_Intelligence_Indirect",
    3: "Not_Business_Relevant"
}