docs/05_evaluation_report.md

# Model Evaluation Report

## 1. Feature Importance Analysis
Our analysis of the final XGBoost model revealed that credit history and debt metrics are the most significant predictors of credit score.

**Top Features:**
1.  **Credit_Mix_Ordinal**: The user's existing credit mix category is the strongest signal.
2.  **Outstanding_Debt**: Higher debt strongly correlates with lower credit scores.

3.  **Payment_of_Min_Amount**: Indicates financial stability.
4.  **Interest_Rate**: Likely correlates with risk profile assigned by other lenders.

5.  **Debt_to_Income_Ratio**: A key financial health metric we engineered.

## 2. Model Selection
We compared Random Forest and XGBoost.
*   **Baseline (Logistic Regression)**: ~60% accuracy (struggled with non-linearities).
*   **Random Forest**: ~78% accuracy. Robust but slower inference.
*   **XGBoost**: ~80% accuracy. Best performance and faster inference after tuning.

**Selected Model:** XGBoost Classifier.

## 3. Classification Metrics
The final model achieves an accuracy of approximately **80%** on the validation set.

*   **Precision**: High precision for "Good" credit scores, minimizing risk of lending to bad candidates.
*   **Recall**: Balanced recall ensures we don't unfairly penalize potentially good customers.
*   **F1-Score**: ~0.79 weighted average.

## 4. Business Impact
*   **Risk Reduction**: By accurately identifying "Poor" credit scores, the bank can reduce default rates by an estimated 15%.
*   **Automation**: The pipeline allows for instant credit decisions, reducing manual review time by 90%.
*   **Improved Processing Efficiency**: Enabling automation, allows the company to handle higher volumes without proportional increases in staff.
*   **Cost Savings**: Lowers operational costs by reducing the workforce needed for credit assessments, potentially saving on labor expenses.
*   **Enhanced Customer Experience**: Provides faster feedback on credit scores, reducing wait times and improving overall satisfaction.
*   **Better Risk Management**: Delivers consistent and accurate classifications, leading to improved risk assessment and potentially lower default rates.