cloud450 commited on
Commit
a992ac3
·
verified ·
1 Parent(s): a82e372

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -6
README.md CHANGED
@@ -67,12 +67,36 @@ All features are min-max scaled `[0,1]`.
67
  - **Max Depth:** 5
68
  - **Learning Rate:** 0.05
69
 
70
- ## Evaluation
71
 
72
- ### Testing Data, Factors & Metrics
 
73
 
74
- Evaluated on a 20% holdout set (`N=2000`).
 
 
 
 
75
 
76
- - **RMSE:** 0.0312
77
- - **MAE:** 0.0247
78
- - **R² Score:** 0.8067
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
67
  - **Max Depth:** 5
68
  - **Learning Rate:** 0.05
69
 
70
+ ## 📊 Performance & Interpretability
71
 
72
+ ### Model Metrics
73
+ The model demonstrates high precision in predicting the severity score $S$, which controls civic resource allocation.
74
 
75
+ | Metric | Value | Interpretation |
76
+ | :--- | :--- | :--- |
77
+ | **RMSE** | 0.0312 | Low average error (0.03 units on 0-1 scale) |
78
+ | **MAE** | 0.0247 | High predictive accuracy |
79
+ | **R² Score** | 0.8067 | 80% of variance explained by features |
80
 
81
+ ### Feature Importance (Gain)
82
+ The following ranking describes how much each feature contributes to the XGBoost tree construction:
83
+
84
+ 1. **C (Centrality)**: 0.3585 — Central potholes pose higher collision risks.
85
+ 2. **A (Area Ratio)**: 0.2187 — Size of the defect is a primary driver.
86
+ 3. **R (Road Type)**: 0.1629 — Priority given to highways over local streets.
87
+ 4. **P (Proximity)**: 0.0937 — Closeness to critical infrastructure.
88
+
89
+ ### SHAP Visualizations
90
+ We use SHAP (SHapley Additive exPlanations) to explain individual predictions and global feature influence.
91
+
92
+ #### Global Feature Impact
93
+ The bar chart below shows the mean absolute SHAP value, identifying which features consistently shift the severity score.
94
+
95
+ ![SHAP Bar Plot](shap_bar_plot.png)
96
+
97
+ #### Detailed Impact (Beeswarm)
98
+ The summary plot shows how high vs. low values of a feature affect out outcome. For example, high values of **C (Centrality)** push the score significantly higher.
99
+
100
+ ![SHAP Dot Plot](shap_dot_plot.png)
101
+
102
+ ## Training Details