| ================================================================================ | |
| 🏛️ LEGAL-BERT EVALUATION REPORT | |
| ================================================================================ | |
| 📊 RISK CLASSIFICATION PERFORMANCE | |
| -------------------------------------------------- | |
| Accuracy: 0.7746 | |
| Precision: 0.7798 | |
| Recall: 0.7746 | |
| F1-Score: 0.7719 | |
| Average Confidence: 0.8107 | |
| 📈 REGRESSION PERFORMANCE | |
| -------------------------------------------------- | |
| Severity Prediction: | |
| MSE: 0.6716 | |
| MAE: 0.5123 | |
| R²: 0.8582 | |
| Importance Prediction: | |
| MSE: 0.3247 | |
| MAE: 0.2937 | |
| R²: 0.9786 | |
| 🔍 DISCOVERED RISK PATTERNS | |
| -------------------------------------------------- | |
| Pattern Distribution (True vs Predicted): | |
| 2: 395 → 449 | |
| 0: 444 → 403 | |
| 1: 310 → 389 | |
| 5: 249 → 254 | |
| 4: 528 → 386 | |
| 3: 634 → 681 | |
| 6: 248 → 246 | |
| Pattern-Specific Performance: | |
| 0: | |
| Precision: 0.7419 | |
| Recall: 0.6734 | |
| F1-Score: 0.7060 | |
| Support: 444 | |
| 1: | |
| Precision: 0.6581 | |
| Recall: 0.8258 | |
| F1-Score: 0.7325 | |
| Support: 310 | |
| 2: | |
| Precision: 0.7661 | |
| Recall: 0.8709 | |
| F1-Score: 0.8152 | |
| Support: 395 | |
| 3: | |
| Precision: 0.8473 | |
| Recall: 0.9101 | |
| F1-Score: 0.8776 | |
| Support: 634 | |
| 4: | |
| Precision: 0.8394 | |
| Recall: 0.6136 | |
| F1-Score: 0.7090 | |
| Support: 528 | |
| 5: | |
| Precision: 0.6693 | |
| Recall: 0.6827 | |
| F1-Score: 0.6759 | |
| Support: 249 | |
| 6: | |
| Precision: 0.8333 | |
| Recall: 0.8266 | |
| F1-Score: 0.8300 | |
| Support: 248 | |
| 🎯 DISCOVERED PATTERN DETAILS | |
| -------------------------------------------------- | |
| 0: | |
| Clauses: 1306 | |
| Top Words: insurance, shall, 000, liability, agreement | |
| 1: | |
| Clauses: 1678 | |
| Top Words: shall, agreement, product, laws, reasonable | |
| 2: | |
| Clauses: 1419 | |
| Top Words: agreement, shall, term, termination, date | |
| 3: | |
| Clauses: 1786 | |
| Top Words: agreement, party, license, use, non | |
| 4: | |
| Clauses: 1744 | |
| Top Words: shall, company, period, year, products | |
| 5: | |
| Clauses: 849 | |
| Top Words: company, group, shall, property, rights | |
| 6: | |
| Clauses: 1072 | |
| Top Words: party, agreement, damages, shall, liability | |
| ================================================================================ |