| ================================================================================ | |
| 🏛️ LEGAL-BERT EVALUATION REPORT | |
| ================================================================================ | |
| 📊 RISK CLASSIFICATION PERFORMANCE | |
| -------------------------------------------------- | |
| Accuracy: 0.7956 | |
| Precision: 0.8012 | |
| Recall: 0.7956 | |
| F1-Score: 0.7961 | |
| Average Confidence: 0.7491 | |
| 📈 REGRESSION PERFORMANCE | |
| -------------------------------------------------- | |
| Severity Prediction: | |
| MSE: 0.6135 | |
| MAE: 0.4928 | |
| R²: 0.8705 | |
| Importance Prediction: | |
| MSE: 0.3579 | |
| MAE: 0.3346 | |
| R²: 0.9764 | |
| 🔍 DISCOVERED RISK PATTERNS | |
| -------------------------------------------------- | |
| Pattern Distribution (True vs Predicted): | |
| 2: 244 → 236 | |
| 6: 248 → 233 | |
| 5: 457 → 559 | |
| 4: 574 → 587 | |
| 1: 579 → 544 | |
| 0: 534 → 462 | |
| 3: 172 → 187 | |
| Pattern-Specific Performance: | |
| 0: | |
| Precision: 0.8139 | |
| Recall: 0.7041 | |
| F1-Score: 0.7550 | |
| Support: 534 | |
| 1: | |
| Precision: 0.8162 | |
| Recall: 0.7668 | |
| F1-Score: 0.7907 | |
| Support: 579 | |
| 2: | |
| Precision: 0.7881 | |
| Recall: 0.7623 | |
| F1-Score: 0.7750 | |
| Support: 244 | |
| 3: | |
| Precision: 0.7380 | |
| Recall: 0.8023 | |
| F1-Score: 0.7688 | |
| Support: 172 | |
| 4: | |
| Precision: 0.8893 | |
| Recall: 0.9094 | |
| F1-Score: 0.8992 | |
| Support: 574 | |
| 5: | |
| Precision: 0.6637 | |
| Recall: 0.8118 | |
| F1-Score: 0.7303 | |
| Support: 457 | |
| 6: | |
| Precision: 0.8455 | |
| Recall: 0.7944 | |
| F1-Score: 0.8191 | |
| Support: 248 | |
| 🎯 DISCOVERED PATTERN DETAILS | |
| -------------------------------------------------- | |
| 0: | |
| Clauses: 1428 | |
| Top Words: use, license, non, exclusive, grants | |
| 1: | |
| Clauses: 2084 | |
| Top Words: shall, insurance, product, 000, reasonable | |
| 2: | |
| Clauses: 1082 | |
| Top Words: party, agreement, shall, consent, written | |
| 3: | |
| Clauses: 870 | |
| Top Words: party, damages, agreement, section, shall | |
| 4: | |
| Clauses: 2033 | |
| Top Words: agreement, shall, term, date, termination | |
| 5: | |
| Clauses: 1331 | |
| Top Words: company, product, shall, products, use | |
| 6: | |
| Clauses: 1026 | |
| Top Words: agreement, laws, shall, state, governed | |
| ================================================================================ |