File size: 2,137 Bytes
aeb53bb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 |
================================================================================
ποΈ LEGAL-BERT EVALUATION REPORT
================================================================================
π RISK CLASSIFICATION PERFORMANCE
--------------------------------------------------
Accuracy: 0.7746
Precision: 0.7798
Recall: 0.7746
F1-Score: 0.7719
Average Confidence: 0.8107
π REGRESSION PERFORMANCE
--------------------------------------------------
Severity Prediction:
MSE: 0.6716
MAE: 0.5123
RΒ²: 0.8582
Importance Prediction:
MSE: 0.3247
MAE: 0.2937
RΒ²: 0.9786
π DISCOVERED RISK PATTERNS
--------------------------------------------------
Pattern Distribution (True vs Predicted):
2: 395 β 449
0: 444 β 403
1: 310 β 389
5: 249 β 254
4: 528 β 386
3: 634 β 681
6: 248 β 246
Pattern-Specific Performance:
0:
Precision: 0.7419
Recall: 0.6734
F1-Score: 0.7060
Support: 444
1:
Precision: 0.6581
Recall: 0.8258
F1-Score: 0.7325
Support: 310
2:
Precision: 0.7661
Recall: 0.8709
F1-Score: 0.8152
Support: 395
3:
Precision: 0.8473
Recall: 0.9101
F1-Score: 0.8776
Support: 634
4:
Precision: 0.8394
Recall: 0.6136
F1-Score: 0.7090
Support: 528
5:
Precision: 0.6693
Recall: 0.6827
F1-Score: 0.6759
Support: 249
6:
Precision: 0.8333
Recall: 0.8266
F1-Score: 0.8300
Support: 248
π― DISCOVERED PATTERN DETAILS
--------------------------------------------------
0:
Clauses: 1306
Top Words: insurance, shall, 000, liability, agreement
1:
Clauses: 1678
Top Words: shall, agreement, product, laws, reasonable
2:
Clauses: 1419
Top Words: agreement, shall, term, termination, date
3:
Clauses: 1786
Top Words: agreement, party, license, use, non
4:
Clauses: 1744
Top Words: shall, company, period, year, products
5:
Clauses: 849
Top Words: company, group, shall, property, rights
6:
Clauses: 1072
Top Words: party, agreement, damages, shall, liability
================================================================================ |