File size: 2,137 Bytes
aeb53bb
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
================================================================================
πŸ›οΈ  LEGAL-BERT EVALUATION REPORT
================================================================================

πŸ“Š RISK CLASSIFICATION PERFORMANCE
--------------------------------------------------
Accuracy: 0.7746
Precision: 0.7798
Recall: 0.7746
F1-Score: 0.7719
Average Confidence: 0.8107

πŸ“ˆ REGRESSION PERFORMANCE
--------------------------------------------------
Severity Prediction:
  MSE: 0.6716
  MAE: 0.5123
  RΒ²: 0.8582
Importance Prediction:
  MSE: 0.3247
  MAE: 0.2937
  RΒ²: 0.9786

πŸ” DISCOVERED RISK PATTERNS
--------------------------------------------------
Pattern Distribution (True vs Predicted):
  2: 395 β†’ 449
  0: 444 β†’ 403
  1: 310 β†’ 389
  5: 249 β†’ 254
  4: 528 β†’ 386
  3: 634 β†’ 681
  6: 248 β†’ 246

Pattern-Specific Performance:
  0:
    Precision: 0.7419
    Recall: 0.6734
    F1-Score: 0.7060
    Support: 444
  1:
    Precision: 0.6581
    Recall: 0.8258
    F1-Score: 0.7325
    Support: 310
  2:
    Precision: 0.7661
    Recall: 0.8709
    F1-Score: 0.8152
    Support: 395
  3:
    Precision: 0.8473
    Recall: 0.9101
    F1-Score: 0.8776
    Support: 634
  4:
    Precision: 0.8394
    Recall: 0.6136
    F1-Score: 0.7090
    Support: 528
  5:
    Precision: 0.6693
    Recall: 0.6827
    F1-Score: 0.6759
    Support: 249
  6:
    Precision: 0.8333
    Recall: 0.8266
    F1-Score: 0.8300
    Support: 248

🎯 DISCOVERED PATTERN DETAILS
--------------------------------------------------

0:
  Clauses: 1306
  Top Words: insurance, shall, 000, liability, agreement

1:
  Clauses: 1678
  Top Words: shall, agreement, product, laws, reasonable

2:
  Clauses: 1419
  Top Words: agreement, shall, term, termination, date

3:
  Clauses: 1786
  Top Words: agreement, party, license, use, non

4:
  Clauses: 1744
  Top Words: shall, company, period, year, products

5:
  Clauses: 849
  Top Words: company, group, shall, property, rights

6:
  Clauses: 1072
  Top Words: party, agreement, damages, shall, liability

================================================================================