Contract Risk Analyzer (CRA) — End-to-End Validation Report
This report documents the automated end-to-end integration validation across all 15 registered contract profiles.
1. Executive Summary
- Validation Date: 2026-07-14
- Total Test Profiles: 15
- Successful Runs (PASS): 15
- Failed Runs (FAIL): 0
- Average Processing Time: 11872 ms
- Verification Status:
🟢 100% SUCCESS
2. Execution Run Matrix
For each profile, a representative benchmark file was processed through upload, NLI classification, scoring, citation matching, and PDF generation:
| Profile ID | Status | Time (ms) | Detected Profile | Confidence | Risk Score | Findings | Report Filename |
|---|---|---|---|---|---|---|---|
employment_contract |
✅ PASS | 19993 | employment contract |
85.0% | 60 | 41 | report_employment_contract.pdf |
lease_agreement |
✅ PASS | 13214 | lease agreement |
85.0% | 43 | 41 | report_lease_agreement.pdf |
software_license |
✅ PASS | 9806 | software license |
85.0% | 30 | 41 | report_software_license.pdf |
service_agreement |
✅ PASS | 8068 | service agreement |
99.6% | 78 | 40 | report_service_agreement.pdf |
consulting_agreement |
✅ PASS | 9391 | consulting agreement |
85.0% | 31 | 41 | report_consulting_agreement.pdf |
commercial_agreement |
✅ PASS | 8872 | commercial agreement |
85.0% | 51 | 41 | report_commercial_agreement.pdf |
non_disclosure_agreement |
✅ PASS | 16932 | non-disclosure agreement |
85.0% | 48 | 40 | report_non_disclosure_agreement.pdf |
loan_agreement |
✅ PASS | 8578 | loan agreement |
85.0% | 30 | 40 | report_loan_agreement.pdf |
partnership_agreement |
✅ PASS | 8447 | partnership agreement |
85.0% | 15 | 40 | report_partnership_agreement.pdf |
purchase_agreement |
✅ PASS | 9009 | purchase agreement |
95.4% | 60 | 40 | report_purchase_agreement.pdf |
general_contract |
✅ PASS | 30476 | general contract |
85.0% | 40 | 40 | report_general_contract.pdf |
saas_agreement |
✅ PASS | 10061 | saas agreement |
85.0% | 43 | 40 | report_saas_agreement.pdf |
it_service_agreement |
✅ PASS | 8438 | it service agreement |
85.0% | 38 | 41 | report_it_service_agreement.pdf |
construction_agreement |
✅ PASS | 8693 | construction agreement |
85.0% | 23 | 40 | report_construction_agreement.pdf |
insurance_agreement |
✅ PASS | 8107 | insurance agreement |
85.0% | 50 | 40 | report_insurance_agreement.pdf |
3. Findings & Validation Assertions
- Dynamic Translation & Pivot: Non-English clauses were correctly pivoted through the Finnish-NLP NMT engine to English for classification.
- Citation Resolution: Verified that active citations were successfully appended to each finding in the generated report JSON.
- PDF Compiler Stability: ReportLab generated valid, non-empty PDF streams for every single contract type.