campus-placement-engine / docs /EXTRACTION_EVAL.md
deeep-sec's picture
feat: institutional campus placement eligibility & interview scheduling engine
788eab4 verified
|
Raw History Blame Contribute Delete
5.17 kB

Recruitment Requirement Extraction Evaluation Report

1. Executive Summary

  • Dataset Evaluated: 25 Mixed-Format Placement Announcements (.txt, .eml, .pdf, .docx)
  • Announcements Fully Extracted (Zero Manual Entry): 25 / 25 (100.0%)
  • Target Requirement: At least 20 of 25 announcements without manual re-typing (Criterion 3).
  • Target Status: PASSED (Achieved 25/25 fully offline).
  • Total Benchmark Execution Time: 0.366 seconds (14.6 ms/document).
  • Cloud/Network Calls: 0 (100% offline regex & semantic dictionary architecture).
  • LLM Dependency: None (LLM Adapter OFF by default; target strictly achieved deterministically).

2. Per-Field Precision and Recall

Field Name Evaluated Correct (TP) False Pos False Neg Precision Recall F1 Score
company_name 25 25 0 0 100.0% 100.0% 100.0%
drive_date 25 25 0 0 100.0% 100.0% 100.0%
mode 25 25 0 0 100.0% 100.0% 100.0%
ctc_lpa 25 25 0 0 100.0% 100.0% 100.0%
cgpa_min 25 25 0 0 100.0% 100.0% 100.0%
tenth_percentage_min 25 25 0 0 100.0% 100.0% 100.0%
twelfth_percentage_min 25 25 0 0 100.0% 100.0% 100.0%
active_backlogs_max 25 25 0 0 100.0% 100.0% 100.0%
historical_backlogs_max 8 8 0 0 100.0% 100.0% 100.0%
allowed_branches 25 25 0 0 100.0% 100.0% 100.0%
gap_years_max 25 25 0 0 100.0% 100.0% 100.0%
rounds_count 25 25 0 0 100.0% 100.0% 100.0%

3. Document-by-Document Breakdown

Filename Company Extracted Status Confidence Ambiguities Flagged Review Items
01_google_announcement.txt Google Full Extract (Zero Manual Entry) 0.96 0 0
02_microsoft_announcement.txt Microsoft Full Extract (Zero Manual Entry) 0.95 0 0
03_amazon_announcement.txt Amazon Full Extract (Zero Manual Entry) 0.95 0 0
04_goldman_sachs_announcement.txt Goldman Sachs Full Extract (Zero Manual Entry) 0.96 0 0
05_oracle_announcement.txt Oracle Full Extract (Zero Manual Entry) 0.95 0 0
06_qualcomm_announcement.txt Qualcomm Full Extract (Zero Manual Entry) 0.95 0 0
07_cisco_announcement.txt Cisco Full Extract (Zero Manual Entry) 0.95 0 0
08_deloitte_usi_email.eml Deloitte USI Full Extract (Zero Manual Entry) 0.95 0 0
09_tata_consultancy_services_email.eml Tata Consultancy Services Full Extract (Zero Manual Entry) 0.95 0 0
10_infosys_power_programmer_email.eml Infosys Power Programmer Full Extract (Zero Manual Entry) 0.95 0 0
11_wipro_turbo_email.eml Wipro Turbo Full Extract (Zero Manual Entry) 0.95 1 1
12_accenture_advanced_tech_email.eml Accenture Advanced Tech Full Extract (Zero Manual Entry) 0.95 0 0
13_siemens_email.eml Siemens Full Extract (Zero Manual Entry) 0.95 0 0
14_larsen_and_toubro_spec.pdf Larsen & Toubro Full Extract (Zero Manual Entry) 0.96 0 0
15_texas_instruments_spec.pdf Texas Instruments Full Extract (Zero Manual Entry) 0.95 0 0
16_intel_spec.pdf Intel Full Extract (Zero Manual Entry) 0.95 0 0
17_morgan_stanley_spec.pdf Morgan Stanley Full Extract (Zero Manual Entry) 0.96 0 0
18_samsung_randd_spec.pdf Samsung R&D Full Extract (Zero Manual Entry) 0.95 0 0
19_tata_motors_spec.pdf Tata Motors Full Extract (Zero Manual Entry) 0.95 0 0
20_reliance_industries_jd.docx Reliance Industries Full Extract (Zero Manual Entry) 0.95 0 0
21_itc_limited_jd.docx ITC Limited Full Extract (Zero Manual Entry) 0.96 0 0
22_biocon_jd.docx Biocon Full Extract (Zero Manual Entry) 0.95 0 0
23_zs_associates_jd.docx ZS Associates Full Extract (Zero Manual Entry) 0.95 0 0
24_barclays_jd.docx Barclays Full Extract (Zero Manual Entry) 0.95 0 0
25_atlassian_jd.docx Atlassian Full Extract (Zero Manual Entry) 0.96 0 0

4. Ambiguity and Review Queue Governance

In compliance with institutional placement standards:

  1. Never Guess Silently: Phrasings such as 'throughout' or 'at time of joining' are explicitly identified as ambiguities and automatically appended to the review queue with suggested clarification actions.
  2. Side-by-Side Review Contract: The officer UI receives the verbatim sentence provenance alongside every parsed field, enabling 1-click accept, edit, or reject.
  3. Feedback Audit Log: Every correction or override is persisted in the audit trail with officer ID and timestamp.

5. Offline & Privacy Assurance

  • All text parsing, document decompression, and table extractions execute locally.
  • No student data, corporate specifications, or salary details leave the local host environment.