README.md

metadata

title: DefectRadar Annotation Tool
emoji: ⚖️
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.33.0
app_file: app.py
pinned: false
license: apache-2.0

DefectRadar -- Annotation Tool

Human annotation tool for definitional defects in Ukrainian legislation. Part of the LegDefQA benchmark construction for the DefectRadar paper.

Task

Annotators classify pipeline-flagged definitions along two dimensions:

Circulus in definiendo

• TRUE_DEFECT: Definition is normatively empty, adds no distinguishing criterion
• DOMAIN_REUSE: Root word repeats but definition is substantively meaningful
• FALSE_POSITIVE: Pipeline error, no actual overlap

Ignotum per ignotum

• CRITICAL: Term undefined anywhere in the corpus, norm is inapplicable
• CROSS_REF: Term defined in another law, needs explicit reference
• COMMON: Well-known term, no definition needed
• FALSE_POSITIVE: Pipeline error, term is defined in the same law

Data

• Input: 300 stratified definitions from 5,799 extracted from 44,021 active Ukrainian laws
• Output: Saved to overthelex/defectradar-annotations

Citation

@article{ovcharov2026defectradar,
  title={DefectRadar: Automated Detection of Definitional Defects in Legislation via Morpho-Semantic NLP Pipeline over 24,000 Ukrainian Laws},
  author={Ovcharov, Volodymyr and Kyrychenko, Ihor},
  year={2026}
}