README.md

metadata

license: apache-2.0
pipeline_tag: token-classification
tags:
  - ner
  - gliner
  - data-use

gliner_datause_smoketest

Fine-tune of urchade/gliner_large-v2.1 for data-use mention extraction (dataset / survey / census / registry mentions in economics research papers).

Labels

• NAMED_DATA — a proper name, title, or acronym of a specific data source
• DESCRIPTIVE_DATA — a source described in words but not named
• VAGUE_DATA — generic data wording with no identifiable source

Training

• base model: urchade/gliner_large-v2.1
• dataset: rafmacalaba/data-use-mentions (gliner config)
• epochs: 1
• learning rate: 5e-06
• batch size: 16
• precision: bf16

Evaluation (holdout)

thr	tp	fp	fn	precision	recall	f0.5	f1
0.10	71	1253	20	0.0536	0.7802	0.0659	0.1004
0.20	54	519	37	0.0942	0.5934	0.1133	0.1627
0.30	29	204	62	0.1245	0.3187	0.1417	0.1790
0.40	21	67	70	0.2386	0.2308	0.2370	0.2346
0.50	11	34	80	0.2444	0.1209	0.2030	0.1618
0.60	4	23	87	0.1481	0.0440	0.1005	0.0678
0.70	1	15	90	0.0625	0.0110	0.0323	0.0187

Best F0.5: 0.2370 (thr=0.4) Best F1: 0.2346 (thr=0.4)