| --- |
| license: cc-by-4.0 |
| language: en |
| tags: |
| - text-classification |
| - linguistics |
| - ukraine |
| - toponymy |
| datasets: |
| - KyivNotKiev/corpus |
| pipeline_tag: text-classification |
| --- |
| |
| # Toponym Context Classifier |
|
|
| DeBERTa-v3-large fine-tuned for discourse context classification of Ukrainian toponym mentions. |
|
|
| Part of [#KyivNotKiev](https://kyivnotkiev.org). |
|
|
| ## Performance |
|
|
| | Model | F1 Macro | Accuracy | |
| |-------|---------|----------| |
| | **DeBERTa-v3-large (this)** | **0.857 +/- 0.013** | **0.901** | |
| | XLM-RoBERTa-large | 0.846 +/- 0.011 | 0.892 | |
| | mDeBERTa-v3-base | 0.807 +/- 0.007 | 0.864 | |
|
|
| 11 context classes: war_conflict, academic_science, history, politics, sports, culture_arts, food_cuisine, travel_tourism, religion, business_economy, general_news. |
| |
| ## Training |
| |
| - Corpus: 36,791 texts, 59 toponym pairs, 5 sources |
| - Annotation: Claude Haiku 4.5 (validated: kappa=0.56-0.69 vs human consensus 86.2%) |
| - Loss: class-weighted cross-entropy |
| - Config: LR=1e-5, epochs=3, batch=16, fp16, seed=456 |
| - Benchmark: 21 runs (12 hyperparameter + 9 architecture comparison) |
| |
| ## License |
| |
| CC-BY-4.0 |
| |
