Update README.md
Browse files
README.md
CHANGED
|
@@ -28,8 +28,7 @@ Unique Words** subset against three competitive attention baselines under a
|
|
| 28 |
controlled multi-seed protocol.
|
| 29 |
|
| 30 |
The repository includes four base architectures (Baseline, Luong, MHSA, and
|
| 31 |
-
the proposed FAA)
|
| 32 |
-
adaptation to Kurdish Person, Place, and Month name subsets.
|
| 33 |
|
| 34 |
## Repository Structure
|
| 35 |
|
|
@@ -44,9 +43,6 @@ KHWR/
|
|
| 44 |
βββ Baseline-Word-Model/ # CRNN without attention (seed 42)
|
| 45 |
βββ Luong-Word-Model/ # Luong multiplicative attention (seed 42)
|
| 46 |
βββ MHSA-Word-Model/ # Multi-Head Self-Attention (seed 42)
|
| 47 |
-
βββ FAA-Person-Names-Adapted/ # FAA fine-tuned on Person Names (100%)
|
| 48 |
-
βββ FAA-Place-Names-Adapted/ # FAA fine-tuned on Place Names (100%)
|
| 49 |
-
βββ FAA-Month-Names-Adapted/ # FAA fine-tuned on Month Names (100%)
|
| 50 |
βββ Scripts/
|
| 51 |
β βββ train.py
|
| 52 |
β βββ inference.py
|
|
@@ -90,24 +86,6 @@ Test set of 8,036 word images, five random seeds (42, 7, 123, 456, 789):
|
|
| 90 |
| MHSA | 0.0403 Β± 0.0023 | 0.1709 Β± 0.0079 |
|
| 91 |
| **FAA (proposed)** | **0.0358 Β± 0.0013** | **0.1426 Β± 0.0044** |
|
| 92 |
|
| 93 |
-
The improvements of FAA over Luong and MHSA are statistically significant
|
| 94 |
-
under both the paired bootstrap (B = 100,000) and the seed-level Wilcoxon
|
| 95 |
-
signed-rank test (p = 0.031 for each), and borderline against the Baseline
|
| 96 |
-
(p = 0.063) where FAA wins on four of five seeds and ties on the fifth.
|
| 97 |
-
|
| 98 |
-
### CTC Beam Search with Character-Level Language Model Rescoring
|
| 99 |
-
|
| 100 |
-
Seed-42 FAA checkpoint, NVIDIA RTX 4060:
|
| 101 |
-
|
| 102 |
-
| Decoding Strategy | CER | WER | Time (ms) |
|
| 103 |
-
|-------------------|:-:|:-:|:-:|
|
| 104 |
-
| Greedy CTC | 0.0373 | 0.1480 | 0.7 |
|
| 105 |
-
| Beam search (k = 10) | 0.0369 | 0.1470 | 11.4 |
|
| 106 |
-
| Beam-10 + 5-gram LM (w = 0.4) | 0.0334 | 0.1279 | 11.5 |
|
| 107 |
-
| **Beam-20 + 5-gram LM (w = 0.4)** | **0.0332** | **0.1273** | **42.4** |
|
| 108 |
-
|
| 109 |
-
The best configuration reduces the CER by 11.0% relative to greedy decoding.
|
| 110 |
-
|
| 111 |
### Few-Shot Cross-Domain Adaptation
|
| 112 |
|
| 113 |
FAA seed-42 checkpoint adapted to three additional DASTNUS subsets:
|
|
@@ -197,9 +175,6 @@ python Scripts/train.py \
|
|
| 197 |
| `Baseline-Word-Model/` | CRNN (no attention) | 0.0380 | 0.1544 |
|
| 198 |
| `Luong-Word-Model/` | CRNN + Luong attention | 0.0391 | 0.1663 |
|
| 199 |
| `MHSA-Word-Model/` | CRNN + Multi-Head Self-Attention | 0.0383 | 0.1655 |
|
| 200 |
-
| `FAA-Person-Names-Adapted/` | FAA fine-tuned (Person Names, 100%) | 0.0380 | 0.1543 |
|
| 201 |
-
| `FAA-Place-Names-Adapted/` | FAA fine-tuned (Place Names, 100%) | 0.0268 | 0.1230 |
|
| 202 |
-
| `FAA-Month-Names-Adapted/` | FAA fine-tuned (Month Names, 100%) | 0.0087 | 0.0527 |
|
| 203 |
|
| 204 |
All values reported on the held-out test split of the corresponding subset
|
| 205 |
under greedy CTC decoding, seed 42.
|
|
@@ -212,22 +187,11 @@ text dataset. Relevant statistics:
|
|
| 212 |
| Subset | Samples | Unique Words | Vocabulary |
|
| 213 |
|--------|:-:|:-:|:-:|
|
| 214 |
| Unique Words | 54,191 | 2,750 | 21,796 (full DASTNUS) |
|
| 215 |
-
| Person Names | DASTNUS subset | β | β |
|
| 216 |
-
| Place Names | DASTNUS subset | β | β |
|
| 217 |
-
| Month Names | DASTNUS subset | 12 | 12 |
|
| 218 |
-
|
| 219 |
-
Writer-disjoint 70 / 15 / 15 train / validation / test splits.
|
| 220 |
|
| 221 |
## Citation
|
| 222 |
|
| 223 |
```bibtex
|
| 224 |
-
|
| 225 |
-
title = {Text-Based Kurdish Handwritten Word Recognition with
|
| 226 |
-
Frequency-Adaptive Attention on the DASTNUS Dataset},
|
| 227 |
-
author = {[Author list to be added]},
|
| 228 |
-
journal = {[Target venue]},
|
| 229 |
-
year = {2026}
|
| 230 |
-
}
|
| 231 |
```
|
| 232 |
|
| 233 |
## License
|
|
|
|
| 28 |
controlled multi-seed protocol.
|
| 29 |
|
| 30 |
The repository includes four base architectures (Baseline, Luong, MHSA, and
|
| 31 |
+
the proposed FAA).
|
|
|
|
| 32 |
|
| 33 |
## Repository Structure
|
| 34 |
|
|
|
|
| 43 |
βββ Baseline-Word-Model/ # CRNN without attention (seed 42)
|
| 44 |
βββ Luong-Word-Model/ # Luong multiplicative attention (seed 42)
|
| 45 |
βββ MHSA-Word-Model/ # Multi-Head Self-Attention (seed 42)
|
|
|
|
|
|
|
|
|
|
| 46 |
βββ Scripts/
|
| 47 |
β βββ train.py
|
| 48 |
β βββ inference.py
|
|
|
|
| 86 |
| MHSA | 0.0403 Β± 0.0023 | 0.1709 Β± 0.0079 |
|
| 87 |
| **FAA (proposed)** | **0.0358 Β± 0.0013** | **0.1426 Β± 0.0044** |
|
| 88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 89 |
### Few-Shot Cross-Domain Adaptation
|
| 90 |
|
| 91 |
FAA seed-42 checkpoint adapted to three additional DASTNUS subsets:
|
|
|
|
| 175 |
| `Baseline-Word-Model/` | CRNN (no attention) | 0.0380 | 0.1544 |
|
| 176 |
| `Luong-Word-Model/` | CRNN + Luong attention | 0.0391 | 0.1663 |
|
| 177 |
| `MHSA-Word-Model/` | CRNN + Multi-Head Self-Attention | 0.0383 | 0.1655 |
|
|
|
|
|
|
|
|
|
|
| 178 |
|
| 179 |
All values reported on the held-out test split of the corresponding subset
|
| 180 |
under greedy CTC decoding, seed 42.
|
|
|
|
| 187 |
| Subset | Samples | Unique Words | Vocabulary |
|
| 188 |
|--------|:-:|:-:|:-:|
|
| 189 |
| Unique Words | 54,191 | 2,750 | 21,796 (full DASTNUS) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 190 |
|
| 191 |
## Citation
|
| 192 |
|
| 193 |
```bibtex
|
| 194 |
+
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 195 |
```
|
| 196 |
|
| 197 |
## License
|