Karez commited on
Commit
598e2e1
Β·
verified Β·
1 Parent(s): 5b7ca85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -38
README.md CHANGED
@@ -28,8 +28,7 @@ Unique Words** subset against three competitive attention baselines under a
28
  controlled multi-seed protocol.
29
 
30
  The repository includes four base architectures (Baseline, Luong, MHSA, and
31
- the proposed FAA) and three FAA checkpoints fine-tuned for cross-domain
32
- adaptation to Kurdish Person, Place, and Month name subsets.
33
 
34
  ## Repository Structure
35
 
@@ -44,9 +43,6 @@ KHWR/
44
  β”œβ”€β”€ Baseline-Word-Model/ # CRNN without attention (seed 42)
45
  β”œβ”€β”€ Luong-Word-Model/ # Luong multiplicative attention (seed 42)
46
  β”œβ”€β”€ MHSA-Word-Model/ # Multi-Head Self-Attention (seed 42)
47
- β”œβ”€β”€ FAA-Person-Names-Adapted/ # FAA fine-tuned on Person Names (100%)
48
- β”œβ”€β”€ FAA-Place-Names-Adapted/ # FAA fine-tuned on Place Names (100%)
49
- β”œβ”€β”€ FAA-Month-Names-Adapted/ # FAA fine-tuned on Month Names (100%)
50
  β”œβ”€β”€ Scripts/
51
  β”‚ β”œβ”€β”€ train.py
52
  β”‚ └── inference.py
@@ -90,24 +86,6 @@ Test set of 8,036 word images, five random seeds (42, 7, 123, 456, 789):
90
  | MHSA | 0.0403 Β± 0.0023 | 0.1709 Β± 0.0079 |
91
  | **FAA (proposed)** | **0.0358 Β± 0.0013** | **0.1426 Β± 0.0044** |
92
 
93
- The improvements of FAA over Luong and MHSA are statistically significant
94
- under both the paired bootstrap (B = 100,000) and the seed-level Wilcoxon
95
- signed-rank test (p = 0.031 for each), and borderline against the Baseline
96
- (p = 0.063) where FAA wins on four of five seeds and ties on the fifth.
97
-
98
- ### CTC Beam Search with Character-Level Language Model Rescoring
99
-
100
- Seed-42 FAA checkpoint, NVIDIA RTX 4060:
101
-
102
- | Decoding Strategy | CER | WER | Time (ms) |
103
- |-------------------|:-:|:-:|:-:|
104
- | Greedy CTC | 0.0373 | 0.1480 | 0.7 |
105
- | Beam search (k = 10) | 0.0369 | 0.1470 | 11.4 |
106
- | Beam-10 + 5-gram LM (w = 0.4) | 0.0334 | 0.1279 | 11.5 |
107
- | **Beam-20 + 5-gram LM (w = 0.4)** | **0.0332** | **0.1273** | **42.4** |
108
-
109
- The best configuration reduces the CER by 11.0% relative to greedy decoding.
110
-
111
  ### Few-Shot Cross-Domain Adaptation
112
 
113
  FAA seed-42 checkpoint adapted to three additional DASTNUS subsets:
@@ -197,9 +175,6 @@ python Scripts/train.py \
197
  | `Baseline-Word-Model/` | CRNN (no attention) | 0.0380 | 0.1544 |
198
  | `Luong-Word-Model/` | CRNN + Luong attention | 0.0391 | 0.1663 |
199
  | `MHSA-Word-Model/` | CRNN + Multi-Head Self-Attention | 0.0383 | 0.1655 |
200
- | `FAA-Person-Names-Adapted/` | FAA fine-tuned (Person Names, 100%) | 0.0380 | 0.1543 |
201
- | `FAA-Place-Names-Adapted/` | FAA fine-tuned (Place Names, 100%) | 0.0268 | 0.1230 |
202
- | `FAA-Month-Names-Adapted/` | FAA fine-tuned (Month Names, 100%) | 0.0087 | 0.0527 |
203
 
204
  All values reported on the held-out test split of the corresponding subset
205
  under greedy CTC decoding, seed 42.
@@ -212,22 +187,11 @@ text dataset. Relevant statistics:
212
  | Subset | Samples | Unique Words | Vocabulary |
213
  |--------|:-:|:-:|:-:|
214
  | Unique Words | 54,191 | 2,750 | 21,796 (full DASTNUS) |
215
- | Person Names | DASTNUS subset | β€” | β€” |
216
- | Place Names | DASTNUS subset | β€” | β€” |
217
- | Month Names | DASTNUS subset | 12 | 12 |
218
-
219
- Writer-disjoint 70 / 15 / 15 train / validation / test splits.
220
 
221
  ## Citation
222
 
223
  ```bibtex
224
- @article{KHWR2026,
225
- title = {Text-Based Kurdish Handwritten Word Recognition with
226
- Frequency-Adaptive Attention on the DASTNUS Dataset},
227
- author = {[Author list to be added]},
228
- journal = {[Target venue]},
229
- year = {2026}
230
- }
231
  ```
232
 
233
  ## License
 
28
  controlled multi-seed protocol.
29
 
30
  The repository includes four base architectures (Baseline, Luong, MHSA, and
31
+ the proposed FAA).
 
32
 
33
  ## Repository Structure
34
 
 
43
  β”œβ”€β”€ Baseline-Word-Model/ # CRNN without attention (seed 42)
44
  β”œβ”€β”€ Luong-Word-Model/ # Luong multiplicative attention (seed 42)
45
  β”œβ”€β”€ MHSA-Word-Model/ # Multi-Head Self-Attention (seed 42)
 
 
 
46
  β”œβ”€β”€ Scripts/
47
  β”‚ β”œβ”€β”€ train.py
48
  β”‚ └── inference.py
 
86
  | MHSA | 0.0403 Β± 0.0023 | 0.1709 Β± 0.0079 |
87
  | **FAA (proposed)** | **0.0358 Β± 0.0013** | **0.1426 Β± 0.0044** |
88
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
  ### Few-Shot Cross-Domain Adaptation
90
 
91
  FAA seed-42 checkpoint adapted to three additional DASTNUS subsets:
 
175
  | `Baseline-Word-Model/` | CRNN (no attention) | 0.0380 | 0.1544 |
176
  | `Luong-Word-Model/` | CRNN + Luong attention | 0.0391 | 0.1663 |
177
  | `MHSA-Word-Model/` | CRNN + Multi-Head Self-Attention | 0.0383 | 0.1655 |
 
 
 
178
 
179
  All values reported on the held-out test split of the corresponding subset
180
  under greedy CTC decoding, seed 42.
 
187
  | Subset | Samples | Unique Words | Vocabulary |
188
  |--------|:-:|:-:|:-:|
189
  | Unique Words | 54,191 | 2,750 | 21,796 (full DASTNUS) |
 
 
 
 
 
190
 
191
  ## Citation
192
 
193
  ```bibtex
194
+
 
 
 
 
 
 
195
  ```
196
 
197
  ## License