Card: loop retry at serving, updated letter figures

README.md

@@ -36,6 +36,7 @@ v0.1 is a fine-tune of [dots.mocr](https://huggingface.co/dots-studio/dots.mocr)
 | Statistical test | Paired bootstrap over pages, 95% confidence interval for each difference |
 | Gate on readable print (typeset; scans at about 300 dpi once verified) | **Passed.** Vowel error rate 0.030 → 0.006 (95% CI of the change −0.028 to −0.020, 116 pages); vowel marks added that the page does not print: 14.5 → 2.0 per 1,000 letters; no pages failed to read; verse match rate 0.92 → 0.97 |
 | Old low-resolution scans (separate, softer rule: fail only if clearly much worse than base) | **Passed narrowly.** Vowel error rate 0.386 → 0.476 on *Sharh Ma'na at-Taghut* (CI +0.045 to +0.138, limit +0.05) |
+| Letter error rate, all 267 evaluated pages (serving with the loop retry, see *How to use*) | 0.061 → **0.040**; old low-resolution scans 0.114 → **0.070** |
 | Release decision | **Research preview** |
 
 ## Where it works today
@@ -44,7 +45,7 @@ v0.1 is a fine-tune of [dots.mocr](https://huggingface.co/dots-studio/dots.mocr)
 |---|---|
 | Typeset classical print, fully vowelled | **Works.** 96% of pages at 95% accuracy or better, two thirds at 99% or better (verified references). |
 | Scans at about 300 dpi, partly vowelled or unvowelled | **Promising preliminary results; reference verification in progress.** |
-| Old low-resolution scans | **Not yet.** About as good as the base model, sometimes worse. This is the focus of the next version. |
+| Old low-resolution scans | **Not yet for vowel marks.** Letters read better than the base model (letter error 0.114 → 0.070), but vowel marks are about as good as base, sometimes worse. This is the focus of the next version. |
 
 ## Faithfulness to the page
 
@@ -59,8 +60,8 @@ letters, base model → v0.1:
 | Scan, about 300 dpi | partial | 19 | 62.8 → **13.5** | 15.0 → **9.5** | provisional |
 | Scan, about 300 dpi | none | 31 | 3.8 → **8.1** | 6.2 → **1.9** | provisional |
 | Old low-resolution scan | full | 7 | 78.6 → 77.2 | 14.2 → 39.4 | verified and provisional |
-| Old low-resolution scan | partial | 58 | 31.4 → 27.6 | 12.4 → 5.2 | verified and provisional |
-| Old low-resolution scan | none | 27 | 63.3 → 44.1 | 12.9 → 4.2 | verified and provisional |
+| Old low-resolution scan | partial | 58 | 31.4 → 27.5 | 12.4 → 5.2 | verified and provisional |
+| Old low-resolution scan | none | 27 | 63.3 → 41.6 | 12.9 → 4.3 | verified and provisional |
 
 On unvowelled 300 dpi scans v0.1 adds more marks than the base model (3.8 → 8.1 per 1,000 letters),
 even though its overall vowel error rate is lower. Unvowelled pages still carry vowelled Qur'an
@@ -75,7 +76,7 @@ Each page falls in one accuracy band. **Verified** means a person checked the re
 | Typeset print | verified | 116 | 78 (67%) | 33 (28%) | 5 (4%) | 0 (0%) | 0 |
 | Scan, about 300 dpi | provisional | 59 | 3 (5%) | 36 (61%) | 12 (20%) | 7 (12%) | 1 |
 | Old low-resolution scan | verified | 44 | 1 (2%) | 6 (14%) | 31 (70%) | 5 (11%) | 1 |
-| Old low-resolution scan | provisional | 48 | 2 (4%) | 16 (33%) | 23 (48%) | 4 (8%) | 3 |
+| Old low-resolution scan | provisional | 48 | 2 (4%) | 16 (33%) | 24 (50%) | 4 (8%) | 2 |
 
 Provisional references: *Sharh Hadith Inna Kunna fi Jahiliyya*, *Sharh al-Jami' li-'Ibadat Allah Wahdah*, *Sharh as-Sunna (al-Barbahari)*, *al-'Arabiyya bayna Yadayk*.
 
@@ -91,7 +92,7 @@ A page can show 100% for letters and for vowel marks and still score below 100%
 figure also counts punctuation, brackets, digits and spacing.
 
 All figures are measured after the optional verse layer (see below), which replaces recognised Qur'an
-quotations with the canonical text.
+quotations with the canonical text, and with the loop retry described under *How to use*.
 
 In the examples below, the left side is the page as printed and the right side is the model's text:
 red marks a wrong word, yellow an extra word that is not on
@@ -186,6 +187,12 @@ tokens. The image tokens go before the prompt in the text part:
    {"type": "text", "text": "<|img|><|imgpad|><|endofimg|>Extract the text content from this image."}]}]}
 ```
 
+Rarely, on title and front-matter pages, the model repeats a line until it reaches the token limit
+(`finish_reason` is `length`). Ask for that page once more with `"repetition_penalty": 1.1`; leave
+pages that finish normally alone, since a penalty on every page would also discourage words a page
+genuinely repeats. On the evaluation pages this retry fixed two of three such pages and lowered the
+letter error rate on old low-resolution scans from 0.126 to 0.070.
+
 The output is Markdown: `#` headings, `**bold**`, `﴿verse﴾ [السورة: ن]`, and footnotes as `[^n]`
 after a `---` line. Running headers and page numbers are left out.
 
@@ -208,7 +215,7 @@ plus real pages of verified books. No page or paragraph of a test or validation
   verse type the model cannot make out.
 - Unvowelled scans: letters read well; v0.1 still adds some vowel marks the page does not print.
 - Honorific signs (such as ﷺ and ﵁) are sometimes written out in words.
-- A few title and front-matter pages produced repeated text.
+- A few title and front-matter pages produce repeated text; the retry above fixes most, not all.
 - Scans at about 300 dpi are measured against provisional references until they are verified.
 
 ## Next