etzion commited on
Commit
1706bda
·
verified ·
1 Parent(s): 08dd72a

org card: per-experiment hyperparameters and VQA/caption results

Browse files
Files changed (2) hide show
  1. README.md +57 -2
  2. index.html +50 -2
README.md CHANGED
@@ -224,7 +224,7 @@ Batch size and learning rate illustrate that ceiling. Effective batch 16 came in
224
  Enlarging the training set did what none of those could, and training it longer did not extend the gain. That narrows the remaining question to **data composition**: the corpus added was RSICD-only, and the gain it produced is correspondingly RSICD-only while in-domain stays flat. Additional in-domain imagery is the targeted next step.
225
 
226
 
227
- ## Round 1XX - verbose grounded answers (Aspaklarya-101 ... 107)
228
 
229
  ### Why a second round
230
 
@@ -254,7 +254,60 @@ max seq 2048, vision tower trained. **One variable each.**
254
  | Aspaklarya-104 | LoRA **scale** `alpha/r` 1.0 -> 2.0, rank 16 | `train` | 18,862 / 6,288 | 5.4 h |
255
  | Aspaklarya-105 | **objective balance**, `w_caption` 1.0 -> 0.4 | `train` | 18,862 / 6,288 | 5.4 h |
256
  | Aspaklarya-106 | **LoRA soup** of the four epoch-3 adapters | n/a | n/a | **0 h** |
257
- | Aspaklarya-107 | **cosine** schedule, 3 epochs | `train` | 18,862 / 6,288 | in progress |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
258
 
259
  ### How these are scored
260
 
@@ -292,9 +345,11 @@ generated at a 48-token budget, which clips verbose answers and penalises the
292
  | Aspaklarya-104-step1770 | 74.6 | 68.78 | 81.92 | 78.56 | **75.97** |
293
  | Aspaklarya-103-step1770 | 74.46 | 69.0 | 81.81 | 78.52 | **75.95** |
294
  | Aspaklarya-101-step2360 | 72.38 | 69.28 | 82.21 | 79.72 | **75.9** |
 
295
  | Aspaklarya-102-step1770 | 73.45 | 68.93 | 81.56 | 78.6 | **75.64** |
296
  | Aspaklarya-102-step2360 | 73.24 | 68.71 | 82.0 | 78.49 | **75.61** |
297
  | Aspaklarya-105-step2360 | 73.18 | 68.7 | 82.09 | 78.41 | **75.59** |
 
298
  | **Aspaklarya-020-step4500** | 66.18 | 70.65 | 82.79 | 79.99 | **74.9** |
299
  | in-house reference | 65.26 | 63.59 | 71.91 | 58.58 | **64.84** |
300
  | Qwen3-VL-8B (base) | 60.64 | 53.13 | 68.31 | 63.28 | **61.34** |
 
224
  Enlarging the training set did what none of those could, and training it longer did not extend the gain. That narrows the remaining question to **data composition**: the corpus added was RSICD-only, and the gain it produced is correspondingly RSICD-only while in-domain stays flat. Additional in-domain imagery is the targeted next step.
225
 
226
 
227
+ ## Round 1XX - verbose grounded answers (Aspaklarya-101 ... 108)
228
 
229
  ### Why a second round
230
 
 
254
  | Aspaklarya-104 | LoRA **scale** `alpha/r` 1.0 -> 2.0, rank 16 | `train` | 18,862 / 6,288 | 5.4 h |
255
  | Aspaklarya-105 | **objective balance**, `w_caption` 1.0 -> 0.4 | `train` | 18,862 / 6,288 | 5.4 h |
256
  | Aspaklarya-106 | **LoRA soup** of the four epoch-3 adapters | n/a | n/a | **0 h** |
257
+ | Aspaklarya-107 | **cosine** schedule, lr 1e-4, warmup 0.10, 3 epochs | `train` | 18,862 / 6,288 | 3.8 h |
258
+ | Aspaklarya-108 | **seed replication** of 102 (1234, 2024) | `train` | 18,862 / 6,288 | 2 x 5.4 h |
259
+
260
+ ### Hyperparameters in full
261
+
262
+ Every value actually passed to the trainer, read back from each run's
263
+ `run_config.json`. Cells that differ from the Aspaklarya-102 reference are
264
+ **bold** - that is the single variable the run was built to test.
265
+
266
+ | | 101 | 102 (ref) | 103 | 104 | 105 | 106 | 106b | 107 | 108 |
267
+ |---|---|---|---|---|---|---|---|---|---|
268
+ | split | **`train,other`** | `train` | `train` | `train` | `train` | n/a | n/a | `train` | `train` |
269
+ | items | **35,979** | 18,862 | 18,862 | 18,862 | 18,862 | n/a | n/a | 18,862 | 18,862 |
270
+ | images | **11,994** | 6,288 | 6,288 | 6,288 | 6,288 | n/a | n/a | 6,288 | 6,288 |
271
+ | LoRA rank | 16 | 16 | **32** | 16 | 16 | 64 | 64 | 16 | 16 |
272
+ | LoRA alpha | 16 | 16 | **32** | **32** | 16 | 64 | 64 | 16 | 16 |
273
+ | scale `alpha/r` | 1.0 | 1.0 | 1.0 | **2.0** | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 |
274
+ | LoRA dropout | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | n/a | n/a | 0.0 | 0.0 |
275
+ | vision tower | trained | trained | trained | trained | trained | trained | trained | trained | trained |
276
+ | `w_caption` | 1.0 | 1.0 | 1.0 | 1.0 | **0.4** | n/a | n/a | 1.0 | 1.0 |
277
+ | `w_vqa` | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | n/a | n/a | 1.0 | 1.0 |
278
+ | loss weighting | token | token | token | token | token | n/a | n/a | token | token |
279
+ | epochs | 4 | 4 | 4 | 4 | 4 | n/a | n/a | **3** | 4 |
280
+ | learning rate | 2e-4 | 2e-4 | 2e-4 | 2e-4 | 2e-4 | n/a | n/a | **1e-4** | 2e-4 |
281
+ | scheduler | linear | linear | linear | linear | linear | n/a | n/a | **cosine** | linear |
282
+ | warmup ratio | 0.03 | 0.03 | 0.03 | 0.03 | 0.03 | n/a | n/a | **0.10** | 0.03 |
283
+ | weight decay | 0.001 | 0.001 | 0.001 | 0.001 | 0.001 | n/a | n/a | 0.001 | 0.001 |
284
+ | grad clip | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | n/a | n/a | 0.3 | 0.3 |
285
+ | batch x accum | 4 x 8 | 4 x 8 | 4 x 8 | 4 x 8 | 4 x 8 | n/a | n/a | 4 x 8 | 4 x 8 |
286
+ | effective batch | 32 | 32 | 32 | 32 | 32 | n/a | n/a | 32 | 32 |
287
+ | max seq length | 2048 | 2048 | 2048 | 2048 | 2048 | n/a | n/a | 2048 | 2048 |
288
+ | max image side | 1024 | 1024 | 1024 | 1024 | 1024 | n/a | n/a | 1024 | 1024 |
289
+ | seed | 3407 | 3407 | 3407 | 3407 | 3407 | n/a | n/a | 3407 | **1234 / 2024** |
290
+ | base precision | bf16 | bf16 | bf16 | bf16 | bf16 | bf16 | bf16 | bf16 | bf16 |
291
+ | save every | 590 | 295 | 295 | 295 | 295 | n/a | n/a | 295 | 295 |
292
+ | steps / epoch | 1125 | 590 | 590 | 590 | 590 | n/a | n/a | 590 | 590 |
293
+ | total steps | 4500 | 2360 | 2360 | 2360 | 2360 | n/a | n/a | 1770 | 2360 |
294
+ | wall clock | 9.8 h | 5.4 h | 5.4 h | 5.4 h | 5.4 h | **0 h** | **0 h** | 3.8 h | 2 x 5.4 h |
295
+
296
+ Constant across the whole round and therefore omitted above: base model
297
+ `Qwen/Qwen3-VL-8B-Instruct`, no 4-bit quantisation, 1 caption + 2 QA per
298
+ image, VQA column `VQA_1126`, caption prompts drawn from the 50-query bank,
299
+ eval-loss probe of 400 held-out items (200 caption / 200 VQA).
300
+
301
+ **Aspaklarya-106 and 106b are not training runs.** They are exact LoRA soups:
302
+ four rank-16 adapters stacked into a single rank-64 adapter, which reproduces
303
+ the arithmetic mean of the parent weight deltas to within 2.3e-9. 106 averages
304
+ the epoch-3 parents, 106b the epoch-4 parents. Neither consumed GPU training
305
+ time; both are listed here so their rank and alpha are not mistaken for a
306
+ tuned choice.
307
+
308
+ **Aspaklarya-108 is a replication, not a new configuration.** It is
309
+ Aspaklarya-102 run again at two further seeds, to measure the run-to-run
310
+ spread that every comparison in this table silently assumes is small.
311
 
312
  ### How these are scored
313
 
 
345
  | Aspaklarya-104-step1770 | 74.6 | 68.78 | 81.92 | 78.56 | **75.97** |
346
  | Aspaklarya-103-step1770 | 74.46 | 69.0 | 81.81 | 78.52 | **75.95** |
347
  | Aspaklarya-101-step2360 | 72.38 | 69.28 | 82.21 | 79.72 | **75.9** |
348
+ | Aspaklarya-106b-soup | 72.77 | 69.99 | 81.53 | 78.73 | **75.75** |
349
  | Aspaklarya-102-step1770 | 73.45 | 68.93 | 81.56 | 78.6 | **75.64** |
350
  | Aspaklarya-102-step2360 | 73.24 | 68.71 | 82.0 | 78.49 | **75.61** |
351
  | Aspaklarya-105-step2360 | 73.18 | 68.7 | 82.09 | 78.41 | **75.59** |
352
+ | Aspaklarya-107-step1770 | 72.16 | 69.9 | 80.98 | 77.06 | **75.03** |
353
  | **Aspaklarya-020-step4500** | 66.18 | 70.65 | 82.79 | 79.99 | **74.9** |
354
  | in-house reference | 65.26 | 63.59 | 71.91 | 58.58 | **64.84** |
355
  | Qwen3-VL-8B (base) | 60.64 | 53.13 | 68.31 | 63.28 | **61.34** |
index.html CHANGED
@@ -248,7 +248,7 @@ a { color: #0969da; }
248
  <p>The <strong>hyperparameter</strong> search is closed. Rank, alpha, dropout, learning rate, schedule, weight decay, gradient clipping, vision-tower freezing, QA-per-image, caption prompt pool, batch geometry, effective batch size, learning rate at large batch and base-weight precision were all swept across 19 recipes under identical conditions. None displaced the reference recipe by more than the paired error bar.</p>
249
  <p>Batch size and learning rate illustrate that ceiling. Effective batch 16 came in at <strong>-0.59</strong> overall, batch 64 at 2e-4 at <strong>-0.56</strong>, and batch 64 at 3e-4 at <strong>-0.34</strong> overall and <strong>-0.87</strong> in-domain; batch 64 at 4e-4 was stopped at epoch 4 while declining. In each case captioning held steady or improved while VQA fell.</p>
250
  <p>Enlarging the training set did what none of those could, and training it longer did not extend the gain. That narrows the remaining question to <strong>data composition</strong>: the corpus added was RSICD-only, and the gain it produced is correspondingly RSICD-only while in-domain stays flat. Additional in-domain imagery is the targeted next step.</p>
251
- <h2>Round 1XX - verbose grounded answers (Aspaklarya-101 ... 107)</h2>
252
  <h3>Why a second round</h3>
253
  <p>The 0XX round closed with hyperparameters saturated and data identified as the only live lever. It also left a product problem: every 0XX model answers in one word, because its supervision was one word. <code>yes</code> is a correct answer to <em>&quot;are there any anomalies in the scene?&quot;</em> and a useless one.</p>
254
  <p>The dataset author then supplied a new column, <strong><code>VQA_1126</code></strong>, replacing the terse answers for the in-domain (DM) images with ~300-character grounded answers that name objects, locations and context. The RSICD rows are byte-identical to the old column; only the 5,148 DM rows changed, from a mean of 5.9 characters to ~304.</p>
@@ -267,8 +267,54 @@ a { color: #0969da; }
267
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-104</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">LoRA <strong>scale</strong> <code>alpha/r</code> 1.0 -&gt; 2.0, rank 16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td></tr>
268
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-105</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>objective balance</strong>, <code>w_caption</code> 1.0 -&gt; 0.4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td></tr>
269
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-106</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>LoRA soup</strong> of the four epoch-3 adapters</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0 h</strong></td></tr>
270
- <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-107</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>cosine</strong> schedule, 3 epochs</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">in progress</td></tr>
 
271
  </tbody></table>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
272
  <h3>How these are scored</h3>
273
  <p>Round-1XX checkpoints were first ranked on the DM VQA slice alone - the slice the round was trained for. Every model in the programme has since been re-judged on <strong>one fixed sample drawn with seed 1105</strong>, drawn once outside the model loop so all 24 checkpoints see byte-identical items:</p>
274
  <table style="border-collapse:collapse;margin:1rem 0;font-size:.85rem;border:1px solid #d0d7de"><thead><tr>
@@ -302,9 +348,11 @@ a { color: #0969da; }
302
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-104-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">74.6</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.78</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.92</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.56</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.97</strong></td></tr>
303
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-103-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">74.46</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.81</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.52</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.95</strong></td></tr>
304
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-101-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">72.38</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.28</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.21</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">79.72</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.9</strong></td></tr>
 
305
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-102-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.45</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.93</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.56</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.6</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.64</strong></td></tr>
306
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-102-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.24</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.71</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.49</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.61</strong></td></tr>
307
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-105-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.18</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.7</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.09</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.41</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.59</strong></td></tr>
 
308
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>Aspaklarya-020-step4500</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">66.18</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">70.65</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.79</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">79.99</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>74.9</strong></td></tr>
309
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">in-house reference</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">65.26</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">63.59</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">71.91</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">58.58</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>64.84</strong></td></tr>
310
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Qwen3-VL-8B (base)</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">60.64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">53.13</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.31</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">63.28</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>61.34</strong></td></tr>
 
248
  <p>The <strong>hyperparameter</strong> search is closed. Rank, alpha, dropout, learning rate, schedule, weight decay, gradient clipping, vision-tower freezing, QA-per-image, caption prompt pool, batch geometry, effective batch size, learning rate at large batch and base-weight precision were all swept across 19 recipes under identical conditions. None displaced the reference recipe by more than the paired error bar.</p>
249
  <p>Batch size and learning rate illustrate that ceiling. Effective batch 16 came in at <strong>-0.59</strong> overall, batch 64 at 2e-4 at <strong>-0.56</strong>, and batch 64 at 3e-4 at <strong>-0.34</strong> overall and <strong>-0.87</strong> in-domain; batch 64 at 4e-4 was stopped at epoch 4 while declining. In each case captioning held steady or improved while VQA fell.</p>
250
  <p>Enlarging the training set did what none of those could, and training it longer did not extend the gain. That narrows the remaining question to <strong>data composition</strong>: the corpus added was RSICD-only, and the gain it produced is correspondingly RSICD-only while in-domain stays flat. Additional in-domain imagery is the targeted next step.</p>
251
+ <h2>Round 1XX - verbose grounded answers (Aspaklarya-101 ... 108)</h2>
252
  <h3>Why a second round</h3>
253
  <p>The 0XX round closed with hyperparameters saturated and data identified as the only live lever. It also left a product problem: every 0XX model answers in one word, because its supervision was one word. <code>yes</code> is a correct answer to <em>&quot;are there any anomalies in the scene?&quot;</em> and a useless one.</p>
254
  <p>The dataset author then supplied a new column, <strong><code>VQA_1126</code></strong>, replacing the terse answers for the in-domain (DM) images with ~300-character grounded answers that name objects, locations and context. The RSICD rows are byte-identical to the old column; only the 5,148 DM rows changed, from a mean of 5.9 characters to ~304.</p>
 
267
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-104</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">LoRA <strong>scale</strong> <code>alpha/r</code> 1.0 -&gt; 2.0, rank 16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td></tr>
268
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-105</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>objective balance</strong>, <code>w_caption</code> 1.0 -&gt; 0.4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td></tr>
269
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-106</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>LoRA soup</strong> of the four epoch-3 adapters</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0 h</strong></td></tr>
270
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-107</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>cosine</strong> schedule, lr 1e-4, warmup 0.10, 3 epochs</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3.8 h</td></tr>
271
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-108</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>seed replication</strong> of 102 (1234, 2024)</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862 / 6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2 x 5.4 h</td></tr>
272
  </tbody></table>
273
+ <h3>Hyperparameters in full</h3>
274
+ <p>Every value actually passed to the trainer, read back from each run&#x27;s <code>run_config.json</code>. Cells that differ from the Aspaklarya-102 reference are <strong>bold</strong> - that is the single variable the run was built to test.</p>
275
+ <table style="border-collapse:collapse;margin:1rem 0;font-size:.85rem;border:1px solid #d0d7de"><thead><tr>
276
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap"></th>
277
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">101</th>
278
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">102 (ref)</th>
279
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">103</th>
280
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">104</th>
281
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">105</th>
282
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">106</th>
283
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">106b</th>
284
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">107</th>
285
+ <th style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;background:#f6f8fa;font-weight:600;white-space:nowrap">108</th>
286
+ </tr></thead><tbody>
287
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">split</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong><code>train,other</code></strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>train</code></td></tr>
288
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">items</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>35,979</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">18,862</td></tr>
289
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">images</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>11,994</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">6,288</td></tr>
290
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">LoRA rank</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>32</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td></tr>
291
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">LoRA alpha</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>32</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>32</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">16</td></tr>
292
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">scale <code>alpha/r</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>2.0</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td></tr>
293
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">LoRA dropout</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.0</td></tr>
294
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">vision tower</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">trained</td></tr>
295
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>w_caption</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0.4</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td></tr>
296
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><code>w_vqa</code></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1.0</td></tr>
297
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">loss weighting</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">token</td></tr>
298
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">epochs</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>3</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4</td></tr>
299
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">learning rate</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>1e-4</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2e-4</td></tr>
300
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">scheduler</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>cosine</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">linear</td></tr>
301
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">warmup ratio</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0.10</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.03</td></tr>
302
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">weight decay</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.001</td></tr>
303
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">grad clip</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">0.3</td></tr>
304
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">batch x accum</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4 x 8</td></tr>
305
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">effective batch</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">32</td></tr>
306
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">max seq length</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2048</td></tr>
307
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">max image side</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1024</td></tr>
308
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">seed</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3407</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>1234 / 2024</strong></td></tr>
309
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">base precision</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">bf16</td></tr>
310
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">save every</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">295</td></tr>
311
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">steps / epoch</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1125</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">590</td></tr>
312
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">total steps</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">4500</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">n/a</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2360</td></tr>
313
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">wall clock</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">9.8 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">5.4 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0 h</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>0 h</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">3.8 h</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">2 x 5.4 h</td></tr>
314
+ </tbody></table>
315
+ <p>Constant across the whole round and therefore omitted above: base model <code>Qwen/Qwen3-VL-8B-Instruct</code>, no 4-bit quantisation, 1 caption + 2 QA per image, VQA column <code>VQA_1126</code>, caption prompts drawn from the 50-query bank, eval-loss probe of 400 held-out items (200 caption / 200 VQA).</p>
316
+ <p><strong>Aspaklarya-106 and 106b are not training runs.</strong> They are exact LoRA soups: four rank-16 adapters stacked into a single rank-64 adapter, which reproduces the arithmetic mean of the parent weight deltas to within 2.3e-9. 106 averages the epoch-3 parents, 106b the epoch-4 parents. Neither consumed GPU training time; both are listed here so their rank and alpha are not mistaken for a tuned choice.</p>
317
+ <p><strong>Aspaklarya-108 is a replication, not a new configuration.</strong> It is Aspaklarya-102 run again at two further seeds, to measure the run-to-run spread that every comparison in this table silently assumes is small.</p>
318
  <h3>How these are scored</h3>
319
  <p>Round-1XX checkpoints were first ranked on the DM VQA slice alone - the slice the round was trained for. Every model in the programme has since been re-judged on <strong>one fixed sample drawn with seed 1105</strong>, drawn once outside the model loop so all 24 checkpoints see byte-identical items:</p>
320
  <table style="border-collapse:collapse;margin:1rem 0;font-size:.85rem;border:1px solid #d0d7de"><thead><tr>
 
348
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-104-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">74.6</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.78</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.92</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.56</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.97</strong></td></tr>
349
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-103-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">74.46</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.81</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.52</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.95</strong></td></tr>
350
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-101-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">72.38</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.28</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.21</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">79.72</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.9</strong></td></tr>
351
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-106b-soup</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">72.77</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.99</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.53</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.73</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.75</strong></td></tr>
352
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-102-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.45</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.93</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">81.56</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.6</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.64</strong></td></tr>
353
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-102-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.24</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.71</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.0</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.49</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.61</strong></td></tr>
354
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-105-step2360</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">73.18</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.7</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.09</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">78.41</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.59</strong></td></tr>
355
+ <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Aspaklarya-107-step1770</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">72.16</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">69.9</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">80.98</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">77.06</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>75.03</strong></td></tr>
356
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>Aspaklarya-020-step4500</strong></td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">66.18</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">70.65</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">82.79</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">79.99</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>74.9</strong></td></tr>
357
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">in-house reference</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">65.26</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">63.59</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">71.91</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">58.58</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>64.84</strong></td></tr>
358
  <tr><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">Qwen3-VL-8B (base)</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">60.64</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">53.13</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">68.31</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap">63.28</td><td style="border:1px solid #d0d7de;padding:5px 10px;text-align:left;white-space:nowrap"><strong>61.34</strong></td></tr>