CoderDoge commited on
Commit
18f59dc
·
verified ·
1 Parent(s): b5053ae

Set WAI success-rate axis to 50–80%

Browse files
Files changed (1) hide show
  1. index.html +7 -7
index.html CHANGED
@@ -61,13 +61,13 @@
61
  <div class="tabs" role="tablist" aria-label="Benchmark results"><button class="tab" id="tab-wai" role="tab" aria-selected="true" aria-controls="panel-wai" tabindex="0">WebArena Infinity</button><button class="tab" id="tab-vwa" role="tab" aria-selected="false" aria-controls="panel-vwa" tabindex="-1">VisualWebArena</button><button class="tab" id="tab-om2w" role="tab" aria-selected="false" aria-controls="panel-om2w" tabindex="-1">Online Mind2Web</button></div>
62
  <div class="result-content" id="panel-wai" role="tabpanel" aria-labelledby="tab-wai">
63
  <div class="result-topline"><div><h3>Stronger training on an open backbone</h3><p>Task-weighted success rate on the public 9-app comparison set. CLIFT trains Gemma-4 31B with LoRA; CTS adds inference-time selection.</p></div><span class="pill">OPEN MODEL · TRAIN + SELECT</span></div>
64
- <div class="chart" role="img" aria-label="WAI success rates on a 50–100% axis: Gemma-4 base 61.8%, vanilla GRPO 64.7%, CLIFT 72.6%, CLIFT plus CTS K=3 74.6%.">
65
- <div class="chart-axis" aria-hidden="true"><span>50%</span><span>75%</span><span>100%</span></div>
66
- <div class="bar-row"><div class="bar-label">Gemma-4 base</div><div class="bar-track"><div class="bar-fill" style="width:23.6%"></div></div><div class="bar-value">61.8</div></div>
67
- <div class="bar-row"><div class="bar-label">Vanilla GRPO</div><div class="bar-track"><div class="bar-fill" style="width:29.4%"></div></div><div class="bar-value">64.7</div></div>
68
- <div class="bar-row"><div class="bar-label">CLIFT</div><div class="bar-track"><div class="bar-fill" style="width:45.2%"></div></div><div class="bar-value">72.6</div></div>
69
- <div class="bar-row featured"><div class="bar-label">CLIFT + CTS (K = 3)</div><div class="bar-track"><div class="bar-fill" style="width:49.2%"></div></div><div class="bar-value">74.6</div></div>
70
- </div><div class="axis-label">Success rate (%) · axis starts at 50% · higher is better</div>
71
  <div class="result-foot">Source: <a href="https://arxiv.org/html/2610.06829v1#S4.T6" target="_blank" rel="noopener">arXiv v1, Table 6</a>. Training rows share the comparative judge and browser-use backbone. Training contributes +10.8 pp; CTS adds +2.0 pp.</div>
72
  </div>
73
  <div class="result-content" id="panel-vwa" role="tabpanel" aria-labelledby="tab-vwa" hidden>
 
61
  <div class="tabs" role="tablist" aria-label="Benchmark results"><button class="tab" id="tab-wai" role="tab" aria-selected="true" aria-controls="panel-wai" tabindex="0">WebArena Infinity</button><button class="tab" id="tab-vwa" role="tab" aria-selected="false" aria-controls="panel-vwa" tabindex="-1">VisualWebArena</button><button class="tab" id="tab-om2w" role="tab" aria-selected="false" aria-controls="panel-om2w" tabindex="-1">Online Mind2Web</button></div>
62
  <div class="result-content" id="panel-wai" role="tabpanel" aria-labelledby="tab-wai">
63
  <div class="result-topline"><div><h3>Stronger training on an open backbone</h3><p>Task-weighted success rate on the public 9-app comparison set. CLIFT trains Gemma-4 31B with LoRA; CTS adds inference-time selection.</p></div><span class="pill">OPEN MODEL · TRAIN + SELECT</span></div>
64
+ <div class="chart" role="img" aria-label="WAI success rates on a 50–80% axis: Gemma-4 base 61.8%, vanilla GRPO 64.7%, CLIFT 72.6%, CLIFT plus CTS K=3 74.6%.">
65
+ <div class="chart-axis" aria-hidden="true"><span>50%</span><span>60%</span><span>70%</span><span>80%</span></div>
66
+ <div class="bar-row"><div class="bar-label">Gemma-4 base</div><div class="bar-track"><div class="bar-fill" style="width:39.333333%"></div></div><div class="bar-value">61.8</div></div>
67
+ <div class="bar-row"><div class="bar-label">Vanilla GRPO</div><div class="bar-track"><div class="bar-fill" style="width:49%"></div></div><div class="bar-value">64.7</div></div>
68
+ <div class="bar-row"><div class="bar-label">CLIFT</div><div class="bar-track"><div class="bar-fill" style="width:75.333333%"></div></div><div class="bar-value">72.6</div></div>
69
+ <div class="bar-row featured"><div class="bar-label">CLIFT + CTS (K = 3)</div><div class="bar-track"><div class="bar-fill" style="width:82%"></div></div><div class="bar-value">74.6</div></div>
70
+ </div><div class="axis-label">Success rate (%) · axis range 50–80% · higher is better</div>
71
  <div class="result-foot">Source: <a href="https://arxiv.org/html/2610.06829v1#S4.T6" target="_blank" rel="noopener">arXiv v1, Table 6</a>. Training rows share the comparative judge and browser-use backbone. Training contributes +10.8 pp; CTS adds +2.0 pp.</div>
72
  </div>
73
  <div class="result-content" id="panel-vwa" role="tabpanel" aria-labelledby="tab-vwa" hidden>