File size: 1,838 Bytes
edd7992
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
<div style="border: 2px solid #30363d; border-radius: 12px; background: linear-gradient(145deg, #161b22, #0d1117); padding: 30px; font-family: sans-serif; color: #c9d1d9;">
    <div style="text-align: center; border-bottom: 2px solid #30363d; padding-bottom: 20px; margin-bottom: 25px;">
        <h1 style="color: #58a6ff; margin: 0 0 10px 0;">SPEED-Bench Speculative Decoding Replication</h1>
        <p style="color: #8b949e; margin: 0;">Replicating paper OpenReview: <strong>Rl2uQlCoQX</strong> (arXiv: 2604.09557)</p>
    </div>
    <div style="display: grid; grid-template-columns: 1fr 1fr; gap: 20px;">
        <div style="border: 1px solid #30363d; border-radius: 8px; background-color: #0d1117; padding: 20px;">
            <h2 style="color: #58a6ff; border-bottom: 1px solid #30363d; padding-bottom: 10px; margin-top: 0;">Claim 4: Synthetic Overestimation</h2>
            <p>Synthetic Input Speedup: <strong style="color: #58a6ff; font-size: 1.2rem;">1.28x</strong> (35.17 vs 27.46 TPS)</p>
            <p>Natural Input Speedup: <strong style="color: #ff7b72; font-size: 1.2rem;">0.78x</strong> (slowdown! 23.19 vs 29.8 TPS)</p>
            <p>Synthetic Speedup Overestimation Gap: <strong style="color: #58a6ff; font-size: 1.2rem;">64.1%</strong></p>
        </div>
        <div style="border: 1px solid #30363d; border-radius: 8px; background-color: #0d1117; padding: 20px;">
            <h2 style="color: #58a6ff; border-bottom: 1px solid #30363d; padding-bottom: 10px; margin-top: 0;">Claim 5: Optimal Draft Length</h2>
            <p>Draft length 1 yields highest TPS of <strong style="color: #58a6ff;">15.31</strong>, with performance decreasing monotonically to <strong style="color: #ff7b72;">9.69</strong> at length 5 due to acceptance rate decay on natural text.</p>
        </div>
    </div>
</div>