File size: 2,624 Bytes
95f7276 397c7e9 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Speculative Decoding on a 16 GB Consumer GPU — paper</title>
<style>
:root { --ink:#1a1d21; --mut:#5b6470; --acc:#0f4c81; --line:#e3e6ea; }
* { box-sizing: border-box; }
body {
margin:0; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif;
color: var(--ink); background:#f7f8fa; line-height:1.5;
}
header {
max-width:1000px; margin:0 auto; padding:2rem 1.25rem 0.5rem;
}
h1 { font-size:1.45rem; margin:0 0 0.25rem; letter-spacing:-0.01em; }
.meta { color:var(--mut); font-size:0.92rem; margin-bottom:0.75rem; }
.links { display:flex; flex-wrap:wrap; gap:0.5rem; margin:0.75rem 0 0.25rem; }
.links a {
text-decoration:none; font-size:0.85rem; color:var(--acc);
border:1px solid var(--line); background:#fff; border-radius:999px;
padding:0.3rem 0.85rem;
}
.links a:hover { border-color:var(--acc); }
.wrap { max-width:1000px; margin:0 auto; padding:0 1.25rem 2.5rem; }
.pdf {
width:100%; height:calc(100vh - 220px); min-height:640px;
border:1px solid var(--line); border-radius:6px; background:#fff;
}
footer {
max-width:1000px; margin:0 auto; padding:0 1.25rem 2rem;
color:var(--mut); font-size:0.82rem;
}
</style>
</head>
<body>
<header>
<h1>Speculative Decoding on a 16 GB Consumer GPU</h1>
<div class="meta">Acceptance, modern drafters, and quantization in Gemma 4 12B and Qwen3-8B
· Martin Ulises Millan Guerrero · 2026-08-08</div>
<div class="links">
<a href="https://huggingface.co/reyden009/speculative-decoding-lab" target="_blank" rel="noopener">Companion repo (code + data)</a>
<a href="https://huggingface.co/reyden009/speculative-decoding-lab/resolve/main/paper/paper.pdf" target="_blank" rel="noopener">PDF (direct)</a>
<a href="https://huggingface.co/reyden009/speculative-decoding-lab/resolve/main/paper/arxiv-bundle.tar.gz" target="_blank" rel="noopener">arXiv-ready bundle</a>
<a href="https://huggingface.co/reyden009/speculative-decoding-lab/resolve/main/paper/paper.md" target="_blank" rel="noopener">Markdown source</a>
</div>
</header>
<div class="wrap">
<iframe class="pdf" src="https://huggingface.co/reyden009/speculative-decoding-lab/resolve/main/paper/paper.pdf#toolbar=1"
title="Paper PDF" allowfullscreen></iframe>
</div>
<footer>
Setup: RTX 4060 Ti 16 GB · Intel i5-12400 · llama.cpp (CUDA) · Gemma 4 12B and Qwen3-8B GGUF · everything user-space, no sudo.
</footer>
</body>
</html>
|