Spaces:
Running
Running
RoleCall Studios commited on
Commit ·
b5bcaec
1
Parent(s): 4c674c7
Move model notes above tests, restyle pink and tighter
Browse files- index.html +6 -5
index.html
CHANGED
|
@@ -18,7 +18,7 @@
|
|
| 18 |
--canvas:#0a0a0b; --bg-panel:#1c1a22; --bg-higher:#26232d; --line:#3f3f46; --hard:#000;
|
| 19 |
--ink:#fafaf9; --ink-soft:#e4e4e7; --ink-muted:#a1a1aa; --ink-dim:#71717a;
|
| 20 |
--brand:#e11d48; --brand-soft:#fb7185; --brand-deep:#9f1239;
|
| 21 |
-
--accent:#8b5cf6; --accent-soft:#a78bfa; --gold:#eab308; --gold-soft:#fcd34d; --amber:#f59e0b;
|
| 22 |
--font-display:'Cinzel',Georgia,serif; --font-serif:'Cormorant Garamond',Garamond,Georgia,serif;
|
| 23 |
--font-body:'Inter',system-ui,-apple-system,'Segoe UI',sans-serif; --font-mono:'JetBrains Mono',ui-monospace,monospace;
|
| 24 |
--border:3px solid var(--hard); --shadow:6px 6px 0 0 var(--hard); --shadow-sm:3px 3px 0 0 var(--hard);
|
|
@@ -77,8 +77,9 @@
|
|
| 77 |
blockquote{margin:6px 0 26px; padding:0; text-align:center}
|
| 78 |
blockquote p{margin:0 auto; max-width:760px; font-family:var(--font-display); font-weight:700; font-size:clamp(17px,2.1vw,23px); letter-spacing:.04em; line-height:1.35; color:var(--ink-soft); text-shadow:2px 2px 0 var(--hard)}
|
| 79 |
|
| 80 |
-
.note{font-size:
|
| 81 |
-
.note
|
|
|
|
| 82 |
|
| 83 |
ul{margin:0 0 16px; padding-left:1.3em} li{margin:.32em 0} li::marker{color:var(--brand)}
|
| 84 |
|
|
@@ -127,6 +128,8 @@
|
|
| 127 |
|
| 128 |
<h2>The <span class="em">PlotPoints</span> Benchmark</h2>
|
| 129 |
<p>A leaderboard for how well models actually <em>roleplay</em>: staying in character, holding a scene across many turns, prose quality, and not hijacking your agency. Not a knowledge or willingness test, and not one vibe score. SFW and NSFW.</p>
|
|
|
|
|
|
|
| 130 |
<p>The difference from the boards you already know: <strong>nothing here is private.</strong> The test harness, the judge prompts, the scoring rubric, and the raw vote dumps are all open-source (CC-BY 4.0), so every number traces back to a file you can read and rerun. Six tests, each measuring a different facet:</p>
|
| 131 |
<ul>
|
| 132 |
<li><strong>Arena ELO.</strong> Single-turn pairwise blind voting. Humans pick the better reply, blind.</li>
|
|
@@ -137,8 +140,6 @@
|
|
| 137 |
<li><strong>Calibration.</strong> Quality control on the votes themselves; roughly 1 in 8 ballots is a trap to catch random clickers.</li>
|
| 138 |
</ul>
|
| 139 |
<p>Every model runs through OpenRouter to keep providers comparable. Human votes and machine judging both count, and where they disagree is half the fun.</p>
|
| 140 |
-
<p class="note"><strong>Requesting a model:</strong> we'll run just about anything within reason, as long as it's on <a href="https://openrouter.ai">OpenRouter</a>. We already add the popular ones we come across, and we take requests, so if it's listed on OR it can go on the board.</p>
|
| 141 |
-
<p class="note"><strong>Local models and finetunes:</strong> we actively want to bench them, and we're actively hunting for an OpenRouter-style aggregator that hosts them in real abundance. The only thing holding us back is fairness: every local model is set up differently and runs differently on every machine, and mismatched provider setups can quietly poison results. The day the community points us at one consistent aggregator with a deep library, we will run them regularly and wildly. Know one? Tell us in the Community tab.</p>
|
| 142 |
<div class="stats">
|
| 143 |
<div class="stat"><div class="n">3,000+</div><div class="l">Human Votes</div></div>
|
| 144 |
<div class="stat"><div class="n">20+</div><div class="l">Models</div></div>
|
|
|
|
| 18 |
--canvas:#0a0a0b; --bg-panel:#1c1a22; --bg-higher:#26232d; --line:#3f3f46; --hard:#000;
|
| 19 |
--ink:#fafaf9; --ink-soft:#e4e4e7; --ink-muted:#a1a1aa; --ink-dim:#71717a;
|
| 20 |
--brand:#e11d48; --brand-soft:#fb7185; --brand-deep:#9f1239;
|
| 21 |
+
--accent:#8b5cf6; --accent-soft:#a78bfa; --gold:#eab308; --gold-soft:#fcd34d; --amber:#f59e0b; --pink:#ec4899; --pink-soft:#f9a8d4;
|
| 22 |
--font-display:'Cinzel',Georgia,serif; --font-serif:'Cormorant Garamond',Garamond,Georgia,serif;
|
| 23 |
--font-body:'Inter',system-ui,-apple-system,'Segoe UI',sans-serif; --font-mono:'JetBrains Mono',ui-monospace,monospace;
|
| 24 |
--border:3px solid var(--hard); --shadow:6px 6px 0 0 var(--hard); --shadow-sm:3px 3px 0 0 var(--hard);
|
|
|
|
| 77 |
blockquote{margin:6px 0 26px; padding:0; text-align:center}
|
| 78 |
blockquote p{margin:0 auto; max-width:760px; font-family:var(--font-display); font-weight:700; font-size:clamp(17px,2.1vw,23px); letter-spacing:.04em; line-height:1.35; color:var(--ink-soft); text-shadow:2px 2px 0 var(--hard)}
|
| 79 |
|
| 80 |
+
.note{font-size:13.5px; color:var(--ink-muted); border-left:3px solid var(--pink); background:rgba(236,72,153,.06); padding:.55em 1em; margin:0 0 10px}
|
| 81 |
+
.note:last-of-type{margin-bottom:22px}
|
| 82 |
+
.note strong{color:var(--pink-soft)} .note a{color:var(--pink-soft)}
|
| 83 |
|
| 84 |
ul{margin:0 0 16px; padding-left:1.3em} li{margin:.32em 0} li::marker{color:var(--brand)}
|
| 85 |
|
|
|
|
| 128 |
|
| 129 |
<h2>The <span class="em">PlotPoints</span> Benchmark</h2>
|
| 130 |
<p>A leaderboard for how well models actually <em>roleplay</em>: staying in character, holding a scene across many turns, prose quality, and not hijacking your agency. Not a knowledge or willingness test, and not one vibe score. SFW and NSFW.</p>
|
| 131 |
+
<p class="note"><strong>Requesting a model:</strong> we'll run just about anything within reason, as long as it's on <a href="https://openrouter.ai">OpenRouter</a>. We already add the popular ones we come across, and we take requests, so if it's on OR it can go on the board.</p>
|
| 132 |
+
<p class="note"><strong>Local models and finetunes:</strong> we actively want to bench them, and we're hunting for an OpenRouter-style aggregator that hosts them in real abundance. The only blocker is fairness: every local model is set up differently and runs differently on every machine, and mismatched provider setups can quietly poison results. Point us at one consistent aggregator with a deep library and we will run them regularly and wildly. Know one? Tell us in the Community tab.</p>
|
| 133 |
<p>The difference from the boards you already know: <strong>nothing here is private.</strong> The test harness, the judge prompts, the scoring rubric, and the raw vote dumps are all open-source (CC-BY 4.0), so every number traces back to a file you can read and rerun. Six tests, each measuring a different facet:</p>
|
| 134 |
<ul>
|
| 135 |
<li><strong>Arena ELO.</strong> Single-turn pairwise blind voting. Humans pick the better reply, blind.</li>
|
|
|
|
| 140 |
<li><strong>Calibration.</strong> Quality control on the votes themselves; roughly 1 in 8 ballots is a trap to catch random clickers.</li>
|
| 141 |
</ul>
|
| 142 |
<p>Every model runs through OpenRouter to keep providers comparable. Human votes and machine judging both count, and where they disagree is half the fun.</p>
|
|
|
|
|
|
|
| 143 |
<div class="stats">
|
| 144 |
<div class="stat"><div class="n">3,000+</div><div class="l">Human Votes</div></div>
|
| 145 |
<div class="stat"><div class="n">20+</div><div class="l">Models</div></div>
|