Burnmydays Claude Opus 4.8 (1M context) commited on
Commit ·
39fba4e
1
Parent(s): 7054692
wild corpus: 10 tokscale.ai operators (replaces old 6), Supabase synced
Browse files- metrics.py SEED: replace the 6 prior wild rows with 10 hardlined operators
from the tokscale.ai public ccusage leaderboard (cited in-file). Every row
has full four-pillar data so all leaderboard columns populate. MO§ES
canonical row untouched (Υ 18436.98).
- Supabase sigrank_operators: dropped old wild rows, inserted the 10 with real
published cost in cost_usd, source='tokscale'. Board now 11 rows live.
- README: cost-provenance + wild-corpus notes updated (10 operators, tokscale
citation, real cost stored but board uses list-price ~ for consistency).
Verified: all 10 Υ reproduce the source analysis exactly; live board reads 11.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
- README.md +7 -5
- metrics.py +20 -11
README.md
CHANGED
|
@@ -215,11 +215,13 @@ cheapest per token, by an order of magnitude.
|
|
| 215 |
(owner-seeded). The board is backed by Supabase with a hardcoded-seed fallback,
|
| 216 |
so it renders identically even if the database is unreachable.
|
| 217 |
- **Cost provenance.** The board's `$/1M` is a list-price recompute for every
|
| 218 |
-
corpus row (shown with `~`)
|
| 219 |
-
blended cost. MO§ES's verified ccusage
|
| 220 |
-
|
| 221 |
-
- Wild
|
| 222 |
-
|
|
|
|
|
|
|
| 223 |
- Υ is an engineered macro-efficiency index motivated by thermodynamics
|
| 224 |
(Landauer, Ohmic dissipation); log Υ = X + log(Velocity). An analogy, not a
|
| 225 |
microscopic-entropy derivation.
|
|
|
|
| 215 |
(owner-seeded). The board is backed by Supabase with a hardcoded-seed fallback,
|
| 216 |
so it renders identically even if the database is unreachable.
|
| 217 |
- **Cost provenance.** The board's `$/1M` is a list-price recompute for every
|
| 218 |
+
corpus row (shown with `~`) so all rows compare apples-to-apples; only the
|
| 219 |
+
**live ccusage paste** path surfaces real blended cost. MO§ES's verified ccusage
|
| 220 |
+
cost is **$0.527**, which the list-price recompute reproduces exactly.
|
| 221 |
+
- **Wild corpus (10 operators).** Public ccusage footprints from the
|
| 222 |
+
[tokscale.ai](https://tokscale.ai) leaderboard. Their published real cost is kept
|
| 223 |
+
in Supabase (`cost_usd`) but the board shows the list-price `~` recompute for
|
| 224 |
+
consistency with every other row. MO§ES is verified ccusage data, not tokscale.
|
| 225 |
- Υ is an engineered macro-efficiency index motivated by thermodynamics
|
| 226 |
(Landauer, Ohmic dissipation); log Υ = X + log(Velocity). An analogy, not a
|
| 227 |
microscopic-entropy derivation.
|
metrics.py
CHANGED
|
@@ -67,18 +67,27 @@ def compute(i, o, cw, cr, cost_usd=None, prices=None):
|
|
| 67 |
}
|
| 68 |
|
| 69 |
# seed corpus + hardcoded fallback for db.load_operators() (do NOT delete — safety net).
|
| 70 |
-
#
|
| 71 |
-
#
|
| 72 |
-
#
|
| 73 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
| 74 |
SEED = {
|
| 75 |
-
"MO§ES (ccusage)":
|
| 76 |
-
|
| 77 |
-
"
|
| 78 |
-
"
|
| 79 |
-
"
|
| 80 |
-
"Nepomuk5665":
|
| 81 |
-
"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 82 |
}
|
| 83 |
|
| 84 |
if __name__ == "__main__":
|
|
|
|
| 67 |
}
|
| 68 |
|
| 69 |
# seed corpus + hardcoded fallback for db.load_operators() (do NOT delete — safety net).
|
| 70 |
+
#
|
| 71 |
+
# WILD CORPUS SOURCE: the 10 wild operators are public ccusage footprints published
|
| 72 |
+
# on the tokscale.ai leaderboard (https://tokscale.ai). Each row is stored as the four
|
| 73 |
+
# token pillars (input, output, cache_create, cache_read). Real blended cost for these
|
| 74 |
+
# operators is also published on tokscale (kept in Supabase `cost_usd`); the board,
|
| 75 |
+
# however, recomputes $/1M at list price (~) for ALL corpus rows for apples-to-apples
|
| 76 |
+
# comparison. Real cost only appears on the live ccusage paste path (cost_usd passed in).
|
| 77 |
+
# MO§ES is verified ccusage data (not tokscale) and reproduces its real cost ($0.527).
|
| 78 |
SEED = {
|
| 79 |
+
"MO§ES (ccusage)": (1_251_211, 11_296_121, 128_196_310, 2_555_179_769),
|
| 80 |
+
# ---- wild corpus (tokscale.ai) — (input, output, cache_create, cache_read) ----
|
| 81 |
+
"vincentkoc": (10_000, 500, 6_530, 295_500),
|
| 82 |
+
"ben (@cexll)": (10_000, 9_500, 30, 5_500),
|
| 83 |
+
"MapleEve": (1_000, 80, 196, 22_800),
|
| 84 |
+
"Nepomuk5665": (50_000, 1_200, 500, 15_000),
|
| 85 |
+
"Ólafur Nils Sigurðsson": (20_500_000, 1_900_000, 1_400_000, 572_400_000),
|
| 86 |
+
"Ivan Golovach": (17_000_000, 1_300_000, 352, 512_000_000),
|
| 87 |
+
"Feng GAO": (26_500_000, 2_000_000, 238, 471_000_000),
|
| 88 |
+
"steve wu": (164_100_000, 26_000_000, 170_100, 296_800_000),
|
| 89 |
+
"Max Ghenis": (16_100_000, 1_100_000, 1_000_000, 358_100_000),
|
| 90 |
+
"Sylvain Tissier": (8_300_000, 495_200, 111_400, 210_600_000),
|
| 91 |
}
|
| 92 |
|
| 93 |
if __name__ == "__main__":
|