README.md

metadata

title: Top-W Geometry-Aware Decoding Reproduction
emoji: 🧠
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.16.0
python_version: '3.10'
app_file: app.py
pinned: false
tags:
  - icml2026-repro
  - paper-HSuU4xBmAv

Reproduction for "Geometry-Aware Decoding with Wasserstein-Regularized Truncation and Mass Penalties for Large Language Models"

Paper ID: HSuU4xBmAv Attempt ID: c1b6dd10-f227-4d24-89a0-17fb00ec9147

Target Claims

1. Top-W decoding selects token subsets by optimizing a Wasserstein-entropy-mass objective using embedding-induced geometry (Section 3, Algorithm 1).
2. The method instantiates a practical alternating decoder with an exact subset-update step inside a candidate-pool loop (Section 4.2).
3. Top-W is evaluated against Min-p, Top-p, and Top-H on GSM8K across multiple temperatures and models (Table 1).

Logbook

The claim-by-claim evidence lives in pages/*.md and is rendered by the Space app. Claims 1 and 2 are numerical audits of the mechanism: the exact prefix-form S-step (Theorem 3.4a) is checked against brute-force enumeration of all 1023 subsets per instance and against the byte-exact vendored official implementation (evidence/inputs/upstream/, pinned in evidence/inputs/upstream_manifest.json). Claim 3 (GSM8K benchmark table) is not reproduced — no language model was run.

Reproduce

uv run --project . python generate_evidence.py
uv run --project . python -m pytest tests -q

CPU-only, zero metered API cost, fixed seeds; evidence/bundle.json is the machine-readable output backing every number on the pages.