Anonymous Authors commited on
Commit ·
a42608e
1
Parent(s): 2766452
Unify companion-repo labels: Project page / Dataset / Benchmark code / Model & Inference code
Browse filesHeader bar, Submit-tab instructions, and About-tab companion list now
all use the same five labels as the project page and the rest of the
suite. Drops the older 📦 Code / Reference model framing.
README.md
CHANGED
|
@@ -21,13 +21,13 @@ The full thirteen-metric vector is the unit of report. The table is sorted by **
|
|
| 21 |
|
| 22 |
## Submitting
|
| 23 |
|
| 24 |
-
1. Run the official benchmark on the 157-clip frozen evaluation split: `bash scripts/run_benchmark.sh <your_method>` in the [code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench).
|
| 25 |
2. Upload the produced `outputs/<method>/eval.json` via the **Submit** tab.
|
| 26 |
3. The maintainers review the submission. Approved entries appear on the leaderboard.
|
| 27 |
|
| 28 |
## Companion repos
|
| 29 |
|
| 30 |
-
- 🌐 Project page: https://vitex-bench.github.io/
|
| 31 |
-
-
|
| 32 |
-
-
|
| 33 |
-
- 🤖
|
|
|
|
| 21 |
|
| 22 |
## Submitting
|
| 23 |
|
| 24 |
+
1. Run the official benchmark on the 157-clip frozen evaluation split: `bash scripts/run_benchmark.sh <your_method>` in the [Benchmark code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench).
|
| 25 |
2. Upload the produced `outputs/<method>/eval.json` via the **Submit** tab.
|
| 26 |
3. The maintainers review the submission. Approved entries appear on the leaderboard.
|
| 27 |
|
| 28 |
## Companion repos
|
| 29 |
|
| 30 |
+
- 🌐 **Project page:** https://vitex-bench.github.io/
|
| 31 |
+
- 📊 **Dataset:** https://huggingface.co/datasets/ViTeX-Bench/ViTeX-Dataset
|
| 32 |
+
- 🧪 **Benchmark code:** https://huggingface.co/ViTeX-Bench/ViTeX-Bench
|
| 33 |
+
- 🤖 **Model & Inference code** (ViTeX-14B): https://huggingface.co/ViTeX-Bench/ViTeX-14B
|
app.py
CHANGED
|
@@ -550,11 +550,10 @@ def admin_act(passphrase: str, idx: int, action: str):
|
|
| 550 |
|
| 551 |
HEADER_MD = (
|
| 552 |
"# 🏆 ViTeX-Bench Leaderboard\n\n"
|
| 553 |
-
"🌐
|
| 554 |
-
" · "
|
| 555 |
-
"📦 [Code](https://huggingface.co/ViTeX-Bench/ViTeX-Bench) · "
|
| 556 |
"📊 [Dataset](https://huggingface.co/datasets/ViTeX-Bench/ViTeX-Dataset) · "
|
| 557 |
-
"
|
|
|
|
| 558 |
"Public ranking for **video scene text editing** under the 13-metric, three-axis "
|
| 559 |
"[ViTeX-Bench](https://huggingface.co/ViTeX-Bench/ViTeX-Bench) protocol. "
|
| 560 |
"The full thirteen-metric vector is the unit of report; the table is sorted by "
|
|
@@ -562,7 +561,7 @@ HEADER_MD = (
|
|
| 562 |
"text-correctness primitives. TextScore is a single-axis sort key by design — "
|
| 563 |
"no cross-axis aggregate is computed, because no axis substitutes for another.\n\n"
|
| 564 |
"**To submit:** run `bash scripts/run_benchmark.sh <your_method>` in the "
|
| 565 |
-
"[code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench), then upload "
|
| 566 |
"the resulting `eval.json` in the **Submit** tab. Submissions are reviewed "
|
| 567 |
"before appearing on the leaderboard."
|
| 568 |
)
|
|
@@ -580,7 +579,7 @@ with gr.Blocks(title="ViTeX-Bench Leaderboard", theme=gr.themes.Soft()) as demo:
|
|
| 580 |
gr.Markdown(
|
| 581 |
"Upload your `eval.json` produced by "
|
| 582 |
"`bash scripts/run_benchmark.sh <method>` in the "
|
| 583 |
-
"[code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench). "
|
| 584 |
"All 13 metrics + TextScore are read directly from the JSON; "
|
| 585 |
"you only need to fill the method metadata below."
|
| 586 |
)
|
|
@@ -661,9 +660,9 @@ with gr.Blocks(title="ViTeX-Bench Leaderboard", theme=gr.themes.Soft()) as demo:
|
|
| 661 |
"ten primitives still appear next to TextScore on the table.\n\n"
|
| 662 |
"### Companion repos\n\n"
|
| 663 |
"- 🌐 Project page: https://vitex-bench.github.io/\n"
|
| 664 |
-
"- 📦 Code: https://huggingface.co/ViTeX-Bench/ViTeX-Bench\n"
|
| 665 |
"- 📊 Dataset: https://huggingface.co/datasets/ViTeX-Bench/ViTeX-Dataset\n"
|
| 666 |
-
"-
|
|
|
|
| 667 |
"Paper under double-blind review at NeurIPS 2026 D&B Track. "
|
| 668 |
"Author list and DOI updated after deanonymization."
|
| 669 |
)
|
|
|
|
| 550 |
|
| 551 |
HEADER_MD = (
|
| 552 |
"# 🏆 ViTeX-Bench Leaderboard\n\n"
|
| 553 |
+
"🌐 [Project page](https://vitex-bench.github.io/) · "
|
|
|
|
|
|
|
| 554 |
"📊 [Dataset](https://huggingface.co/datasets/ViTeX-Bench/ViTeX-Dataset) · "
|
| 555 |
+
"🧪 [Benchmark code](https://huggingface.co/ViTeX-Bench/ViTeX-Bench) · "
|
| 556 |
+
"🤖 [Model & Inference code](https://huggingface.co/ViTeX-Bench/ViTeX-14B)\n\n"
|
| 557 |
"Public ranking for **video scene text editing** under the 13-metric, three-axis "
|
| 558 |
"[ViTeX-Bench](https://huggingface.co/ViTeX-Bench/ViTeX-Bench) protocol. "
|
| 559 |
"The full thirteen-metric vector is the unit of report; the table is sorted by "
|
|
|
|
| 561 |
"text-correctness primitives. TextScore is a single-axis sort key by design — "
|
| 562 |
"no cross-axis aggregate is computed, because no axis substitutes for another.\n\n"
|
| 563 |
"**To submit:** run `bash scripts/run_benchmark.sh <your_method>` in the "
|
| 564 |
+
"[Benchmark code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench), then upload "
|
| 565 |
"the resulting `eval.json` in the **Submit** tab. Submissions are reviewed "
|
| 566 |
"before appearing on the leaderboard."
|
| 567 |
)
|
|
|
|
| 579 |
gr.Markdown(
|
| 580 |
"Upload your `eval.json` produced by "
|
| 581 |
"`bash scripts/run_benchmark.sh <method>` in the "
|
| 582 |
+
"[Benchmark code repo](https://huggingface.co/ViTeX-Bench/ViTeX-Bench). "
|
| 583 |
"All 13 metrics + TextScore are read directly from the JSON; "
|
| 584 |
"you only need to fill the method metadata below."
|
| 585 |
)
|
|
|
|
| 660 |
"ten primitives still appear next to TextScore on the table.\n\n"
|
| 661 |
"### Companion repos\n\n"
|
| 662 |
"- 🌐 Project page: https://vitex-bench.github.io/\n"
|
|
|
|
| 663 |
"- 📊 Dataset: https://huggingface.co/datasets/ViTeX-Bench/ViTeX-Dataset\n"
|
| 664 |
+
"- 🧪 Benchmark code: https://huggingface.co/ViTeX-Bench/ViTeX-Bench\n"
|
| 665 |
+
"- 🤖 Model & Inference code: https://huggingface.co/ViTeX-Bench/ViTeX-14B\n\n"
|
| 666 |
"Paper under double-blind review at NeurIPS 2026 D&B Track. "
|
| 667 |
"Author list and DOI updated after deanonymization."
|
| 668 |
)
|