Spaces:
Running
Running
Sharpen frontier benchmark positioning
Browse filesUpdate the title, hero, and paper framing to match the rebuilt FlavourBench release.
README.md
CHANGED
|
@@ -8,13 +8,13 @@ sdk_version: 6.9.0
|
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
license: other
|
| 11 |
-
short_description:
|
| 12 |
---
|
| 13 |
|
| 14 |
-
# FlavourBench:
|
| 15 |
|
| 16 |
-
|
| 17 |
-
|
| 18 |
|
| 19 |
[Paper](https://github.com/josefchen/flavourbench/blob/main/paper/build/flavourbench.pdf) 路
|
| 20 |
[Dataset](https://huggingface.co/datasets/josefchen/flavourbench) 路
|
|
|
|
| 8 |
app_file: app.py
|
| 9 |
pinned: false
|
| 10 |
license: other
|
| 11 |
+
short_description: The executable culinary benchmark for frontier LLMs.
|
| 12 |
---
|
| 13 |
|
| 14 |
+
# FlavourBench: Executable Culinary Evaluation of Frontier Language Models
|
| 15 |
|
| 16 |
+
The executable culinary benchmark and evidence explorer for 20 frontier language-model endpoints,
|
| 17 |
+
scored against answer keys computed before evaluation.
|
| 18 |
|
| 19 |
[Paper](https://github.com/josefchen/flavourbench/blob/main/paper/build/flavourbench.pdf) 路
|
| 20 |
[Dataset](https://huggingface.co/datasets/josefchen/flavourbench) 路
|
app.py
CHANGED
|
@@ -313,8 +313,8 @@ def _hero_html() -> str:
|
|
| 313 |
return f"""
|
| 314 |
<div class="fb-shell fb-hero">
|
| 315 |
<section>
|
| 316 |
-
<div class="fb-kicker">
|
| 317 |
-
<h1>
|
| 318 |
<p class="fb-dek">FlavourBench scores 20 current language-model endpoints against answer
|
| 319 |
keys compiled by Epicure.
|
| 320 |
<strong>Blue is the FlavourBench Score. Gray shows its Wilson 95% interval.</strong>
|
|
@@ -510,7 +510,7 @@ theme = gr.themes.Base(
|
|
| 510 |
)
|
| 511 |
|
| 512 |
|
| 513 |
-
with gr.Blocks(title="FlavourBench 路
|
| 514 |
gr.HTML(_hero_html())
|
| 515 |
|
| 516 |
with gr.Tabs():
|
|
|
|
| 313 |
return f"""
|
| 314 |
<div class="fb-shell fb-hero">
|
| 315 |
<section>
|
| 316 |
+
<div class="fb-kicker">The executable culinary benchmark 路 20 frontier endpoints</div>
|
| 317 |
+
<h1>How well do frontier models reason about flavour?</h1>
|
| 318 |
<p class="fb-dek">FlavourBench scores 20 current language-model endpoints against answer
|
| 319 |
keys compiled by Epicure.
|
| 320 |
<strong>Blue is the FlavourBench Score. Gray shows its Wilson 95% interval.</strong>
|
|
|
|
| 510 |
)
|
| 511 |
|
| 512 |
|
| 513 |
+
with gr.Blocks(title="FlavourBench 路 Executable culinary benchmark") as demo:
|
| 514 |
gr.HTML(_hero_html())
|
| 515 |
|
| 516 |
with gr.Tabs():
|