Clarify distinct benchmark scopes and factual-data ownership
Browse files
README.md
CHANGED
|
@@ -15,20 +15,20 @@ Lexmount builds browsers and web-access tools for AI agents. Our platform provid
|
|
| 15 |
|
| 16 |
## Browser Eval and LexBench
|
| 17 |
|
| 18 |
-
[Browser Eval](https://github.com/lexmount/browser-eval) compares browsers and web tools through direct tool calls and fixed browser trajectory replay. It favors programmatic scoring where tasks have definite answers, retains evidence for each result, and
|
| 19 |
|
| 20 |
Our versioned benchmark datasets are available here:
|
| 21 |
|
| 22 |
| Dataset | What it evaluates |
|
| 23 |
| --- | --- |
|
| 24 |
| [LexBench-Web-Fetch](https://huggingface.co/datasets/Lexmount/LexBench-Web-Fetch) | Page content, documents, structured records, resource discovery and file delivery |
|
| 25 |
-
| [LexBench-Web-Search](https://huggingface.co/datasets/Lexmount/LexBench-Web-Search) |
|
| 26 |
| [LexBench-WebMainBench](https://huggingface.co/datasets/Lexmount/LexBench-WebMainBench) | Main-content extraction from frozen HTML, using a reference-corrected upstream edition |
|
| 27 |
-
| [LexBench-SimpleQA-Verified](https://huggingface.co/datasets/Lexmount/LexBench-SimpleQA-Verified) |
|
| 28 |
| [LexBench-WCXB](https://huggingface.co/datasets/Lexmount/LexBench-WCXB) | Source-qualified frozen web pages and extraction references |
|
| 29 |
| [LexBench-Headless-Browser](https://huggingface.co/datasets/Lexmount/LexBench-Headless-Browser) | Raw CDP, browser-driver compatibility and web-platform behavior on deterministic fixtures |
|
| 30 |
-
| [LexBench-Trajectory-Replay](https://huggingface.co/datasets/Lexmount/LexBench-Trajectory-Replay) |
|
| 31 |
-
| [LexBench-WebArena-Replay](https://huggingface.co/datasets/Lexmount/LexBench-WebArena-Replay) |
|
| 32 |
|
| 33 |
Each dataset card describes its task scope, use, sources and evaluation limits. Derived datasets retain upstream attribution and document their changes.
|
| 34 |
|
|
|
|
| 15 |
|
| 16 |
## Browser Eval and LexBench
|
| 17 |
|
| 18 |
+
[Browser Eval](https://github.com/lexmount/browser-eval) compares browsers and web tools through direct tool calls and fixed browser trajectory replay. It favors programmatic scoring where tasks have definite answers, retains evidence for each result, and can turn saved results into local HTML reports readers can inspect, rebuild and share. Optional verification provides a separate check of the results.
|
| 19 |
|
| 20 |
Our versioned benchmark datasets are available here:
|
| 21 |
|
| 22 |
| Dataset | What it evaluates |
|
| 23 |
| --- | --- |
|
| 24 |
| [LexBench-Web-Fetch](https://huggingface.co/datasets/Lexmount/LexBench-Web-Fetch) | Page content, documents, structured records, resource discovery and file delivery |
|
| 25 |
+
| [LexBench-Web-Search](https://huggingface.co/datasets/Lexmount/LexBench-Web-Search) | Scenario search queries with relevance, ranking and explicit source requirements |
|
| 26 |
| [LexBench-WebMainBench](https://huggingface.co/datasets/Lexmount/LexBench-WebMainBench) | Main-content extraction from frozen HTML, using a reference-corrected upstream edition |
|
| 27 |
+
| [LexBench-SimpleQA-Verified](https://huggingface.co/datasets/Lexmount/LexBench-SimpleQA-Verified) | Factual retrieval questions and reference answers; composed with scenario queries by Browser Eval |
|
| 28 |
| [LexBench-WCXB](https://huggingface.co/datasets/Lexmount/LexBench-WCXB) | Source-qualified frozen web pages and extraction references |
|
| 29 |
| [LexBench-Headless-Browser](https://huggingface.co/datasets/Lexmount/LexBench-Headless-Browser) | Raw CDP, browser-driver compatibility and web-platform behavior on deterministic fixtures |
|
| 30 |
+
| [LexBench-Trajectory-Replay](https://huggingface.co/datasets/Lexmount/LexBench-Trajectory-Replay) | Browser Eval-authored public-web tasks with fixed actions and exact checks |
|
| 31 |
+
| [LexBench-WebArena-Replay](https://huggingface.co/datasets/Lexmount/LexBench-WebArena-Replay) | One official-task catalog, with versioned human-recording and corrected replay definitions |
|
| 32 |
|
| 33 |
Each dataset card describes its task scope, use, sources and evaluation limits. Derived datasets retain upstream attribution and document their changes.
|
| 34 |
|