Spaces:

ianalloway
/

browser-agent-benchmark

Running

App Files Files Community

ianalloway commited on Jun 29

Commit

d3ebf05

verified ·

1 Parent(s): 21fb6f3

Upload folder using huggingface_hub

Browse files

Files changed (5) hide show

.nojekyll +0 -0
README.md +1 -3
app.py +0 -41
index.html +56 -0
requirements.txt +0 -2

.nojekyll ADDED Viewed

File without changes

README.md CHANGED Viewed

@@ -3,9 +3,7 @@ title: Browser Agent Benchmark
 emoji: 🧭
 colorFrom: blue
 colorTo: purple
-sdk: gradio
-sdk_version: 5.0.0
-app_file: app.py
 pinned: false
 license: mit
 short_description: Real-world browser automation as an agent benchmark

 emoji: 🧭
 colorFrom: blue
 colorTo: purple
+sdk: static
 pinned: false
 license: mit
 short_description: Real-world browser automation as an agent benchmark

app.py DELETED Viewed

@@ -1,41 +0,0 @@
-import gradio as gr
-POST_URL = "https://allowayai.substack.com/p/the-browser-is-the-real-agent-benchmark"
-CHECKLIST = """
-## Real-world browser agent checklist
-A browser agent is not production-ready until it can handle:
-- persistent authenticated profiles
-- MFA / CAPTCHA handoff without credential leakage
-- iframe switching
-- Shadow DOM traversal
-- ProseMirror / Quill rich-text editors
-- passkey/WebAuthn dead ends
-- viewport and responsive layout shifts
-- final-state verification with a receipt
-The core idea: do not claim success because the script exited. Claim success only after the public page, admin state, screenshot, or server response proves it.
-"""
-with gr.Blocks(title="Browser Agent Benchmark") as demo:
-    gr.Markdown(
-        """
-# The browser is the real agent benchmark
-Most agent demos skip the part that breaks in production: real websites.
-This is a small public companion to Ian Alloway's write-up on browser agents, publishing automation, and why agent work needs receipts instead of vibes.
-[Read the full post on Substack](%s)
-        """ % POST_URL
-    )
-    gr.Markdown(CHECKLIST)
-    with gr.Row():
-        gr.Button("Open the post", link=POST_URL)
-        gr.Button("Ian on GitHub", link="https://github.com/ianalloway")
-        gr.Button("Portfolio", link="https://ianalloway.xyz")
-if __name__ == "__main__":
-    demo.launch()

index.html ADDED Viewed

	@@ -0,0 +1,56 @@

+<!doctype html>
+<html lang="en">
+<head>
+  <meta charset="utf-8" />
+  <meta name="viewport" content="width=device-width, initial-scale=1" />
+  <title>The browser is the real agent benchmark</title>
+  <meta name="description" content="A real-world browser automation checklist for AI agents: auth, iframes, Shadow DOM, rich-text editors, and receipts." />
+  <style>
+    :root { color-scheme: dark; --bg: #090b12; --fg: #eef2ff; --muted: #a8b3cf; --card: #111827; --line: #263044; --accent: #8b5cf6; --accent2: #38bdf8; }
+    * { box-sizing: border-box; }
+    body { margin: 0; font-family: ui-sans-serif, system-ui, -apple-system, BlinkMacSystemFont, "Segoe UI", sans-serif; background: radial-gradient(circle at top left, rgba(139,92,246,.22), transparent 35%), radial-gradient(circle at bottom right, rgba(56,189,248,.16), transparent 30%), var(--bg); color: var(--fg); line-height: 1.6; }
+    main { max-width: 920px; margin: 0 auto; padding: 64px 24px 80px; }
+    .eyebrow { color: var(--accent2); text-transform: uppercase; letter-spacing: .18em; font-size: .8rem; font-weight: 700; }
+    h1 { font-size: clamp(2.3rem, 6vw, 5rem); line-height: .96; margin: 18px 0 22px; letter-spacing: -.05em; }
+    .lede { font-size: clamp(1.1rem, 2vw, 1.35rem); color: var(--muted); max-width: 720px; }
+    .actions { display: flex; flex-wrap: wrap; gap: 12px; margin: 30px 0 46px; }
+    a.button { color: white; text-decoration: none; border: 1px solid var(--line); padding: 12px 16px; border-radius: 999px; background: rgba(255,255,255,.05); }
+    a.primary { background: linear-gradient(135deg, var(--accent), var(--accent2)); border: 0; color: #06111f; font-weight: 800; }
+    section { background: rgba(17,24,39,.72); border: 1px solid var(--line); border-radius: 22px; padding: 24px; margin: 18px 0; backdrop-filter: blur(12px); }
+    h2 { margin-top: 0; letter-spacing: -.02em; }
+    li { margin: 8px 0; }
+    code { background: rgba(255,255,255,.08); padding: 2px 6px; border-radius: 6px; }
+    footer { color: var(--muted); margin-top: 34px; font-size: .95rem; }
+  </style>
+</head>
+<body>
+<main>
+  <div class="eyebrow">Real-world agent evals</div>
+  <h1>The browser is the real agent benchmark</h1>
+  <p class="lede">Most agent demos skip the part that breaks in production: real websites. Auth flows, iframes, Shadow DOM, rich-text editors, redirects, passkeys, and verification receipts.</p>
+  <div class="actions">
+    <a class="button primary" href="https://allowayai.substack.com/p/the-browser-is-the-real-agent-benchmark">Read the full write-up</a>
+    <a class="button" href="https://github.com/ianalloway">GitHub</a>
+    <a class="button" href="https://ianalloway.xyz">Portfolio</a>
+  </div>
+  <section>
+    <h2>What the benchmark cares about</h2>
+    <ul>
+      <li>Persistent authenticated browser profiles.</li>
+      <li>MFA and CAPTCHA handoff without leaking credentials.</li>
+      <li>Iframe switching and Shadow DOM traversal.</li>
+      <li>ProseMirror and Quill rich-text editors.</li>
+      <li>Passkey/WebAuthn prompts that sit outside the DOM.</li>
+      <li>Responsive layout shifts and hidden controls.</li>
+      <li>Final-state verification instead of trusting a process exit.</li>
+    </ul>
+  </section>
+  <section>
+    <h2>Receipts over vibes</h2>
+    <p>If an agent says it posted, submitted, updated, or paid for something, it needs a receipt: a final URL, a DOM state, a server response, a public page check, or a screenshot.</p>
+    <p>That is the difference between a chatbot and infrastructure.</p>
+  </section>
+  <footer>Built by Ian Alloway · public companion page for the Substack post.</footer>
+</main>
+</body>
+</html>

requirements.txt DELETED Viewed

	@@ -1,2 +0,0 @@
1	- gradio>=5.0.0
2	- pyaudioop>=0.2.0