| <!DOCTYPE html>
|
| <html lang="en">
|
| <head>
|
| <meta charset="UTF-8">
|
| <meta name="viewport" content="width=device-width, initial-scale=1.0">
|
| <title>RecallTrace OpenEnv</title>
|
| <link rel="preconnect" href="https://fonts.googleapis.com">
|
| <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
| <link href="https://fonts.googleapis.com/css2?family=Space+Grotesk:wght@400;500;700&family=IBM+Plex+Mono:wght@400;500&display=swap" rel="stylesheet">
|
| <link rel="stylesheet" href="/static/styles.css?v=4">
|
| </head>
|
| <body>
|
| <div class="page-shell">
|
| <header class="hero">
|
| <div class="hero-copy">
|
| <span class="eyebrow">Safety-Critical OpenEnv Benchmark</span>
|
| <h1>RecallTrace OpenEnv</h1>
|
| <p class="hero-text">
|
| A real-world supply-chain recall benchmark where agents must trace contaminated lots,
|
| follow relabeled inventory lineage, inspect evidence, and quarantine only the unsafe stock.
|
| </p>
|
| <div class="badge-row">
|
| <span class="badge">OpenEnv compliant</span>
|
| <span class="badge">Deterministic grading</span>
|
| <span class="badge">3 escalating tasks</span>
|
| <span class="badge">Precision containment</span>
|
| </div>
|
| </div>
|
| <div class="hero-panel">
|
| <div class="metric-card">
|
| <span class="metric-label">Average baseline</span>
|
| <strong id="metric-average">0.9677</strong>
|
| </div>
|
| <div class="metric-card">
|
| <span class="metric-label">Hard task focus</span>
|
| <strong>Mixed safe/unsafe inventory</strong>
|
| </div>
|
| <div class="metric-card">
|
| <span class="metric-label">Judging edge</span>
|
| <strong>Operational realism over toy mechanics</strong>
|
| </div>
|
| </div>
|
| </header>
|
|
|
| <main class="dashboard-grid">
|
| <section class="panel panel-accent">
|
| <div class="panel-header">
|
| <h2>Task Runner</h2>
|
| <p>Choose a task and run the deterministic baseline to inspect the full trajectory.</p>
|
| </div>
|
| <div class="controls">
|
| <label class="field">
|
| <span>Task level</span>
|
| <select id="task-select"></select>
|
| </label>
|
| <div class="button-row">
|
| <button id="reset-button" class="button button-secondary">Reset Task</button>
|
| <button id="run-button" class="button button-primary">Run Episode</button>
|
| <button id="run-all-button" class="button button-ghost">Run All Tasks</button>
|
| </div>
|
| </div>
|
| <div id="task-summary" class="task-summary"></div>
|
| </section>
|
|
|
| <section class="panel">
|
| <div class="panel-header">
|
| <h2>Scoreboard</h2>
|
| <p>Live summary of the current task and the multi-task baseline run.</p>
|
| </div>
|
| <div class="score-grid">
|
| <div class="score-card">
|
| <span>Current score</span>
|
| <strong id="current-score">-</strong>
|
| </div>
|
| <div class="score-card">
|
| <span>Steps taken</span>
|
| <strong id="current-steps">-</strong>
|
| </div>
|
| <div class="score-card">
|
| <span>Status</span>
|
| <strong id="current-status">Ready</strong>
|
| </div>
|
| <div class="score-card">
|
| <span>Average over all tasks</span>
|
| <strong id="all-score">-</strong>
|
| </div>
|
| </div>
|
| <div id="all-results" class="all-results empty-state">Run all tasks to compare easy, medium, and hard performance.</div>
|
| </section>
|
|
|
| <section class="panel panel-wide">
|
| <div class="panel-header">
|
| <h2>Episode Output</h2>
|
| <p>Visual baseline trajectory, readable action summaries, and final grading highlights.</p>
|
| </div>
|
| <div class="episode-layout">
|
| <div class="episode-visuals">
|
| <div class="mini-panel">
|
| <h3>Reward Curve</h3>
|
| <div id="reward-chart" class="reward-chart empty-state">Run a task to render the reward trajectory.</div>
|
| </div>
|
| <div class="mini-panel">
|
| <h3>Final Outcome</h3>
|
| <div id="final-summary" class="final-summary empty-state">Readable scoring highlights will appear here.</div>
|
| </div>
|
| </div>
|
| <div id="episode-log" class="episode-log empty-state">Run a task to populate the episode trajectory.</div>
|
| </div>
|
| </section>
|
|
|
| <section class="panel">
|
| <div class="panel-header">
|
| <h2>Judge Lens</h2>
|
| </div>
|
| <div class="highlight-stack">
|
| <div class="highlight-card">
|
| <span class="highlight-title">Real-world utility</span>
|
| <p>Models a safety-critical recall workflow that QA, operations, and supply-chain teams actually perform.</p>
|
| </div>
|
| <div class="highlight-card">
|
| <span class="highlight-title">Frontier challenge</span>
|
| <p>The hard task forces precision containment of mixed safe and unsafe stock under partial observability.</p>
|
| </div>
|
| <div class="highlight-card">
|
| <span class="highlight-title">Benchmark quality</span>
|
| <p>Deterministic graders evaluate precision, coverage, investigation depth, and efficiency with reproducible scores.</p>
|
| </div>
|
| </div>
|
| </section>
|
|
|
| <section class="panel">
|
| <div class="panel-header">
|
| <h2>Project Hub</h2>
|
| </div>
|
| <div class="link-list">
|
| <a href="/health" target="_blank" rel="noreferrer">Health endpoint</a>
|
| <a href="/reset" target="_blank" rel="noreferrer">Reset endpoint</a>
|
| <a href="/tasks" target="_blank" rel="noreferrer">Task catalog JSON</a>
|
| <a href="https://github.com/MS-Shamanth/recalltrace-openenv/tree/sham" target="_blank" rel="noreferrer">GitHub source</a>
|
| <a href="https://huggingface.co/spaces/ms-shamanth/recalltrace-openenv/tree/main" target="_blank" rel="noreferrer">Space files</a>
|
| <a href="https://www.docker.com/" target="_blank" rel="noreferrer">Docker runtime</a>
|
| <a href="https://github.com/openenvai/openenv" target="_blank" rel="noreferrer">OpenEnv ecosystem</a>
|
| </div>
|
| </section>
|
| </main>
|
| </div>
|
| <script src="/static/app.js?v=4"></script>
|
| </body>
|
| </html>
|
|
|
