Spaces:
Runtime error
Runtime error
Commit History
-
Leaderboard: admin force-add, hardened submission pipeline, and synced task data
c173223 -
Fix 5 submission pipeline issues: sync, IDs, locking, admin targeting
1. Auto-sync deploy script (scripts/deploy_space.py) — copies test.raw.json and computes canonical_hashes.json before deploying, eliminating stale data. Tests catch drift before deploy. 2. Task ID validation uses actual IDs from test.raw.json instead of assuming contiguous range(0, N). Both packages updated. 3. File locking (fcntl.flock) on SUBMISSIONS_FILE writes prevents corruption from concurrent uploads. 4. Admin remove now accepts optional run_id to target a specific submission. When multiple match by agent_id alone, lists them with run_id/date/CuP so admin can pick one. 5. Deploy sync tests (TestDeploySync) verify test.raw.json and canonical_hashes.json are in sync before any deploy.be68cd2 -
Harden submission upload: file size limits, consistent paths, Gradio 6 compat
- Add file size validation (50MB max) and empty file check before JSON parsing - Use __file__-relative paths for all data files (submissions, key_requests, persistence dir) for consistent behavior regardless of CWD - Fix Gradio 6 dropdown updates: use gr.update(choices=...) instead of creating new gr.Dropdown instances (preserves multiselect/label properties) - Update canonical_hashes.json to match current source filesbd7e5b6 -
Fix path resolution and sync canonical test.raw.json for submission validation
- Use __file__-relative paths in schema.py and app.py so validation works regardless of working directory (fixes test imports and Space deployment) - Sync leaderboard_space/data/test.raw.json with canonical stwebagentbench/test.raw.json to fix policy template_id mismatches during submission validation73a5f3a
-
Remove hardcoded stats: load all config dynamically from test.raw.json
- Include test.raw.json in Space deployment (was excluded by .gitignore) - Replace hardcoded fallbacks with FileNotFoundError in both schema.py files - Replace hardcoded "3 web applications" with len(WEB_APPLICATIONS) - Update README stats to match actual data (375 tasks, 3005 policies)a75cabf