fix: remove function aliases from grader_api, classes only, NaN protection d500ed3 Deepikachintamreddy commited on Apr 12
fix: grader classes with grade() method per Meta feedback b5751d2 Deepikachintamreddy commited on Apr 12
fix: grader handles all call patterns, reset reward 0.01 b17299b Deepikachintamreddy commited on Apr 12
fix: class-based graders with grade() method per Meta instructions b5fc338 Deepikachintamreddy commited on Apr 12
fix: bulletproof graders - never throw, always return float in range 5b5379b Deepikachintamreddy commited on Apr 12
fix: correct step format, per-task output, tuple grader returns c7b11e5 Deepikachintamreddy commited on Apr 12
FINAL: emit per-task START/END blocks for validator task counting 529657f Deepikachintamreddy commited on Apr 12
fix: clamp inference.py scores to (0.001, 0.999) strictly 8401a46 Deepikachintamreddy commited on Apr 12
SIMPLIFY: Override /reset to create fresh environment directly, avoiding original endpoint call cf3a550 Nanda Kumar Kondreddy commited on Apr 11
FIX: Properly type request parameter in /reset endpoint as fastapi.Request a91aa82 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL FIX: Replace /reset middleware with direct endpoint override - ensure base fields included f2a42f5 Nanda Kumar Kondreddy commited on Apr 11
ENHANCE: Update reset middleware to include base Observation fields (done, reward, metadata) at top level 270a32f Nanda Kumar Kondreddy commited on Apr 11
FIX: Add middleware to correct /reset response schema - add 'info' field, remove reward/done 5bc98e9 Nanda Kumar Kondreddy commited on Apr 11
FIX: Remove incorrect action wrapper in HTTPEnvClient.step() - POST body must be direct ConfigDebugAction, not nested 9f8c7b6 Nanda Kumar Kondreddy commited on Apr 11
Add comprehensive instrumentation to all graders for validator diagnostic 4891046 Nanda Kumar Kondreddy commited on Apr 11
Fix OpenEnv API step payload format - wrap action in action key 73a9696 Nanda Kumar Kondreddy commited on Apr 11
Add detailed instrumentation to grade_task1 and normalize_reward for validator debugging 31647f3 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL RUNTIME FIX: Remove tuple unpacking from environment handlers - graders now return FLOAT only, not tuples b8c69e2 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL FIX: Graders now return FLOAT ONLY (not tuples) for validator contract compliance - extracted float from raw grader tuples c256e38 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL FIX: Wrappers now return full tuples (reward, error, bugs) instead of just floats - fixes env.py unpacking cf1808d Nanda Kumar Kondreddy commited on Apr 11
Add comprehensive runtime grader validation endpoint (/validate-graders) to audit actual grader outputs under validator-style conditions 5e5a089 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL WIRING FIX: Import wrapped graders from grader_api, not raw graders - ensures normalization is used 1566ba9 Nanda Kumar Kondreddy commited on Apr 11
FINAL FIX: Centralized universal reward normalization - GUARANTEES all scores in (0.01, 0.99) 6d73738 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL BUG FIX: Clamp reward on ALL early return paths - prevents returning 0.0 6138889 Nanda Kumar Kondreddy commited on Apr 11
Enhanced /diagnostics: validate manifest import paths with importlib (mirrors validator behavior) c87f77e Nanda Kumar Kondreddy commited on Apr 11
Add startup and diagnostics logging to debug task loading 9331aaf Nanda Kumar Kondreddy commited on Apr 11
Simplify metadata task schema to minimal fields (id, has_grader) for validator compatibility 491de7d Nanda Kumar Kondreddy commited on Apr 11
PROPER FIX: Remove default /metadata route before registering custom override with tasks 3a48cf2 Nanda Kumar Kondreddy commited on Apr 11
CRITICAL FIX: Add /metadata endpoint with task enumeration for validator discovery a2f8fcd Nanda Kumar Kondreddy commited on Apr 11
Add validator invocation logging to all grader wrappers e924908 Nanda Kumar Kondreddy commited on Apr 11
Fix: Enforce strict open interval (0.01, 0.99) for all grader rewards - validator compliance 8e7ae76 Nanda Kumar Kondreddy commited on Apr 11
Phase 2: Benchmark Quality Upgrades - Progressive graders, realistic multi-bug tasks, ground_truth exposure b43aff5 Nanda Kumar Kondreddy commited on Apr 11