CRITICAL FIX: Add fallback category mappings for data without agenteval.json

ROOT CAUSE: The app was calculating 0.0 scores because:
1. No agenteval.json file exists in the data directory
2. Without it, benchmark_to_categories dict was empty
3. Category aggregation was skipped (line 162-167 in simple_data_loader.py)
4. Overall score calculation received empty list, resulted in None/0.0

SOLUTION: Add hard-coded fallback mappings when agenteval.json is missing:
- swe-bench, swe-bench-multimodal, commit0, multi-swe-bench → Bug Fixing
- swt-bench → Frontend Development
- gaia → Information Gathering

This ensures category aggregation works even without config file.

Tested locally: ✅ Shows real scores (57.767, 54.692, etc.)

Co-authored-by: openhands <openhands@all-hands.dev>

simple_data_loader.py

@@ -39,6 +39,9 @@ class SimpleLeaderboardViewer:
         # Build tag map from config - organize benchmarks by category
         self.tag_map = {}
         self.benchmark_to_categories = {}  # Maps benchmark name to its categories
+        
+        # Try loading from config first
+        config_has_mappings = False
         for split_config in self.suite_config.get("splits", []):
             if split_config["name"] == split:
                 for task in split_config.get("tasks", []):
@@ -54,6 +57,26 @@ class SimpleLeaderboardViewer:
                             if task_name not in self.tag_map[tag]:
                                 self.tag_map[tag].append(task_name)
                             self.benchmark_to_categories[task_name].append(tag)
+                            config_has_mappings = True
+        
+        # FALLBACK: If no mappings loaded from config, use hard-coded category mappings
+        if not config_has_mappings:
+            print("[DATA_LOADER] No agenteval.json found, using fallback category mappings")
+            fallback_mappings = {
+                'swe-bench': ['Bug Fixing'],
+                'swe-bench-multimodal': ['Bug Fixing'],
+                'commit0': ['Bug Fixing'],
+                'multi-swe-bench': ['Bug Fixing'],
+                'swt-bench': ['Frontend Development'],
+                'gaia': ['Information Gathering'],
+            }
+            for benchmark, categories in fallback_mappings.items():
+                self.benchmark_to_categories[benchmark] = categories
+                for category in categories:
+                    if category not in self.tag_map:
+                        self.tag_map[category] = []
+                    if benchmark not in self.tag_map[category]:
+                        self.tag_map[category].append(benchmark)
         
     def _load_from_agent_dirs(self):
         """Load data from new agent-centric directory structure (results/YYYYMMDD_model/)."""