Spaces:

gabeorlanski
/

bc_eval

Runtime error

gabeorlanski commited on Jul 21, 2023

Commit

bf34e9e

1 Parent(s): 2071b6f

Update bc_eval.py

Files changed (1) hide show

bc_eval.py CHANGED Viewed

@@ -247,7 +247,7 @@ def _eval_single_pred(result, test_ids, num_expected_commands):
             had_error = True
     if had_error:
-        return "HAD_ERROR", num_passed, test_case_results
     if did_test_fail:
         return "FAILED", num_passed, test_case_results

             had_error = True
     if had_error:
+        return "HAD_RUNTIME_ERROR", num_passed, test_case_results
     if did_test_fail:
         return "FAILED", num_passed, test_case_results