Spaces:
Runtime error
Runtime error
codellama-CodeLlama-7b-hf
/
Llama2-Code-Interpreter-main
/OpenCodeInterpreter
/evaluation
/evalplus
/.github
/ISSUE_TEMPLATE
/buggy_contract.yml
| name: "π Report Bad Contract" | |
| description: Report to us that certain program contract should be repaired. | |
| title: "π [TestRemoval] - <TASK_ID> <WHY>" | |
| labels: ["program contract"] | |
| body: | |
| - type: input | |
| id: version | |
| attributes: | |
| label: "EvalPlus version" | |
| description: What is the version of EvalPlus? You can find it by running `pip show evalplus`. | |
| placeholder: For example, 0.1.0 | |
| validations: | |
| required: true | |
| - type: input | |
| id: cache | |
| attributes: | |
| label: "Output of running `ls ~/.cache/evalplus`" | |
| validations: | |
| required: true | |
| - type: input | |
| id: task_id | |
| attributes: | |
| label: "Task ID of the programming task" | |
| placeholder: HumanEval/[??] | |
| validations: | |
| required: true | |
| - type: textarea | |
| id: original | |
| attributes: | |
| label: "The original wrong contract" | |
| description: You can run `python -c "from evalplus.data import get_human_eval_plus; print(get_human_eval_plus()['HumanEval/β']['contract'])"` | |
| render: python | |
| validations: | |
| required: true | |
| - type: textarea | |
| id: new | |
| attributes: | |
| label: "Your proposed new contract" | |
| render: python | |
| validations: | |
| required: true | |
| - type: textarea | |
| id: other | |
| attributes: | |
| label: "Other context" | |
| description: (Optional) Anything else the maintainer should notice? | |
| validations: | |
| required: false | |