| license: apache-2.0 | |
| library_name: pytorch | |
| pipeline_tag: text-generation | |
| tags: | |
| - code | |
| - code-generation | |
| # selection-coder-100m | |
| A 212.4M-parameter Python code model. Context length 2048. | |
| ## Benchmarks (pass@1, greedy) | |
| | Benchmark | standard | reasoning | | |
| |---|---|---| | |
| | HumanEval | 0.61% | 0.0% | | |
| | MBPP | 3.5% | 0.5% | | |
| _reasoning = chain-of-thought prompt + 2 self-refine iterations._ | |
| ## Usage | |
| ``` | |
| ### Instruction: | |
| <your task> | |
| ### Response: | |
| ``` | |