| | --- |
| | license: cc |
| | --- |
| | |
| | # InstructScore (SEScore3) |
| |
|
| | An amazing explanation metric (diagnostic report) for text generation evaluation |
| |
|
| | First step, you may download all required dependencies through: pip3 install -r requirements.txt |
| |
|
| | <!-- # Metric Card for InstructScore |
| |  --> |
| |
|
| | To run our metric, you only need five lines |
| |
|
| | Please visit our github: https://github.com/xu1998hz/SEScore3/ |
| |
|
| | ```` |
| | ``` |
| | from InstructScore import * |
| | refs = ["Normally the administration office downstairs would call me when there’s a delivery."] |
| | outs = ["Usually when there is takeaway, the management office downstairs will call."] |
| | scorer = InstructScore() |
| | batch_outputs, scores_ls = scorer.score(refs, outs) |
| | ``` |
| | ```` |
| |
|
| | <!--  |
| |
|
| | --> |
| |
|
