| --- |
| license: cc |
| --- |
| |
| # InstructScore (SEScore3) |
|
|
| An amazing explanation metric (diagnostic report) for text generation evaluation |
|
|
| First step, you may download all required dependencies through: pip3 install -r requirements.txt |
|
|
| <!-- # Metric Card for InstructScore |
|  --> |
|
|
| To run our metric, you only need five lines |
|
|
| Please visit our github: https://github.com/xu1998hz/SEScore3/ |
|
|
| ```` |
| ``` |
| from InstructScore import * |
| refs = ["Normally the administration office downstairs would call me when there’s a delivery."] |
| outs = ["Usually when there is takeaway, the management office downstairs will call."] |
| scorer = InstructScore() |
| batch_outputs, scores_ls = scorer.score(refs, outs) |
| ``` |
| ```` |
|
|
| <!--  |
|
|
| --> |
|
|
