Update README.md
Browse files
README.md
CHANGED
|
@@ -41,6 +41,7 @@ Also, check out our dataset as well on [this page](https://huggingface.co/datase
|
|
| 41 |
|
| 42 |
## Prompt Format
|
| 43 |
Prometheus requires 4 components in the input: An instruction, a response to evaluate, a score rubric, and a reference answer. You could refer to the prompt format below.
|
|
|
|
| 44 |
```
|
| 45 |
###Task Description:
|
| 46 |
An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
|
|
@@ -69,6 +70,7 @@ Score 5: {score5_description}
|
|
| 69 |
###Feedback:
|
| 70 |
```
|
| 71 |
|
|
|
|
| 72 |
|
| 73 |
## License
|
| 74 |
Feedback Collection and Prometheus is subject to OpenAI's Terms of Use for the generated data. If you suspect any violations, please reach out to us.
|
|
|
|
| 41 |
|
| 42 |
## Prompt Format
|
| 43 |
Prometheus requires 4 components in the input: An instruction, a response to evaluate, a score rubric, and a reference answer. You could refer to the prompt format below.
|
| 44 |
+
You should fill in the instruction, response, reference answer, criteria description, and score description for score in range of 1 to 5.
|
| 45 |
```
|
| 46 |
###Task Description:
|
| 47 |
An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
|
|
|
|
| 70 |
###Feedback:
|
| 71 |
```
|
| 72 |
|
| 73 |
+
As a result, a feedback and score decision will be generated, divided by a separating phrase ```[RESULT]```
|
| 74 |
|
| 75 |
## License
|
| 76 |
Feedback Collection and Prometheus is subject to OpenAI's Terms of Use for the generated data. If you suspect any violations, please reach out to us.
|