Spaces:
Sleeping
Sleeping
Update app.py
Browse files
app.py
CHANGED
|
@@ -149,7 +149,8 @@ def get_advanced_evaluation(kb, question, answer):
|
|
| 149 |
- Provide a 'confidence' score (0-100) based on how clearly the answer matches the KB.
|
| 150 |
4. Extract 'irrelevant_snippets': Parts of the answer that don't help answer the question.
|
| 151 |
5. Extract 'contradictions': Parts of the answer that factually conflict with the KB.
|
| 152 |
-
6.
|
|
|
|
| 153 |
|
| 154 |
Knowledge Base: {kb}
|
| 155 |
Question: {question}
|
|
|
|
| 149 |
- Provide a 'confidence' score (0-100) based on how clearly the answer matches the KB.
|
| 150 |
4. Extract 'irrelevant_snippets': Parts of the answer that don't help answer the question.
|
| 151 |
5. Extract 'contradictions': Parts of the answer that factually conflict with the KB.
|
| 152 |
+
6. Penalise scores based on spelling and grammatical mistakes in the answer, but reduce score in accordance to the number of words in the answers. So if there are 2 grammatical/spelling mistakes in a 100 words, then the penalty will be less than if there are 2 grammmatical/spelling mistakes in a 25 words answer
|
| 153 |
+
7. Suggest a 'total_score' (0-100) and 'feedback'.
|
| 154 |
|
| 155 |
Knowledge Base: {kb}
|
| 156 |
Question: {question}
|