heerjtdev commited on
Commit
b595d0a
·
verified ·
1 Parent(s): 2307277

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +2 -1
app.py CHANGED
@@ -149,7 +149,8 @@ def get_advanced_evaluation(kb, question, answer):
149
  - Provide a 'confidence' score (0-100) based on how clearly the answer matches the KB.
150
  4. Extract 'irrelevant_snippets': Parts of the answer that don't help answer the question.
151
  5. Extract 'contradictions': Parts of the answer that factually conflict with the KB.
152
- 6. Suggest a 'total_score' (0-100) and 'feedback'.
 
153
 
154
  Knowledge Base: {kb}
155
  Question: {question}
 
149
  - Provide a 'confidence' score (0-100) based on how clearly the answer matches the KB.
150
  4. Extract 'irrelevant_snippets': Parts of the answer that don't help answer the question.
151
  5. Extract 'contradictions': Parts of the answer that factually conflict with the KB.
152
+ 6. Penalise scores based on spelling and grammatical mistakes in the answer, but reduce score in accordance to the number of words in the answers. So if there are 2 grammatical/spelling mistakes in a 100 words, then the penalty will be less than if there are 2 grammmatical/spelling mistakes in a 25 words answer
153
+ 7. Suggest a 'total_score' (0-100) and 'feedback'.
154
 
155
  Knowledge Base: {kb}
156
  Question: {question}