Jash-K commited on
Commit
26b571e
·
verified ·
1 Parent(s): 8d7ee06

Update ranking/prompt.py

Browse files
Files changed (1) hide show
  1. ranking/prompt.py +5 -5
ranking/prompt.py CHANGED
@@ -1,11 +1,12 @@
1
- RANKING_PROMPT_TEMPLATE = """[INST] You are an expert data scientist helping a researcher select the best dataset for their project.
2
  Review the user query and the candidate datasets provided.
3
  Score each dataset from 0.0 to 10.0 based on how well it matches the user query and intent.
4
 
5
  CRITICAL INSTRUCTIONS:
6
  1. Do not penalize datasets for having short descriptions.
7
- 2. If the dataset name and general domain strongly match the user query, assign a high score between 9.0 and 10.0.
8
- 3. Only assign low scores if the dataset is completely irrelevant to the query.
 
9
 
10
  Provide a brief, 1 sentence justification for your score.
11
 
@@ -23,5 +24,4 @@ Output your response in the following JSON format ONLY:
23
  "llm_score": 9.5,
24
  "reasoning": "Brief explanation of why this dataset is a good fit."
25
  }}
26
- ]
27
- [/INST]"""
 
1
+ RANKING_PROMPT_TEMPLATE = """You are an expert data scientist helping a researcher select the best dataset for their project.
2
  Review the user query and the candidate datasets provided.
3
  Score each dataset from 0.0 to 10.0 based on how well it matches the user query and intent.
4
 
5
  CRITICAL INSTRUCTIONS:
6
  1. Do not penalize datasets for having short descriptions.
7
+ 2. Penalise datasets for missing description.
8
+ 3. If the dataset name and general domain strongly match the user query, assign a high score between 9.0 and 10.0.
9
+ 4. Only assign low scores if the dataset is completely irrelevant to the query.
10
 
11
  Provide a brief, 1 sentence justification for your score.
12
 
 
24
  "llm_score": 9.5,
25
  "reasoning": "Brief explanation of why this dataset is a good fit."
26
  }}
27
+ ]"""