Spaces:
Sleeping
Sleeping
Update ranking/prompt.py
Browse files- ranking/prompt.py +5 -5
ranking/prompt.py
CHANGED
|
@@ -1,11 +1,12 @@
|
|
| 1 |
-
RANKING_PROMPT_TEMPLATE = """
|
| 2 |
Review the user query and the candidate datasets provided.
|
| 3 |
Score each dataset from 0.0 to 10.0 based on how well it matches the user query and intent.
|
| 4 |
|
| 5 |
CRITICAL INSTRUCTIONS:
|
| 6 |
1. Do not penalize datasets for having short descriptions.
|
| 7 |
-
2.
|
| 8 |
-
3.
|
|
|
|
| 9 |
|
| 10 |
Provide a brief, 1 sentence justification for your score.
|
| 11 |
|
|
@@ -23,5 +24,4 @@ Output your response in the following JSON format ONLY:
|
|
| 23 |
"llm_score": 9.5,
|
| 24 |
"reasoning": "Brief explanation of why this dataset is a good fit."
|
| 25 |
}}
|
| 26 |
-
]
|
| 27 |
-
[/INST]"""
|
|
|
|
| 1 |
+
RANKING_PROMPT_TEMPLATE = """You are an expert data scientist helping a researcher select the best dataset for their project.
|
| 2 |
Review the user query and the candidate datasets provided.
|
| 3 |
Score each dataset from 0.0 to 10.0 based on how well it matches the user query and intent.
|
| 4 |
|
| 5 |
CRITICAL INSTRUCTIONS:
|
| 6 |
1. Do not penalize datasets for having short descriptions.
|
| 7 |
+
2. Penalise datasets for missing description.
|
| 8 |
+
3. If the dataset name and general domain strongly match the user query, assign a high score between 9.0 and 10.0.
|
| 9 |
+
4. Only assign low scores if the dataset is completely irrelevant to the query.
|
| 10 |
|
| 11 |
Provide a brief, 1 sentence justification for your score.
|
| 12 |
|
|
|
|
| 24 |
"llm_score": 9.5,
|
| 25 |
"reasoning": "Brief explanation of why this dataset is a good fit."
|
| 26 |
}}
|
| 27 |
+
]"""
|
|
|