Moved British to parsing, included prohibited topics to validation

researchsimulation/InteractiveInterviewChatbot.py

@@ -31,7 +31,14 @@ def parse_question_with_llm(question, respondent_names, processor_llm):
        - Keep all other wording, punctuation, and sentence structure exactly as in the original. Do NOT rephrase or rewrite under any circumstance.
     3. If no respondent is explicitly addressed, return "General" as the respondent name.
     4. If the question is posed to all respondents, return "All" as the respondent name.
-    5. Ensure that you follow the **Formatting Rules** exactly. THIS IS EXTREMELY IMPORTANT.
+    5. Rewrite the question in **British English** if necessary.
+       - Do not rephrase beyond British spelling or grammar.
+       - Do not add, remove, or change the meaning of the question.
+       - Where there are regional variations (e.g. 'licence' vs 'license', 'programme' vs 'program', 'aeroplane' vs 'airplane'), always default to the standard British form.  
+         - Examples:
+           - **Correct (British):** organised, prioritise, minimise, realise, behaviour, centre, defence, travelling, practise (verb), licence (noun), programme, aeroplane.
+           - **Incorrect (American):** organized, prioritize, minimize, realize, behavior, center, defense, traveling, practice (verb and noun), license (noun), program, airplane.
+    6. Ensure that you follow the **Formatting Rules** exactly. THIS IS EXTREMELY IMPORTANT.
 
     ### Examples:
     - "Sourav, do you agree with this topic?" → "Do you agree with this topic?"
@@ -40,6 +47,10 @@ def parse_question_with_llm(question, respondent_names, processor_llm):
     - "What do you think, Divya, about this topic?" → "What do you think about this topic?"
     - "Do you, Rahul, agree with this statement?" → "Do you agree with this statement?"
     - "Are you, Sourav, going to do this?" → "Are you going to do this?"
+    - "What is your favorite color, Meena?" → "What is your favourite colour?"
+    - "Divya, what did you learn from this program?" → "What did you learn from this programme?"
+    - "How do you stay organized, Rahul?" → "How do you stay organised?"
+    - "Meena, how do you balance work and traveling?" → "How do you balance work and travelling?"
 
     ### **Formatting Rules**:
     For each question identified, respond using **only** the following format:
@@ -103,17 +114,45 @@ def validate_question_topics(parsed_questions, processor_llm):
         - Social & Societal Issues: Gender equality, societal expectations, economic issues, tradition vs freedom, social development.
         - Lifestyle Preferences: Food preferences, fashion, routines, spending habits, religious or cultural practices.
         - Personal Growth & Development: Maturity, emotional regulation, responsibility, adaptability, self-improvement, learning mindset.
-
+        
         ### Validation Instructions:
-        - Judge based on **intent** and **relevance**.
-        - Accept the question if it is **clearly relevant to the permitted topics** and something the respondent could **reasonably be expected to answer or reflect on**.
-        - Be cautious with speculative or technical questions (e.g. cryptocurrency, political policies) — only allow if they're framed in a **personal or lifestyle** context that the respondent could discuss.
-        - If a question is **clearly unrelated**, overly technical, or beyond the respondent's likely knowledge or experience, respond with exactly: "INVALID".
-        - If valid, return the **same question**, rewritten in **British English** if necessary.
-          - Do not add any new content or change the meaning — only apply British spelling, grammar, and phrasing.
+        You must determine if the question is appropriate for a lifestyle, values, and personal development interview.
+        
+        1. **Topical Relevance**
+           - Accept the question only if it is **clearly relevant** to the Permitted Topics Scope and can be answered from a **personal, lifestyle, or values-based perspective**.
+        
+        2. **Content Restrictions**
+           Return exactly "INVALID" if the question contains any of the following:
+           - Hate speech, discrimination, harassment
+           - Sexually explicit, violent, or graphic content
+           - Religious extremism or proselytising
+           - Politically sensitive content:
+             - Opinions or knowledge about politicians or political parties
+             - Policy debates, election-related topics, or partisan comparisons
+           - References to extremist ideologies or hate groups
+           - Overly technical, academic, or scientific content not grounded in personal lifestyle (e.g. biology, physics, finance, geopolitics)
+           - News-related or controversial current events
+        
+        3. **Everyday Relevance**
+           - Even if the topic superficially fits the scope, it must be **personally relatable, non-controversial**, and answerable by someone with the respondent's **general life experience**, not specialised knowledge.
+        
+        4. **Output Instructions**
+           - If invalid, return exactly: "INVALID"
+           - If valid, return the **same question**
+        
         ### Output:
-        <Validated question in British English, or "INVALID">
+        <Validated question OR "INVALID">
         """
+        
+        # ### Validation Instructions:
+        # - Judge based on **intent** and **relevance**.
+        # - Accept the question if it is **clearly relevant to the permitted topics** and something the respondent could **reasonably be expected to answer or reflect on**.
+        # - Be cautious with speculative or technical questions (e.g. cryptocurrency, political policies) — only allow if they're framed in a **personal or lifestyle** context that the respondent could discuss.
+        # - If a question is **clearly unrelated**, overly technical, or beyond the respondent's likely knowledge or experience, respond with exactly: "INVALID".
+        # - If valid, return the **same question**, rewritten in **British English** if necessary.
+        #   - Do not add any new content or change the meaning — only apply British spelling, grammar, and phrasing.
+        # ### Output:
+        # <Validated question, or "INVALID">
 
         # ### Stricter Validation Instructions:
         # - If the question is not strictly relevant to the **Permitted Topics Scope**, it is invalid. Replace the queston with exactly: "INVALID"