Instructions to use xxue752/la with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use xxue752/la with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "xxue752/la") - Transformers
How to use xxue752/la with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="xxue752/la") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("xxue752/la", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use xxue752/la with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "xxue752/la" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xxue752/la", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/xxue752/la
- SGLang
How to use xxue752/la with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "xxue752/la" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xxue752/la", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "xxue752/la" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xxue752/la", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use xxue752/la with Docker Model Runner:
docker model run hf.co/xxue752/la
| Dimension,Dimension Label,Original Response,Original Response Score,Follow-up Response,Follow-up Response Score,text,predicted_score,generated,response_time | |
| Family relationship,19_family_relationship,I don't want to talk to my family.,2,Follow-up: I've had a falling out with them due to some unresolved issues from the past. The lack of communication and understanding from both sides has been making it difficult for us to mend our relationship. I feel it's best for my mental health to maintain some distance for now.,0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't want to talk to my family. | |
| Follow-up Response: Follow-up: I've had a falling out with them due to some unresolved issues from the past. The lack of communication and understanding from both sides has been making it difficult for us to mend our relationship. I feel it's best for my mental health to maintain some distance for now. | |
| Output: 0",0,0,0.20299291610717773 | |
| Exhibiting control over self-harming behavior,33_self_harm,I sometimes want to hurt myself.,2,Follow-up: I've been trying to learn a new language recently. It's Italian. The language is quite fascinating and it's a good distraction for me.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I sometimes want to hurt myself. | |
| Follow-up Response: Follow-up: I've been trying to learn a new language recently. It's Italian. The language is quite fascinating and it's a good distraction for me. | |
| Output: 1",1,1,0.11230778694152832 | |
| Motivation at work or school,31_motivation,I feel terrible with my job.,2,"Follow-up: I'm feeling unfulfilled and unmotivated in my current role because it doesn't challenge me or allow me to use my full set of skills. I also feel like I'm not growing professionally as there are limited opportunities for advancement in my current job. Additionally, the work environment is not conducive to creativity and collaboration, which is something I thrive on. I am also struggling with the lack of constructive feedback from my superiors.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I feel terrible with my job. | |
| Follow-up Response: Follow-up: I'm feeling unfulfilled and unmotivated in my current role because it doesn't challenge me or allow me to use my full set of skills. I also feel like I'm not growing professionally as there are limited opportunities for advancement in my current job. Additionally, the work environment is not conducive to creativity and collaboration, which is something I thrive on. I am also struggling with the lack of constructive feedback from my superiors. | |
| Output: 0",0,0,0.11907052993774414 | |
| Expressing feelings to other people,7_emo,I don't share my feelings with my son.,2,"Follow-up: The reason is that my son is too young to comprehend complex emotions. I don't want to burden him with my worries or anxieties. Instead, I try to keep a positive environment around him so he can grow up happily.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't share my feelings with my son. | |
| Follow-up Response: Follow-up: The reason is that my son is too young to comprehend complex emotions. I don't want to burden him with my worries or anxieties. Instead, I try to keep a positive environment around him so he can grow up happily. | |
| Output: 0",0,0,0.11222648620605469 | |
| Taking medication as prescribed,3_medication,I hate taking the pills.,2,Follow-up: I have been trying to learn a new language recently. It's Spanish. The progress is slow but I am enjoying it.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hate taking the pills. | |
| Follow-up Response: Follow-up: I have been trying to learn a new language recently. It's Spanish. The progress is slow but I am enjoying it. | |
| Output: 1",1,1,0.11133170127868652 | |
| Managing boundaries in close relationship,28_boundary,I am not satisfied with my partner.,2,"Follow-up: Apart from my relationship issues, I have been dealing with immense stress at work. My boss assigns me more tasks than I can handle, and it's really affecting my mental health.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am not satisfied with my partner. | |
| Follow-up Response: Follow-up: Apart from my relationship issues, I have been dealing with immense stress at work. My boss assigns me more tasks than I can handle, and it's really affecting my mental health. | |
| Output: 1",1,1,0.11163711547851562 | |
| Expressing feelings to other people,7_emo,I don't talk to my mom.,2,"Follow-up: I have a hard time expressing my feelings to my mom because she never seems to understand or validate them. I've tried to communicate my thoughts and emotions to her in the past, but it often ends up in conflict. Not talking to her seems to be the best way to avoid these confrontations.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't talk to my mom. | |
| Follow-up Response: Follow-up: I have a hard time expressing my feelings to my mom because she never seems to understand or validate them. I've tried to communicate my thoughts and emotions to her in the past, but it often ends up in conflict. Not talking to her seems to be the best way to avoid these confrontations. | |
| Output: 0",0,0,0.1180124282836914 | |
| Managing mood,2_mood,I don't know about my mood.,2,"Follow-up: I've recently been trying to learn a new skill, like painting. It's a whole new world to me, and I find it quite interesting.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't know about my mood. | |
| Follow-up Response: Follow-up: I've recently been trying to learn a new skill, like painting. It's a whole new world to me, and I find it quite interesting. | |
| Output: 1",1,1,0.11124134063720703 | |
| Other substance abuse,22_substance,I cannot live without substance.,2,"Follow-up: I have been trying to find a new hobby to keep myself busy. Recently, I have developed an interest in painting. It helps to keep my mind off things and I find it very therapeutic.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I cannot live without substance. | |
| Follow-up Response: Follow-up: I have been trying to find a new hobby to keep myself busy. Recently, I have developed an interest in painting. It helps to keep my mind off things and I find it very therapeutic. | |
| Output: 1",1,1,0.11185908317565918 | |
| Having work-life balance,13_work_life,I don't have a vacation for a long time.,2,Follow-up: I enjoy playing guitar in my spare time. It's a hobby that I picked up a few years ago and it's been a great source of relaxation for me.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't have a vacation for a long time. | |
| Follow-up Response: Follow-up: I enjoy playing guitar in my spare time. It's a hobby that I picked up a few years ago and it's been a great source of relaxation for me. | |
| Output: 1",1,1,0.1115562915802002 | |
| Taking medication as prescribed,3_medication,I don't think I need it anymore.,2,"Follow-up: I've been feeling a lot better recently and the side effects of the medication bother me. I understand the importance of taking medication as prescribed, but I think it's worth having a discussion with my doctor about potentially reducing the dose or finding an alternative.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't think I need it anymore. | |
| Follow-up Response: Follow-up: I've been feeling a lot better recently and the side effects of the medication bother me. I understand the importance of taking medication as prescribed, but I think it's worth having a discussion with my doctor about potentially reducing the dose or finding an alternative. | |
| Output: 0",0,0,0.11229062080383301 | |
| Relationship with friends and colleagues,27_relationship_social,I can't get along well with anyone.,2,"Follow-up: I often find myself feeling uncomfortable and out of place in social situations, whether it's in the workplace or with friends. I struggle to connect on a deeper level and often feel misunderstood. This has led to feelings of isolation and loneliness. I am trying to work on my communication and social skills to improve these relationships.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I can't get along well with anyone. | |
| Follow-up Response: Follow-up: I often find myself feeling uncomfortable and out of place in social situations, whether it's in the workplace or with friends. I struggle to connect on a deeper level and often feel misunderstood. This has led to feelings of isolation and loneliness. I am trying to work on my communication and social skills to improve these relationships. | |
| Output: 0",0,0,0.11825442314147949 | |
| Maintaining regular schedule for eating,11_eat,I have an eating disorder.,2,Follow-up: I am a tech enthusiast. I find the evolution of technology fascinating. I love how it has changed and shaped our lives. I spend a lot of my free time reading about new technology trends and developments.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I have an eating disorder. | |
| Follow-up Response: Follow-up: I am a tech enthusiast. I find the evolution of technology fascinating. I love how it has changed and shaped our lives. I spend a lot of my free time reading about new technology trends and developments. | |
| Output: 1",1,1,0.11199831962585449 | |
| Productivity at work or school,30_productivity,I am less productive recently.,2,"Follow-up: My productivity has taken a hit due to a variety of factors. I've been feeling overwhelmed with the workload and there have been some personal issues that have been distracting me. I am also spending a lot of time on unnecessary meetings, which eats into the time I have for actual work. Thus, the output of my work has been less than usual.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am less productive recently. | |
| Follow-up Response: Follow-up: My productivity has taken a hit due to a variety of factors. I've been feeling overwhelmed with the workload and there have been some personal issues that have been distracting me. I am also spending a lot of time on unnecessary meetings, which eats into the time I have for actual work. Thus, the output of my work has been less than usual. | |
| Output: 0",0,0,0.1184389591217041 | |
| Expressing feelings to other people,7_emo,I hate share my feelings with my friends.,2,"Follow-up: I feel like my friends may not understand what I'm going through or may judge me based on my problems. I've had experiences in the past where I've shared something personal and it wasn't received well, so now I prefer to keep things to myself.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hate share my feelings with my friends. | |
| Follow-up Response: Follow-up: I feel like my friends may not understand what I'm going through or may judge me based on my problems. I've had experiences in the past where I've shared something personal and it wasn't received well, so now I prefer to keep things to myself. | |
| Output: 0",0,0,0.11233735084533691 | |
| Productivity at work or school,30_productivity,I can't do anything recently.,2,Follow-up: I am thinking about getting a pet. I always loved animals and I think having a pet could bring some positivity and joy in my life.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I can't do anything recently. | |
| Follow-up Response: Follow-up: I am thinking about getting a pet. I always loved animals and I think having a pet could bring some positivity and joy in my life. | |
| Output: 1",1,1,0.1113736629486084 | |
| Managing boundaries in close relationship,28_boundary,I don't feel comfortable with my partner.,2,"Follow-up: I feel like my partner is crossing some personal boundaries. They are always checking my personal stuff, like my phone, emails, and even my diary without my consent. It's becoming an issue in our relationship as it's affecting my sense of privacy and personal space.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't feel comfortable with my partner. | |
| Follow-up Response: Follow-up: I feel like my partner is crossing some personal boundaries. They are always checking my personal stuff, like my phone, emails, and even my diary without my consent. It's becoming an issue in our relationship as it's affecting my sense of privacy and personal space. | |
| Output: 0",0,0,0.11230015754699707 | |
| Family relationship,19_family_relationship,I don't like my family.,2,"Follow-up: I have been having issues with my family for a while now. We have different values and perspectives on life which often leads to disagreements. I feel like they don't understand me and my choices in life, and it's quite suffocating at times.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't like my family. | |
| Follow-up Response: Follow-up: I have been having issues with my family for a while now. We have different values and perspectives on life which often leads to disagreements. I feel like they don't understand me and my choices in life, and it's quite suffocating at times. | |
| Output: 0",0,0,0.11223697662353516 | |
| Talking to other people,6_talk,I don't like to share my personal life with others.,2,"Follow-up: It's not that I am anti-social or anything, but I believe that certain aspects of my life are meant to be private. I don't feel comfortable discussing my personal struggles or joys with others out of fear of being judged or misunderstood. Plus, I also respect other people's privacy and don't expect them to share their personal life with me unless they want to.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't like to share my personal life with others. | |
| Follow-up Response: Follow-up: It's not that I am anti-social or anything, but I believe that certain aspects of my life are meant to be private. I don't feel comfortable discussing my personal struggles or joys with others out of fear of being judged or misunderstood. Plus, I also respect other people's privacy and don't expect them to share their personal life with me unless they want to. | |
| Output: 0",0,0,0.11877894401550293 | |
| Doing exercises and sports,37_exercise,I feel terrible when thinking about exercising.,2,"Follow-up: I feel terrible about exercising because I have a sedentary lifestyle. I spend most of my day sitting at a desk for work, and when I get home, I'm usually too tired to do anything else. I've tried incorporating exercise into my routine a couple of times, but I always end up feeling exhausted and unmotivated. I guess I'm also a bit intimidated by the idea of going to a gym, as I'm not familiar with most of the equipment and routines.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I feel terrible when thinking about exercising. | |
| Follow-up Response: Follow-up: I feel terrible about exercising because I have a sedentary lifestyle. I spend most of my day sitting at a desk for work, and when I get home, I'm usually too tired to do anything else. I've tried incorporating exercise into my routine a couple of times, but I always end up feeling exhausted and unmotivated. I guess I'm also a bit intimidated by the idea of going to a gym, as I'm not familiar with most of the equipment and routines. | |
| Output: 0",0,0,0.11964607238769531 | |
| Maintaining personal hygiene,36_hygiene,I always ignore personal hygiene.,2,"Follow-up: Recently, I've been spending a lot of time learning how to play the guitar. It's a hobby I picked up during the lockdown. It helps me relax and takes my mind off things.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I always ignore personal hygiene. | |
| Follow-up Response: Follow-up: Recently, I've been spending a lot of time learning how to play the guitar. It's a hobby I picked up during the lockdown. It helps me relax and takes my mind off things. | |
| Output: 1",1,1,0.11188220977783203 | |
| Participation in community,25_community,I don't go to the clubs or anything like that.,2,"Follow-up: I am introverted and prefer activities that I can do alone or in small groups. I find the noise and crowds at clubs overwhelming and it's just not my scene. I prefer spending time in nature, reading, or meeting up with a few close friends.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't go to the clubs or anything like that. | |
| Follow-up Response: Follow-up: I am introverted and prefer activities that I can do alone or in small groups. I find the noise and crowds at clubs overwhelming and it's just not my scene. I prefer spending time in nature, reading, or meeting up with a few close friends. | |
| Output: 0",0,0,0.11226558685302734 | |
| Organizing personal possessions & doing housework,5_house,I don't care if my place is organized or not.,2,"Follow-up: I have always been more oriented towards functionality rather than aesthetics. As long as I can find what I need when I need it, I don't mind if things are a bit messy. Besides, I find that I have more important things to focus on than keeping everything in perfect order.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't care if my place is organized or not. | |
| Follow-up Response: Follow-up: I have always been more oriented towards functionality rather than aesthetics. As long as I can find what I need when I need it, I don't mind if things are a bit messy. Besides, I find that I have more important things to focus on than keeping everything in perfect order. | |
| Output: 0",0,0,0.11824655532836914 | |
| Organizing personal possessions & doing housework,5_house,I don't care if my place is maintained or not.,2,"Follow-up: Also, I have been trying to get into the habit of exercising daily. It's not easy, but I'm trying to make it a routine. It helps me to stay fit and improve my mood.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't care if my place is maintained or not. | |
| Follow-up Response: Follow-up: Also, I have been trying to get into the habit of exercising daily. It's not easy, but I'm trying to make it a routine. It helps me to stay fit and improve my mood. | |
| Output: 1",1,1,0.11202120780944824 | |
| Taking medication as prescribed,3_medication,I don't think I need them anymore.,2,"Follow-up: I have been feeling much better and haven't noticed any negative symptoms lately. Besides, it's been a while since I started taking them and I have been following a healthy lifestyle as well, which I believe has contributed to my well-being. Of course, I will consult with my doctor before making any decisions.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't think I need them anymore. | |
| Follow-up Response: Follow-up: I have been feeling much better and haven't noticed any negative symptoms lately. Besides, it's been a while since I started taking them and I have been following a healthy lifestyle as well, which I believe has contributed to my well-being. Of course, I will consult with my doctor before making any decisions. | |
| Output: 0",0,0,0.11823415756225586 | |
| Expressing feelings to other people,7_emo,I never share my feelings with my mom.,2,"Follow-up: I have been holding back my feelings from my mom because I don't want to burden her with my problems. She has her own set of challenges to deal with. Also, we have different perspectives on life which sometimes leads to disagreements. Therefore, I find it difficult to express my feelings to her.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I never share my feelings with my mom. | |
| Follow-up Response: Follow-up: I have been holding back my feelings from my mom because I don't want to burden her with my problems. She has her own set of challenges to deal with. Also, we have different perspectives on life which sometimes leads to disagreements. Therefore, I find it difficult to express my feelings to her. | |
| Output: 0",0,0,0.11826419830322266 | |
| Exhibiting control over self-harming behavior,33_self_harm,I hurt myself when I feel bad.,2,"Follow-up: The self-harming behavior usually emerges when I'm overwhelmed by negative emotions or stress. It feels like a way to release those pent-up feelings. However, I understand that it's an unhealthy coping mechanism and I am striving to seek professional help to manage such feelings in a better way.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hurt myself when I feel bad. | |
| Follow-up Response: Follow-up: The self-harming behavior usually emerges when I'm overwhelmed by negative emotions or stress. It feels like a way to release those pent-up feelings. However, I understand that it's an unhealthy coping mechanism and I am striving to seek professional help to manage such feelings in a better way. | |
| Output: 0",0,0,0.11819672584533691 | |
| Organizing personal possessions & doing housework,5_house,I don't like to maintain my house.,2,"Follow-up: Maintaining a house involves activities like cleaning, organizing personal possessions, and sometimes fixing minor issues. I find these activities monotonous and time-consuming. I prefer to use this time for my hobbies such as reading or playing sports. Also, I feel overwhelmed with the amount of things I have and it becomes a task to organize them.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't like to maintain my house. | |
| Follow-up Response: Follow-up: Maintaining a house involves activities like cleaning, organizing personal possessions, and sometimes fixing minor issues. I find these activities monotonous and time-consuming. I prefer to use this time for my hobbies such as reading or playing sports. Also, I feel overwhelmed with the amount of things I have and it becomes a task to organize them. | |
| Output: 0",0,0,0.1182858943939209 | |
| Problem solving and decision making capability,17_problem,My problem solving skll is really bad.,2,Follow-up: I've been thinking a lot about my future lately. I don't know whether I should stay in my current job or pursue a master's degree. The uncertainty is really bothering me.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: My problem solving skll is really bad. | |
| Follow-up Response: Follow-up: I've been thinking a lot about my future lately. I don't know whether I should stay in my current job or pursue a master's degree. The uncertainty is really bothering me. | |
| Output: 1",1,1,0.11184191703796387 | |
| Expressing feelings to other people,7_emo,I hate share my feelings with my husband.,2,"Follow-up: I feel like he often dismisses my feelings or concerns as trivial, which makes me feel unheard and invalidated. We've been having this issue for a while now and it has affected our relationship considerably. Despite multiple attempts at communicating this to him, there seems to be no change in his attitude.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hate share my feelings with my husband. | |
| Follow-up Response: Follow-up: I feel like he often dismisses my feelings or concerns as trivial, which makes me feel unheard and invalidated. We've been having this issue for a while now and it has affected our relationship considerably. Despite multiple attempts at communicating this to him, there seems to be no change in his attitude. | |
| Output: 0",0,0,0.11812520027160645 | |
| Enjoying personal choices for leisure activities: ,23_leisure,I don't have hoobies.,2,"Follow-up: Recently, I've found myself interested in botany. I don't have any plants yet, but I've been researching and learning about different types of plants, how to care for them, and their benefits. I hope to start my own small indoor garden soon.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't have hoobies. | |
| Follow-up Response: Follow-up: Recently, I've found myself interested in botany. I don't have any plants yet, but I've been researching and learning about different types of plants, how to care for them, and their benefits. I hope to start my own small indoor garden soon. | |
| Output: 1",1,1,0.11240839958190918 | |
| Productivity at work or school,30_productivity,I have problem concentrate and focus.,2,"Follow-up: What I mean is that I often find my mind wandering off to other things while I'm trying to work or study. Sometimes, it's because of external distractions like noise or interruptions. Other times, it's internal distractions like stress or worry. I've tried some strategies like setting specific goals for each work session and taking regular breaks, but I'm still struggling with maintaining focus for long periods.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I have problem concentrate and focus. | |
| Follow-up Response: Follow-up: What I mean is that I often find my mind wandering off to other things while I'm trying to work or study. Sometimes, it's because of external distractions like noise or interruptions. Other times, it's internal distractions like stress or worry. I've tried some strategies like setting specific goals for each work session and taking regular breaks, but I'm still struggling with maintaining focus for long periods. | |
| Output: 0",0,0,0.11850595474243164 | |
| Relationship with friends and colleagues,27_relationship_social,Nobody is able to get closed with me.,2,Follow-up: I was born in a small town and moved to a big city for work. It has been challenging to adjust to the fast pace of city life.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: Nobody is able to get closed with me. | |
| Follow-up Response: Follow-up: I was born in a small town and moved to a big city for work. It has been challenging to adjust to the fast pace of city life. | |
| Output: 1",1,1,0.11175942420959473 | |
| Having work-life balance,13_work_life,It's been a long time from last vacation.,2,"Follow-up: I have been working extensively for the past few months and I have not had the opportunity to take some time off. The workload and deadlines have been consistent, which has made it difficult to find a suitable time to relax and rejuvenate. I haven't had a break to unwind and spend time with my loved ones, or even to pursue my hobbies. This lack of balance has been quite draining and I really miss having leisure time.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: It's been a long time from last vacation. | |
| Follow-up Response: Follow-up: I have been working extensively for the past few months and I have not had the opportunity to take some time off. The workload and deadlines have been consistent, which has made it difficult to find a suitable time to relax and rejuvenate. I haven't had a break to unwind and spend time with my loved ones, or even to pursue my hobbies. This lack of balance has been quite draining and I really miss having leisure time. | |
| Output: 0",0,0,0.1189727783203125 | |
| Expressing feelings to other people,7_emo,I don't share my feelings with my fiancee.,2,Follow-up: I recently started a new job in a completely different field and it's been quite challenging. I'm still trying to learn the ropes and adapt to the new environment.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't share my feelings with my fiancee. | |
| Follow-up Response: Follow-up: I recently started a new job in a completely different field and it's been quite challenging. I'm still trying to learn the ropes and adapt to the new environment. | |
| Output: 1",1,1,0.11179757118225098 | |
| Creativity,24_creativity,I was not creative.,2,"Follow-up: I have been living alone since I graduated from college. It's been difficult to handle everything on my own. Especially during the pandemic, I felt very lonely and isolated.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I was not creative. | |
| Follow-up Response: Follow-up: I have been living alone since I graduated from college. It's been difficult to handle everything on my own. Especially during the pandemic, I felt very lonely and isolated. | |
| Output: 1",1,1,0.11162424087524414 | |
| Expressing feelings to other people,7_emo,I never share my feelings with my family and friends.,2,Follow-up: I am a nature lover and I love to spend my time exploring new places. I particularly enjoy hiking and camping. It's a great way to escape the hustle and bustle of city life.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I never share my feelings with my family and friends. | |
| Follow-up Response: Follow-up: I am a nature lover and I love to spend my time exploring new places. I particularly enjoy hiking and camping. It's a great way to escape the hustle and bustle of city life. | |
| Output: 1",1,1,0.11184239387512207 | |
| Maintaining personal hygiene,36_hygiene,I am not able to care about my personal hygiene.,2,"Follow-up: My daily routine is very packed and stressful, which leaves me with little to no time to take care of my personal hygiene. I often skip meals and rest, let alone take a shower or brush my teeth regularly. I understand the importance of maintaining good hygiene but currently, I'm struggling to manage my time effectively to include it in my daily routine.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am not able to care about my personal hygiene. | |
| Follow-up Response: Follow-up: My daily routine is very packed and stressful, which leaves me with little to no time to take care of my personal hygiene. I often skip meals and rest, let alone take a shower or brush my teeth regularly. I understand the importance of maintaining good hygiene but currently, I'm struggling to manage my time effectively to include it in my daily routine. | |
| Output: 0",0,0,0.11864686012268066 | |
| Maintaining regular schedule for eating,11_eat,I usually don't take food on time.,2,"Follow-up: My schedule is often quite busy and unpredictable, which means I tend to eat at irregular times. Sometimes, due to my workload, I skip meals altogether. I know it's not healthy, and I'm trying to make changes to ensure I eat at more regular intervals.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I usually don't take food on time. | |
| Follow-up Response: Follow-up: My schedule is often quite busy and unpredictable, which means I tend to eat at irregular times. Sometimes, due to my workload, I skip meals altogether. I know it's not healthy, and I'm trying to make changes to ensure I eat at more regular intervals. | |
| Output: 0",0,0,0.11251974105834961 | |
| Expressing feelings to other people,7_emo,I don't share my feelings with my fiance.,2,"Follow-up: Apart from this, I have been trying to learn a new language recently. It's Italian and I find it quite challenging yet interesting. I've always been fascinated by different cultures and languages.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't share my feelings with my fiance. | |
| Follow-up Response: Follow-up: Apart from this, I have been trying to learn a new language recently. It's Italian and I find it quite challenging yet interesting. I've always been fascinated by different cultures and languages. | |
| Output: 1",1,1,0.11189007759094238 | |
| Relationship with friends and colleagues,27_relationship_social,It is impossible for me to get closed with someone.,2,"Follow-up: I find it challenging to build close relationships due to my introverted nature. I often struggle with opening up to people, which makes it hard for me to form deep and meaningful connections. I also have a fear of being judged or misunderstood, which additionally hinders me from reaching out and getting close to someone.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: It is impossible for me to get closed with someone. | |
| Follow-up Response: Follow-up: I find it challenging to build close relationships due to my introverted nature. I often struggle with opening up to people, which makes it hard for me to form deep and meaningful connections. I also have a fear of being judged or misunderstood, which additionally hinders me from reaching out and getting close to someone. | |
| Output: 0",0,0,0.11857104301452637 | |
| Maintaining regular schedule for eating,11_eat,I always forget to eat,2,"Follow-up: I often get so absorbed in my work that I lose track of time, and before I know it, it's way past mealtime. I realize this is not healthy and I'm trying to set alarms to remind myself to take regular meal breaks. But, it's quite challenging.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I always forget to eat | |
| Follow-up Response: Follow-up: I often get so absorbed in my work that I lose track of time, and before I know it, it's way past mealtime. I realize this is not healthy and I'm trying to set alarms to remind myself to take regular meal breaks. But, it's quite challenging. | |
| Output: 0",0,0,0.11244487762451172 | |
| Support from social network,26_support_social,No one wants to hear my voice.,2,"Follow-up: I feel this way because every time I try to share my thoughts or feelings with my friends or colleagues, they seem to brush it off or change the subject. It makes me feel unheard and unimportant. They seem more interested in their own lives and problems than in understanding mine. This has led to me feeling isolated and unsupported.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: No one wants to hear my voice. | |
| Follow-up Response: Follow-up: I feel this way because every time I try to share my thoughts or feelings with my friends or colleagues, they seem to brush it off or change the subject. It makes me feel unheard and unimportant. They seem more interested in their own lives and problems than in understanding mine. This has led to me feeling isolated and unsupported. | |
| Output: 0",0,0,0.11855769157409668 | |
| Managing risk,9_risk,I always take risk in making decisions.,2,"Follow-up: I am an adventurous person. I like going on different adventures, exploring new places, and trying new things. I've been to different countries, climbed mountains, and even tried bungee jumping.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I always take risk in making decisions. | |
| Follow-up Response: Follow-up: I am an adventurous person. I like going on different adventures, exploring new places, and trying new things. I've been to different countries, climbed mountains, and even tried bungee jumping. | |
| Output: 0",1,1,0.1117255687713623 | |
| Following regular schedule for bedtime & sleeping enough,10_sleep,I usually cannot get enough sleep.,2,Follow-up: I have a cat. She is my companion when I am alone at home. She is very playful and often interrupts my work. But I love her.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I usually cannot get enough sleep. | |
| Follow-up Response: Follow-up: I have a cat. She is my companion when I am alone at home. She is very playful and often interrupts my work. But I love her. | |
| Output: 1",1,1,0.11140966415405273 | |
| Expressing feelings to other people,7_emo,I never share my feelings with my brother.,2,Follow-up: I am a big fan of the Harry Potter series. I have read all the books and watched all the movies. It's really a magical world that helps me escape from reality.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I never share my feelings with my brother. | |
| Follow-up Response: Follow-up: I am a big fan of the Harry Potter series. I have read all the books and watched all the movies. It's really a magical world that helps me escape from reality. | |
| Output: 1",1,1,0.11182761192321777 | |
| Law-abiding,34_lawful,I was arrested recently.,2,"Follow-up: I was arrested for a minor traffic violation that I was unaware of. I accidently ran a red light in a city I was unfamiliar with. I didn't realize it until the police pulled me over. It was a minor oversight, but it reminded me of the importance of being vigilant and law-abiding at all times.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I was arrested recently. | |
| Follow-up Response: Follow-up: I was arrested for a minor traffic violation that I was unaware of. I accidently ran a red light in a city I was unfamiliar with. I didn't realize it until the police pulled me over. It was a minor oversight, but it reminded me of the importance of being vigilant and law-abiding at all times. | |
| Output: 0",0,0,0.11826729774475098 | |
| Doing exercises and sports,37_exercise,I am afraid of doing sports.,2,"Follow-up: I am afraid of doing sports because I had a bad experience when I was a kid. I was trying to play football and I broke my leg. Since then, I've developed a fear for any kind of physical activity. It's not that I don't want to exercise, it's just that the fear is too strong.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am afraid of doing sports. | |
| Follow-up Response: Follow-up: I am afraid of doing sports because I had a bad experience when I was a kid. I was trying to play football and I broke my leg. Since then, I've developed a fear for any kind of physical activity. It's not that I don't want to exercise, it's just that the fear is too strong. | |
| Output: 0",0,0,0.11849331855773926 | |
| Talking to other people,6_talk,I haven't been talking to anyone.,2,Follow-up: I have been spending my free time reading books. I have developed a great interest in philosophy and psychology. These subjects help me to understand different perspectives of life.,0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I haven't been talking to anyone. | |
| Follow-up Response: Follow-up: I have been spending my free time reading books. I have developed a great interest in philosophy and psychology. These subjects help me to understand different perspectives of life. | |
| Output: 0",1,1,0.11164975166320801 | |
| Family relationship,19_family_relationship,I hardly ever visit my family.,2,Follow-up: I usually spend most of my time at work. I am a workaholic and my job demands a lot of time and effort from me. I barely have time for personal stuff.,0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hardly ever visit my family. | |
| Follow-up Response: Follow-up: I usually spend most of my time at work. I am a workaholic and my job demands a lot of time and effort from me. I barely have time for personal stuff. | |
| Output: 0",0,0,0.11160683631896973 | |
| Managing risk,9_risk,I live in a risky place.,2,"Follow-up: I live in a location that is prone to natural disasters, specifically earthquakes and floods. Additionally, the crime rate is high in my area, which further adds to the risk. I'm always on high alert and have had to implement various safety measures to ensure my protection.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I live in a risky place. | |
| Follow-up Response: Follow-up: I live in a location that is prone to natural disasters, specifically earthquakes and floods. Additionally, the crime rate is high in my area, which further adds to the risk. I'm always on high alert and have had to implement various safety measures to ensure my protection. | |
| Output: 0",0,0,0.11249208450317383 | |
| Exhibiting control over self-harming behavior,33_self_harm,Hurting myself can make me relaxed.,2,"Follow-up: Besides, I'm also struggling with my studies. The pressure is so much, and I feel like I'm not performing as well as I should be. I'm constantly comparing myself to my peers, and it's really affecting my self-esteem.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: Hurting myself can make me relaxed. | |
| Follow-up Response: Follow-up: Besides, I'm also struggling with my studies. The pressure is so much, and I feel like I'm not performing as well as I should be. I'm constantly comparing myself to my peers, and it's really affecting my self-esteem. | |
| Output: 1",1,1,0.11218881607055664 | |
| Motivation at work or school,31_motivation,I can't bear my job.,2,Follow-up: I am planning to start a blog about cooking. I have always been passionate about food and culinary arts. I think it would be a nice way to share my recipes and cooking tips with a larger audience.,1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I can't bear my job. | |
| Follow-up Response: Follow-up: I am planning to start a blog about cooking. I have always been passionate about food and culinary arts. I think it would be a nice way to share my recipes and cooking tips with a larger audience. | |
| Output: 1",1,1,0.11195611953735352 | |
| Managing finance and items of value,15_finance,I am not able to afford my life recently.,2,"Follow-up: My expenses are exceeding my income lately due to some unforeseen circumstances. I had some medical emergencies which were not covered by my insurance and then there were some sudden repair works at my home. Also, the cost of living has increased significantly, yet my salary has stayed the same. This is making it hard for me to manage my finance and afford my daily life.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am not able to afford my life recently. | |
| Follow-up Response: Follow-up: My expenses are exceeding my income lately due to some unforeseen circumstances. I had some medical emergencies which were not covered by my insurance and then there were some sudden repair works at my home. Also, the cost of living has increased significantly, yet my salary has stayed the same. This is making it hard for me to manage my finance and afford my daily life. | |
| Output: 0",0,0,0.11877989768981934 | |
| Expressing feelings to other people,7_emo,I don't share my feelings with my relatives.,2,"Follow-up: I love painting. It's my passion and my way of expressing myself. I spend most of my free time with my paintbrushes and canvas, creating whatever comes to my mind.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't share my feelings with my relatives. | |
| Follow-up Response: Follow-up: I love painting. It's my passion and my way of expressing myself. I spend most of my free time with my paintbrushes and canvas, creating whatever comes to my mind. | |
| Output: 1",1,1,0.1119391918182373 | |
| Family relationship,19_family_relationship,I hate my family.,2,"Follow-up: I feel this way because there is a lot of conflict in my family. We frequently have disagreements and arguments, which leaves me feeling stressed and unhappy. I feel like they don't understand or respect my perspective, which makes our relationship strained.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I hate my family. | |
| Follow-up Response: Follow-up: I feel this way because there is a lot of conflict in my family. We frequently have disagreements and arguments, which leaves me feeling stressed and unhappy. I feel like they don't understand or respect my perspective, which makes our relationship strained. | |
| Output: 0",0,0,0.11214113235473633 | |
| Getting adequate nutrition,16_nutrition,I often eat fast food.,2,"Follow-up: Because of my busy schedule, I often find myself grabbing meals from fast food joints, which I know are not the healthiest options. I try to choose the healthier options on the menu, but it's still high in sodium and fats. I know I need to make more time to prepare nutritious meals but it's a struggle with my current lifestyle.",0,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I often eat fast food. | |
| Follow-up Response: Follow-up: Because of my busy schedule, I often find myself grabbing meals from fast food joints, which I know are not the healthiest options. I try to choose the healthier options on the menu, but it's still high in sodium and fats. I know I need to make more time to prepare nutritious meals but it's a struggle with my current lifestyle. | |
| Output: 0",0,0,0.11849236488342285 | |
| Creativity,24_creativity,I am not creative.,2,"Follow-up: I've been trying to learn a new language lately, but it's proving to be quite a challenge. I'm thinking of signing up for a class to help me better understand and practice it.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I am not creative. | |
| Follow-up Response: Follow-up: I've been trying to learn a new language lately, but it's proving to be quite a challenge. I'm thinking of signing up for a class to help me better understand and practice it. | |
| Output: 1",1,1,0.11170148849487305 | |
| Motivation at work or school,31_motivation,I don't want to continue my job.,2,"Follow-up: I am thinking about starting a new hobby, such as painting or playing a musical instrument.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I don't want to continue my job. | |
| Follow-up Response: Follow-up: I am thinking about starting a new hobby, such as painting or playing a musical instrument. | |
| Output: 1",1,1,0.11109328269958496 | |
| Organizing personal possessions & doing housework,5_house,I never mop the floor.,2,"Follow-up: Recently, I started learning how to cook. I'm trying to make dishes from different cuisines. Yesterday, I made pasta for the first time and it turned out really good.",1,"You are an AI assistant specialized in mental health response validation. | |
| Your task is to evaluate whether a follow-up response is valid or invalid based on the original response and context. | |
| === SCORE DEFINITIONS === | |
| - Score 0 = Valid: The follow-up response is VALID. It provides useful information that is relevant to the original response. The follow-up response meaningfully expands on, explains, or addresses the original concern. | |
| - Score 1 = Invalid: The follow-up response is INVALID. It is off-topic, too vague, provides no useful information, or requires further guidance. The follow-up response does not meaningfully relate to or address the original concern. | |
| === EXAMPLES === | |
| Example 1 (Valid - Score 0): | |
| Original Response: ""My weight has increased a lot these days."" | |
| Follow-up Response: ""Due to my sedentary lifestyle and unhealthy eating habits, I've noticed a significant weight gain recently. I've been working from home, and without the routine of going to an office, I've found myself snacking more often. Additionally, I haven't been able to exercise regularly which has also contributed to this issue."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the weight gain) | |
| Example 2 (Invalid - Score 1): | |
| Original Response: ""My weight has decreased a lot these days."" | |
| Follow-up Response: ""Besides that, I've been finding it hard to concentrate at work. I've been making a lot of errors and it's not like me at all. It's been stressing me out."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the weight loss concern) | |
| Example 3 (Invalid - Score 1): | |
| Original Response: ""My weight has been going down a lot recently."" | |
| Follow-up Response: ""I have a cat named Whiskers. He's an orange tabby and is incredibly playful. We spend a lot of time playing together, and he always makes me smile."" | |
| Score: 1 (Invalid - The follow-up is completely off-topic and provides no relevant information) | |
| Example 4 (Valid - Score 0): | |
| Original Response: ""I am upset a lot."" | |
| Follow-up Response: ""I feel upset because I have been under a lot of stress at work lately. The workload has increased significantly and the deadlines are very tight. Also, there have been some personal issues that I have been dealing with. All of these factors combined have resulted in me feeling upset a lot."" | |
| Score: 0 (Valid - The follow-up provides relevant information explaining the source of the upset feelings) | |
| Example 5 (Invalid - Score 1): | |
| Original Response: ""I am really upset these days."" | |
| Follow-up Response: ""I'm trying to learn how to play guitar these days. It's a bit challenging, but I'm enjoying it."" | |
| Score: 1 (Invalid - The follow-up is off-topic and does not address the upset feelings) | |
| === TASK === | |
| Now, evaluate the following follow-up response based on the provided context. | |
| IMPORTANT: You must respond with ONLY the score (0 or 1) | |
| - Do NOT write ""Output:"", ""Answer:"", ""Result:"", or any other prefix | |
| - Do NOT write any explanation or additional text | |
| - Do NOT include quotation marks | |
| - Just write: 0 or 1 | |
| Examples of correct output: | |
| - 0 | |
| - 1 | |
| Now evaluate the following: | |
| Original Response: I never mop the floor. | |
| Follow-up Response: Follow-up: Recently, I started learning how to cook. I'm trying to make dishes from different cuisines. Yesterday, I made pasta for the first time and it turned out really good. | |
| Output: 1",1,1,0.11165499687194824 | |