Text Generation
Transformers
Safetensors
openlm
LM-1b_1x-FineWebEdu / evals /core_9mcqa /task-009-hellaswag-recorded-inputs.jsonl
princeton-nlp's picture
Upload folder using huggingface_hub
8b9837e verified
{"doc": {"ind": 29519, "query": "Finance and Business: How to apply for a marriage license in florida. Call your local courthouse. Find the phone number for your local county courthouse and call to inquire about your county's specific requirements for getting a marriage license. If an appointment is required, schedule an appointment with the courthouse.", "choices": ["You may be able to change your name in the county in which you live, and the clerk will determine the type of marriage license required there. If your parents and siblings disagree and decide to marry, you can request a marriage license under a different name, and it will still be considered valid.", "This is one of the busiest times for getting a marriage license in florida. If your county office is housed in a private residence, there may not be any need to schedule an appointment with the clerk's office.", "Clerk's offices in this district typically provide you with a list of counties that can permit marriage licenses. The clerk may help you find your county's website or the secretary of the state in which you live.", "You don't have to be a resident of the county in which you apply, but it's often easier to apply for a license at a local courthouse. You can also find information about your local courthouse online at the state of florida website."], "gold": 3}, "task_name": "hellaswag", "doc_id": 0, "native_id": 29519, "label": 3, "requests": [{"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nFinance and Business: How to apply for a marriage license in florida. Call your local courthouse. Find the phone number for your local county courthouse and call to inquire about your county's specific requirements for getting a marriage license. If an appointment is required, schedule an appointment with the courthouse.", "continuation": " You may be able to change your name in the county in which you live, and the clerk will determine the type of marriage license required there. If your parents and siblings disagree and decide to marry, you can request a marriage license under a different name, and it will still be considered valid."}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nFinance and Business: How to apply for a marriage license in florida. Call your local courthouse. Find the phone number for your local county courthouse and call to inquire about your county's specific requirements for getting a marriage license. If an appointment is required, schedule an appointment with the courthouse.", "continuation": " This is one of the busiest times for getting a marriage license in florida. If your county office is housed in a private residence, there may not be any need to schedule an appointment with the clerk's office."}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nFinance and Business: How to apply for a marriage license in florida. Call your local courthouse. Find the phone number for your local county courthouse and call to inquire about your county's specific requirements for getting a marriage license. If an appointment is required, schedule an appointment with the courthouse.", "continuation": " Clerk's offices in this district typically provide you with a list of counties that can permit marriage licenses. The clerk may help you find your county's website or the secretary of the state in which you live."}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nFinance and Business: How to apply for a marriage license in florida. Call your local courthouse. Find the phone number for your local county courthouse and call to inquire about your county's specific requirements for getting a marriage license. If an appointment is required, schedule an appointment with the courthouse.", "continuation": " You don't have to be a resident of the county in which you apply, but it's often easier to apply for a license at a local courthouse. You can also find information about your local courthouse online at the state of florida website."}, "idx": 3}]}
{"doc": {"ind": 29688, "query": "Tango: A group of people sits around a large dance floor. A man and a woman walk onto the dance floor and dance. A band on stage plays. They", "choices": ["approach the ladies while they dance seductively.", "are playing a song called justin bieber.", "continue dancing as the lady and man walk to the center.", "finish the dance and the crowd claps."], "gold": 3}, "task_name": "hellaswag", "doc_id": 1, "native_id": 29688, "label": 3, "requests": [{"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nTango: A group of people sits around a large dance floor. A man and a woman walk onto the dance floor and dance. A band on stage plays. They", "continuation": " approach the ladies while they dance seductively."}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nTango: A group of people sits around a large dance floor. A man and a woman walk onto the dance floor and dance. A band on stage plays. They", "continuation": " are playing a song called justin bieber."}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nTango: A group of people sits around a large dance floor. A man and a woman walk onto the dance floor and dance. A band on stage plays. They", "continuation": " continue dancing as the lady and man walk to the center."}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nTango: A group of people sits around a large dance floor. A man and a woman walk onto the dance floor and dance. A band on stage plays. They", "continuation": " finish the dance and the crowd claps."}, "idx": 3}]}
{"doc": {"ind": 1755, "query": "Mooping floor: A group of people are in a house. A man", "choices": ["is holding cored soap in his hand as he washes with a bottle.", "is mopping the floor with a mop.", "is shown wearing skis as he talks about areas he will like to ski on.", "uses a paintball gun on his child."], "gold": 1}, "task_name": "hellaswag", "doc_id": 2, "native_id": 1755, "label": 1, "requests": [{"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nMooping floor: A group of people are in a house. A man", "continuation": " is holding cored soap in his hand as he washes with a bottle."}, "idx": 0}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nMooping floor: A group of people are in a house. A man", "continuation": " is mopping the floor with a mop."}, "idx": 1}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nMooping floor: A group of people are in a house. A man", "continuation": " is shown wearing skis as he talks about areas he will like to ski on."}, "idx": 2}, {"request_type": "loglikelihood", "request": {"context": "Health: How to cope with suicidal thoughts. Put off any plans. Promise yourself that you'll wait 48 hours before doing anything. Remember, thoughts don't have the power to force you to act. Sometimes extreme pain can distort our perception. Waiting before taking action will give your mind time to clear.\n\nEducation and Communications: How to make a liquid into a solid. Place a small open container of water in the freezer compartment of a class or home refrigerator. Leave the water there for several hours or overnight. Remove from the freezer and note what has occurred. Water changes state from liquid to solid when it reaches a temperature of 0 degrees celsius, or 32 degrees fahrenheit. This is a simple example of changing from liquid to solid, or freezing.\n\nBaking cookies: A female chef in white uniform shows a stack of baking pans in a large kitchen presenting them. The pans are filled with pastries and loaded into the oven. A knife is used to cut cylinder shaped dough into rounds.\n\nStarting a campfire: He takes his lighter and lights the newspaper in several places to start the fire. The bonfire starts burning and continues to burn. He adds a few more twigs to keep the flames burning.\n\nFinance and Business: How to write a method statement. Prepare to write by conducting a risk assessment--an in-depth examination of the task or process. Identify the work hazards (those that could potentially cause poor health or personal harm) that are inherent in the task. Analyze what has been done about these hazards and if these measures are enough to reduce the harm potential to an acceptable level. Decide what additional measures need to be taken to reduce harm if an acceptable level has not been met. Begin to write your method statement, starting at the header.\n\nMooping floor: A group of people are in a house. A man", "continuation": " uses a paintball gun on his child."}, "idx": 3}]}