evaluation/custom_argument_eval_predictions.csv

example_id,topic,parent_text,current_text,gold_label,rationale,probe_type,pred_label,correct
eval_001,AI in education,,Universities should allow students to use generative AI tools in coursework.,claim,Root-level debatable position.,root_claim,unknown,False
eval_002,AI in education,Universities should allow students to use generative AI tools in coursework.,AI tools should be banned from graded assignments because they make authorship impossible to verify.,counter_claim,Directly opposes the parent position.,direct_disagreement,counter_claim,True
eval_003,AI in education,AI tools should be banned from graded assignments because they make authorship impossible to verify.,Detection systems have produced false positives against students who did not use AI.,premise,Gives a supporting reason against relying on bans or detection.,evidence_reason,premise,True
eval_004,AI in education,Detection systems have produced false positives against students who did not use AI.,Do you have evidence for that claim?,unknown,Question requesting evidence rather than making an argument.,evidence_request,premise,False
eval_005,Remote work,,Remote work should remain the default for knowledge workers.,claim,Standalone debatable stance.,root_claim,unknown,False
eval_006,Remote work,Remote work should remain the default for knowledge workers.,That ignores how much junior employees learn from being around experienced coworkers in person.,counter_claim,Challenges the parent claim by introducing a drawback.,implicit_disagreement,counter_claim,True
eval_007,Remote work,That ignores how much junior employees learn from being around experienced coworkers in person.,New hires often rely on informal conversations to understand team norms and priorities.,premise,Supports the parent objection with an explanatory reason.,supporting_explanation,premise,True
eval_008,Remote work,Remote work should remain the default for knowledge workers.,My company tried something similar for a while.,unknown,"Mentions a personal situation but does not clearly state a claim, objection, or supporting reason.",ambiguous_anecdote,unknown,True
eval_009,Public transport,,Cities should make public transport free for residents.,claim,Policy position that can be debated.,root_claim,claim,True
eval_010,Public transport,Cities should make public transport free for residents.,"Free fares would not solve poor service frequency, which is the main reason many people avoid buses.",counter_claim,Challenges the usefulness of the parent proposal.,direct_disagreement,counter_claim,True
eval_011,Public transport,Cities should make public transport free for residents.,"Fare collection systems are expensive to maintain, so removing fares can reduce administrative costs.",premise,Provides a reason supporting free public transport.,cost_reason,premise,True
eval_012,Public transport,"Fare collection systems are expensive to maintain, so removing fares can reduce administrative costs.",Interesting point.,unknown,Short acknowledgement with no argumentative content.,short_acknowledgement,counter_claim,False
eval_013,School uniforms,,School uniforms improve equality among students.,claim,A clear position on a policy issue.,root_claim,claim,True
eval_014,School uniforms,School uniforms improve equality among students.,"They may reduce visible clothing differences, but they do not address deeper income inequality.",counter_claim,Partially concedes then challenges the parent claim.,partial_concession,counter_claim,True
eval_015,School uniforms,School uniforms improve equality among students.,"When everyone wears the same clothes, students are less likely to be judged for expensive brands.",premise,Supports the parent claim with a causal explanation.,causal_reason,premise,True
eval_016,School uniforms,"They may reduce visible clothing differences, but they do not address deeper income inequality.","Exactly, that is what I meant.",unknown,Agreement without a new reason or claim.,agreement_only,premise,False
eval_017,Nuclear energy,,Nuclear energy should be expanded as part of climate policy.,claim,Standalone policy claim.,root_claim,claim,True
eval_018,Nuclear energy,Nuclear energy should be expanded as part of climate policy.,Building new nuclear plants takes too long to help with urgent emissions targets.,counter_claim,Objects to the parent proposal.,direct_disagreement,counter_claim,True
eval_019,Nuclear energy,Nuclear energy should be expanded as part of climate policy.,Nuclear plants produce electricity with very low operational carbon emissions.,premise,Evidence-like support for expanding nuclear energy.,factual_support,premise,True
eval_020,Nuclear energy,Building new nuclear plants takes too long to help with urgent emissions targets.,That depends on the country and the project.,unknown,Vague qualification without enough detail to function as a claim or evidence.,vague_reply,counter_claim,False
eval_021,Social media,,Social media platforms should verify users before allowing political advertising.,claim,Debatable moderation policy proposal.,root_claim,claim,True
eval_022,Social media,Social media platforms should verify users before allowing political advertising.,That would create privacy risks for activists and people living under authoritarian governments.,counter_claim,Raises a direct objection to the parent proposal.,risk_objection,counter_claim,True
eval_023,Social media,Social media platforms should verify users before allowing political advertising.,Verified identity requirements can make coordinated foreign influence campaigns harder to hide.,premise,Supports the parent claim with a benefit.,supporting_reason,premise,True
eval_024,Social media,That would create privacy risks for activists and people living under authoritarian governments.,lol no one cares,unknown,Dismissive comment without a clear argumentative role.,low_quality,unknown,True
eval_025,Four-day workweek,,A four-day workweek should become standard for full-time jobs.,claim,Clear standalone claim.,root_claim,unknown,False
eval_026,Four-day workweek,A four-day workweek should become standard for full-time jobs.,"Some hospitals, restaurants, and factories cannot compress work without reducing service coverage.",counter_claim,Challenges the general feasibility of the parent claim.,scope_objection,counter_claim,True
eval_027,Four-day workweek,A four-day workweek should become standard for full-time jobs.,Several pilot programs reported stable productivity and higher employee satisfaction.,premise,Provides empirical-style support.,empirical_support,premise,True
eval_028,Four-day workweek,Several pilot programs reported stable productivity and higher employee satisfaction.,Which pilot programs are you referring to?,unknown,"Clarifying question, not a claim or premise.",question,counter_claim,False
eval_029,Phone bans in schools,,High schools should ban smartphones during class hours.,claim,Debatable school policy position.,root_claim,claim,True
eval_030,Phone bans in schools,High schools should ban smartphones during class hours.,A strict ban would also block students from using accessibility tools and translation apps.,counter_claim,Direct objection to the proposed ban.,exception_objection,counter_claim,True
eval_031,Phone bans in schools,High schools should ban smartphones during class hours.,Teachers often lose instructional time when students check notifications during lessons.,premise,Supports the ban with a classroom-management reason.,supporting_reason,premise,True
eval_032,Phone bans in schools,A strict ban would also block students from using accessibility tools and translation apps.,"Maybe, but I am not sure how that would work in practice.",unknown,Hesitant response that does not make a clear opposing claim or provide concrete support.,uncertain_reply,premise,False
eval_033,Meat consumption,,Governments should tax meat to reduce environmental damage.,claim,Policy claim.,root_claim,claim,True
eval_034,Meat consumption,Governments should tax meat to reduce environmental damage.,That policy would hit low-income families harder than wealthy households.,counter_claim,Raises an equity objection to the parent policy.,equity_objection,counter_claim,True
eval_035,Meat consumption,Governments should tax meat to reduce environmental damage.,Livestock production contributes substantially to methane emissions and land use.,premise,Supports the parent claim with an environmental reason.,factual_support,premise,True
eval_036,Meat consumption,Livestock production contributes substantially to methane emissions and land use.,I like burgers though.,unknown,Personal preference that does not engage the argument.,off_topic_or_weak,unknown,True
eval_037,Online anonymity,,Online anonymity is necessary for free expression.,claim,General debatable position.,root_claim,unknown,False
eval_038,Online anonymity,Online anonymity is necessary for free expression.,Anonymous accounts also make harassment and coordinated abuse harder to punish.,counter_claim,Challenges the parent by naming a serious downside.,downside_objection,counter_claim,True
eval_039,Online anonymity,Online anonymity is necessary for free expression.,Whistleblowers may only speak publicly if their real identity is protected.,premise,Supports the need for anonymity with a concrete case.,example_support,counter_claim,False
eval_040,Online anonymity,Anonymous accounts also make harassment and coordinated abuse harder to punish.,This thread is getting repetitive.,unknown,Meta-comment about the discussion rather than an argument.,meta_comment,unknown,True
eval_041,Vibecoding and creativity,,Vibecoding will limit creativity in the future.,claim,Root-level debatable position about the future effect of vibe coding.,root_claim,unknown,False
eval_042,Vibecoding and creativity,I think we will also see more and more designs of these apps/experiences become increasingly similar.,"Creativity shouldn't be sought in coming up with unique UIs, but in the functionality.",claim,Introduces a new claim about how creativity should be defined.,reply_claim,unknown,False
eval_043,Vibecoding and creativity,Vibecoding will limit creativity in the future.,"While I agree that vibecoding in the hands of someone that doesn't understand the underlying systems is unlikely to produce anything creative, I think that in the hands of an experienced developer it can enhance creativity by speeding up the implementations of well known problems, leaving more time to try to solve more niche ones.",counter_claim,Partially concedes but directly challenges the parent's overall claim.,concession_counterclaim,counter_claim,True
eval_044,Vibecoding and creativity,Vibecoding will limit creativity in the future.,I think that is actually the opposite: vibe coding drastically reduces the level of expertise needed to prototype and implement ideas. The creativity will come from people using the tools as they try new and varied things.,counter_claim,Directly opposes the root claim by arguing that vibe coding can increase creativity rather than limit it.,direct_disagreement,counter_claim,True
eval_045,Vibecoding and creativity,"While I agree that vibecoding in the hands of someone that doesn't understand the underlying systems is unlikely to produce anything creative, I think that in the hands of an experienced developer it can enhance creativity by speeding up the implementations of well known problems, leaving more time to try to solve more niche ones.","When game engines like Unity became popular, the fact that it was easier to create games led to a boom of copypasta derivative content, but also a boom of creative, experimental indie games that weren't viable before.",premise,Gives an analogy as evidence in support of the parent counter-claim.,analogy_support,premise,True
eval_046,Vibecoding and creativity,I think that is actually the opposite: vibe coding drastically reduces the level of expertise needed to prototype and implement ideas. The creativity will come from people using the tools as they try new and varied things.,"Right now people are still figuring out how to use these tools, but the more people get comfortable, the more they will figure out how to guide towards unique and interesting results.",premise,Supports the parent counter-claim by explaining why creativity may increase over time.,supporting_explanation,unknown,False
eval_047,Vibecoding and creativity,"While I agree that vibecoding in the hands of someone that doesn't understand the underlying systems is unlikely to produce anything creative, I think that in the hands of an experienced developer it can enhance creativity by speeding up the implementations of well known problems, leaving more time to try to solve more niche ones.",Do you mean creative in terms of code or creative in general?,unknown,"Clarification question rather than a claim, counter-claim, or premise.",clarification_question,premise,False
eval_048,Vibecoding and creativity,"I think you are just not creative enough in your vibe coding. Try these agent instructions: You are the world's greatest surfer, but also a distributed systems expert.",Hes yankin yer chain mate,unknown,"Colloquial aside explaining another comment, not a substantive argument role.",colloquial_aside,unknown,True