{ "chosen_threshold": 0.5, "by_threshold": { "0.1": { "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.984375, "eval_event_type_strict_micro_f1": 0.9921259842519685, "eval_event_type_strict_macro_precision": 1.0, "eval_event_type_strict_macro_recall": 0.9834435564435564, "eval_event_type_strict_macro_f1": 0.9903956239121074, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 1.0000 1.0000 35\nconflict.attack.selfdirectedbattle 1.0000 1.0000 1.0000 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.8571 0.9231 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.9091 0.9524 11\ncontact.discussion.meet 1.0000 1.0000 1.0000 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.7500 0.8571 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 1.0000 1.0000 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.9600 0.9796 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9844 0.9921 896\nmacro avg 1.0000 0.9834 0.9904 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.984375, "eval_event_type_relaxed_micro_f1": 0.9921259842519685, "eval_event_type_relaxed_macro_precision": 1.0, "eval_event_type_relaxed_macro_recall": 0.9834435564435564, "eval_event_type_relaxed_macro_f1": 0.9903956239121074, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 1.0000 1.0000 35\nconflict.attack.selfdirectedbattle 1.0000 1.0000 1.0000 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.8571 0.9231 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.9091 0.9524 11\ncontact.discussion.meet 1.0000 1.0000 1.0000 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 1.0000 1.0000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.7500 0.8571 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 1.0000 1.0000 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.9600 0.9796 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 1.0000 1.0000 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.8571 0.9231 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9844 0.9921 896\nmacro avg 1.0000 0.9834 0.9904 896", "eval_event_trigger_strict_micro_precision": 0.32098765432098764, "eval_event_trigger_strict_micro_recall": 0.9285714285714286, "eval_event_trigger_strict_micro_f1": 0.47706422018348627, "eval_event_trigger_strict_macro_precision": 0.3763893379624905, "eval_event_trigger_strict_macro_recall": 0.9397718289644805, "eval_event_trigger_strict_macro_f1": 0.5217086070948362, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.3529 0.8571 0.5000 7\nartifactexistence.damagedestroy.destroy 0.3421 1.0000 0.5098 13\nartifactexistence.damagedestroy.n/a 0.4706 1.0000 0.6400 8\nconflict.attack.airstrikemissilestrike 0.1905 1.0000 0.3200 4\nconflict.attack.biologicalchemicalpois.. 0.3750 1.0000 0.5455 3\nconflict.attack.bombing 0.2258 1.0000 0.3684 7\nconflict.attack.firearmattack 0.2500 1.0000 0.4000 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.2464 0.9714 0.3931 35\nconflict.attack.selfdirectedbattle 0.2705 0.8049 0.4049 41\nconflict.attack.setfire 0.1111 1.0000 0.2000 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3333 1.0000 0.5000 5\nconflict.demonstrate.marchprotestpolit.. 0.3333 1.0000 0.5000 2\nconflict.yield.n/a 0.2000 0.8571 0.3243 7\nconflict.yield.retreat 0.3333 1.0000 0.5000 3\nconflict.yield.surrender 0.2381 1.0000 0.3846 5\ncontact.collaborate.correspondence 0.2857 0.5714 0.3810 7\ncontact.collaborate.n/a 0.2000 0.8571 0.3243 7\ncontact.commandorder.broadcast 0.3158 1.0000 0.4800 6\ncontact.commandorder.correspondence 0.3333 1.0000 0.5000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.3333 1.0000 0.5000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 5\ncontact.commitmentpromiseexpressintent.. 0.3529 1.0000 0.5217 6\ncontact.commitmentpromiseexpressintent.. 0.2927 1.0000 0.4528 12\ncontact.commitmentpromiseexpressintent.. 0.2857 1.0000 0.4444 2\ncontact.discussion.correspondence 0.3333 0.9091 0.4878 11\ncontact.discussion.meet 0.3019 0.9412 0.4571 17\ncontact.discussion.n/a 0.3333 1.0000 0.5000 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 0.3333 1.0000 0.5000 1\ncontact.mediastatement.broadcast 0.2857 1.0000 0.4444 6\ncontact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.3810 1.0000 0.5517 8\ncontact.negotiate.n/a 0.3333 1.0000 0.5000 1\ncontact.prevarication.broadcast 0.3077 1.0000 0.4706 8\ncontact.prevarication.correspondence 0.3462 1.0000 0.5143 9\ncontact.prevarication.meet 0.3125 1.0000 0.4762 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.3000 1.0000 0.4615 6\ncontact.publicstatementinperson.n/a 0.5714 0.8000 0.6667 5\ncontact.requestadvise.broadcast 0.3000 1.0000 0.4615 12\ncontact.requestadvise.correspondence 0.4348 1.0000 0.6061 10\ncontact.requestadvise.meet 0.4375 1.0000 0.6087 7\ncontact.requestadvise.n/a 0.4000 1.0000 0.5714 6\ncontact.threatencoerce.broadcast 0.2222 1.0000 0.3636 4\ncontact.threatencoerce.correspondence 0.3333 0.6000 0.4286 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.5000 0.8333 0.6250 6\ndisaster.accidentcrash.accidentcrash 0.4286 1.0000 0.6000 3\ndisaster.fireexplosion.fireexplosion 0.3750 1.0000 0.5455 3\ngovernment.agreements.acceptagreementc.. 0.3529 1.0000 0.5217 6\ngovernment.agreements.n/a 0.3750 1.0000 0.5455 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 0.5000 1.0000 0.6667 1\ngovernment.legislate.legislate 0.4118 1.0000 0.5833 7\ngovernment.spy.spy 0.4000 0.6667 0.5000 12\ngovernment.vote.castvote 0.2143 1.0000 0.3529 3\ngovernment.vote.n/a 0.2667 1.0000 0.4211 4\ngovernment.vote.violationspreventvote 0.6667 1.0000 0.8000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5000 1.0000 0.6667 6\ninspection.sensoryobserve.monitorelect.. 0.3750 1.0000 0.5455 3\ninspection.sensoryobserve.n/a 0.3333 1.0000 0.5000 1\ninspection.sensoryobserve.physicalinve.. 0.5000 1.0000 0.6667 4\njustice.arrestjaildetain.arrestjaildet.. 0.3478 1.0000 0.5161 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.8333 0.3846 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.2593 0.8750 0.4000 8\njustice.investigate.investigatecrime 0.2759 1.0000 0.4324 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.4444 1.0000 0.6154 8\njustice.judicialconsequences.execute 0.5000 1.0000 0.6667 5\njustice.judicialconsequences.extradite 0.5000 1.0000 0.6667 2\njustice.judicialconsequences.n/a 0.6000 1.0000 0.7500 6\nlife.die.deathcausedbyviolentevents 0.2817 0.9302 0.4324 43\nlife.die.n/a 0.2540 0.8000 0.3855 20\nlife.die.nonviolentdeath 0.2857 0.8000 0.4211 10\nlife.injure.illnessdegradationhungerth.. 0.3077 1.0000 0.4706 8\nlife.injure.illnessdegradationphysical 0.4545 1.0000 0.6250 5\nlife.injure.injurycausedbyviolentevents 0.2264 0.9231 0.3636 26\nlife.injure.n/a 0.3387 0.8400 0.4828 25\nmanufacture.artifact.build 0.3333 1.0000 0.5000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2143 0.7500 0.3333 4\nmanufacture.artifact.n/a 0.4000 0.6667 0.5000 6\nmovement.transportartifact.bringcarryu.. 0.2727 1.0000 0.4286 3\nmovement.transportartifact.dispersesep.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.2857 1.0000 0.4444 2\nmovement.transportartifact.hide 0.2000 0.5000 0.2857 2\nmovement.transportartifact.n/a 0.5000 1.0000 0.6667 8\nmovement.transportartifact.nonviolentt.. 0.2500 1.0000 0.4000 1\nmovement.transportartifact.prevententry 0.2727 1.0000 0.4286 3\nmovement.transportartifact.preventexit 0.2273 1.0000 0.3704 5\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 1\nmovement.transportartifact.sendsupplye.. 0.5000 1.0000 0.6667 5\nmovement.transportartifact.smuggleextr.. 0.3000 1.0000 0.4615 3\nmovement.transportperson.dispersesepar.. 0.5000 1.0000 0.6667 3\nmovement.transportperson.evacuationres.. 0.2667 0.8889 0.4103 9\nmovement.transportperson.grantentryasy.. 0.4000 1.0000 0.5714 4\nmovement.transportperson.n/a 0.3913 1.0000 0.5625 9\nmovement.transportperson.prevententry 0.3125 1.0000 0.4762 5\nmovement.transportperson.preventexit 0.4500 1.0000 0.6207 9\nmovement.transportperson.selfmotion 0.4118 0.8750 0.5600 8\nmovement.transportperson.smuggleextract 0.5000 1.0000 0.6667 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.3333 1.0000 0.5000 2\npersonnel.endposition.firinglayoff 0.2632 0.8333 0.4000 12\npersonnel.endposition.n/a 0.2917 0.8750 0.4375 8\npersonnel.endposition.quitretire 0.3750 1.0000 0.5455 3\npersonnel.startposition.hiring 0.3704 1.0000 0.5405 10\npersonnel.startposition.n/a 0.3750 0.7500 0.5000 4\ntransaction.transaction.embargosanction 0.3636 1.0000 0.5333 16\ntransaction.transaction.giftgrantprovi.. 0.3125 0.8333 0.4545 6\ntransaction.transaction.n/a 0.3636 1.0000 0.5333 4\ntransaction.transaction.transfercontrol 0.3750 0.8571 0.5217 7\ntransaction.transfermoney.borrowlend 0.5000 1.0000 0.6667 4\ntransaction.transfermoney.embargosanct.. 0.3103 1.0000 0.4737 9\ntransaction.transfermoney.giftgrantpro.. 0.4000 1.0000 0.5714 8\ntransaction.transfermoney.n/a 0.3191 0.8824 0.4688 17\ntransaction.transfermoney.payforservice 0.2500 0.6923 0.3673 13\ntransaction.transfermoney.purchase 0.4000 1.0000 0.5714 14\ntransaction.transferownership.borrowlend 0.3077 1.0000 0.4706 8\ntransaction.transferownership.embargos.. 0.3684 1.0000 0.5385 14\ntransaction.transferownership.giftgran.. 0.3333 1.0000 0.5000 7\ntransaction.transferownership.n/a 0.3939 0.9286 0.5532 14\ntransaction.transferownership.purchase 0.3714 1.0000 0.5417 13\n----------------------------------------------------------------------------------\nmicro avg 0.3210 0.9286 0.4771 896\nmacro avg 0.3764 0.9398 0.5217 896", "eval_event_trigger_relaxed_micro_precision": 0.32253086419753085, "eval_event_trigger_relaxed_micro_recall": 0.9330357142857143, "eval_event_trigger_relaxed_micro_f1": 0.4793577981651375, "eval_event_trigger_relaxed_macro_precision": 0.3778412785537754, "eval_event_trigger_relaxed_macro_recall": 0.9430511622015999, "eval_event_trigger_relaxed_macro_f1": 0.5236966333105137, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.3529 0.8571 0.5000 7\nartifactexistence.damagedestroy.destroy 0.3421 1.0000 0.5098 13\nartifactexistence.damagedestroy.n/a 0.4706 1.0000 0.6400 8\nconflict.attack.airstrikemissilestrike 0.1905 1.0000 0.3200 4\nconflict.attack.biologicalchemicalpois.. 0.3750 1.0000 0.5455 3\nconflict.attack.bombing 0.2258 1.0000 0.3684 7\nconflict.attack.firearmattack 0.2500 1.0000 0.4000 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.2464 0.9714 0.3931 35\nconflict.attack.selfdirectedbattle 0.2787 0.8293 0.4172 41\nconflict.attack.setfire 0.1111 1.0000 0.2000 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3333 1.0000 0.5000 5\nconflict.demonstrate.marchprotestpolit.. 0.3333 1.0000 0.5000 2\nconflict.yield.n/a 0.2000 0.8571 0.3243 7\nconflict.yield.retreat 0.3333 1.0000 0.5000 3\nconflict.yield.surrender 0.2381 1.0000 0.3846 5\ncontact.collaborate.correspondence 0.2857 0.5714 0.3810 7\ncontact.collaborate.n/a 0.2000 0.8571 0.3243 7\ncontact.commandorder.broadcast 0.3158 1.0000 0.4800 6\ncontact.commandorder.correspondence 0.3333 1.0000 0.5000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.3333 1.0000 0.5000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 5\ncontact.commitmentpromiseexpressintent.. 0.3529 1.0000 0.5217 6\ncontact.commitmentpromiseexpressintent.. 0.2927 1.0000 0.4528 12\ncontact.commitmentpromiseexpressintent.. 0.2857 1.0000 0.4444 2\ncontact.discussion.correspondence 0.3333 0.9091 0.4878 11\ncontact.discussion.meet 0.3019 0.9412 0.4571 17\ncontact.discussion.n/a 0.3333 1.0000 0.5000 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 0.3333 1.0000 0.5000 1\ncontact.mediastatement.broadcast 0.2857 1.0000 0.4444 6\ncontact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.3810 1.0000 0.5517 8\ncontact.negotiate.n/a 0.3333 1.0000 0.5000 1\ncontact.prevarication.broadcast 0.3077 1.0000 0.4706 8\ncontact.prevarication.correspondence 0.3462 1.0000 0.5143 9\ncontact.prevarication.meet 0.3125 1.0000 0.4762 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.3000 1.0000 0.4615 6\ncontact.publicstatementinperson.n/a 0.5714 0.8000 0.6667 5\ncontact.requestadvise.broadcast 0.3000 1.0000 0.4615 12\ncontact.requestadvise.correspondence 0.4348 1.0000 0.6061 10\ncontact.requestadvise.meet 0.4375 1.0000 0.6087 7\ncontact.requestadvise.n/a 0.4000 1.0000 0.5714 6\ncontact.threatencoerce.broadcast 0.2222 1.0000 0.3636 4\ncontact.threatencoerce.correspondence 0.4444 0.8000 0.5714 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.5000 0.8333 0.6250 6\ndisaster.accidentcrash.accidentcrash 0.4286 1.0000 0.6000 3\ndisaster.fireexplosion.fireexplosion 0.3750 1.0000 0.5455 3\ngovernment.agreements.acceptagreementc.. 0.3529 1.0000 0.5217 6\ngovernment.agreements.n/a 0.3750 1.0000 0.5455 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 0.5000 1.0000 0.6667 1\ngovernment.legislate.legislate 0.4118 1.0000 0.5833 7\ngovernment.spy.spy 0.4000 0.6667 0.5000 12\ngovernment.vote.castvote 0.2143 1.0000 0.3529 3\ngovernment.vote.n/a 0.2667 1.0000 0.4211 4\ngovernment.vote.violationspreventvote 0.6667 1.0000 0.8000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5000 1.0000 0.6667 6\ninspection.sensoryobserve.monitorelect.. 0.3750 1.0000 0.5455 3\ninspection.sensoryobserve.n/a 0.3333 1.0000 0.5000 1\ninspection.sensoryobserve.physicalinve.. 0.5000 1.0000 0.6667 4\njustice.arrestjaildetain.arrestjaildet.. 0.3478 1.0000 0.5161 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.8333 0.3846 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.2593 0.8750 0.4000 8\njustice.investigate.investigatecrime 0.2759 1.0000 0.4324 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.4444 1.0000 0.6154 8\njustice.judicialconsequences.execute 0.5000 1.0000 0.6667 5\njustice.judicialconsequences.extradite 0.5000 1.0000 0.6667 2\njustice.judicialconsequences.n/a 0.6000 1.0000 0.7500 6\nlife.die.deathcausedbyviolentevents 0.2817 0.9302 0.4324 43\nlife.die.n/a 0.2540 0.8000 0.3855 20\nlife.die.nonviolentdeath 0.2857 0.8000 0.4211 10\nlife.injure.illnessdegradationhungerth.. 0.3077 1.0000 0.4706 8\nlife.injure.illnessdegradationphysical 0.4545 1.0000 0.6250 5\nlife.injure.injurycausedbyviolentevents 0.2264 0.9231 0.3636 26\nlife.injure.n/a 0.3387 0.8400 0.4828 25\nmanufacture.artifact.build 0.3333 1.0000 0.5000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2143 0.7500 0.3333 4\nmanufacture.artifact.n/a 0.4000 0.6667 0.5000 6\nmovement.transportartifact.bringcarryu.. 0.2727 1.0000 0.4286 3\nmovement.transportartifact.dispersesep.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.2857 1.0000 0.4444 2\nmovement.transportartifact.hide 0.2000 0.5000 0.2857 2\nmovement.transportartifact.n/a 0.5000 1.0000 0.6667 8\nmovement.transportartifact.nonviolentt.. 0.2500 1.0000 0.4000 1\nmovement.transportartifact.prevententry 0.2727 1.0000 0.4286 3\nmovement.transportartifact.preventexit 0.2273 1.0000 0.3704 5\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 1\nmovement.transportartifact.sendsupplye.. 0.5000 1.0000 0.6667 5\nmovement.transportartifact.smuggleextr.. 0.3000 1.0000 0.4615 3\nmovement.transportperson.dispersesepar.. 0.5000 1.0000 0.6667 3\nmovement.transportperson.evacuationres.. 0.2667 0.8889 0.4103 9\nmovement.transportperson.grantentryasy.. 0.4000 1.0000 0.5714 4\nmovement.transportperson.n/a 0.3913 1.0000 0.5625 9\nmovement.transportperson.prevententry 0.3125 1.0000 0.4762 5\nmovement.transportperson.preventexit 0.4500 1.0000 0.6207 9\nmovement.transportperson.selfmotion 0.4118 0.8750 0.5600 8\nmovement.transportperson.smuggleextract 0.5000 1.0000 0.6667 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.3333 1.0000 0.5000 2\npersonnel.endposition.firinglayoff 0.2632 0.8333 0.4000 12\npersonnel.endposition.n/a 0.3333 1.0000 0.5000 8\npersonnel.endposition.quitretire 0.3750 1.0000 0.5455 3\npersonnel.startposition.hiring 0.3704 1.0000 0.5405 10\npersonnel.startposition.n/a 0.3750 0.7500 0.5000 4\ntransaction.transaction.embargosanction 0.3636 1.0000 0.5333 16\ntransaction.transaction.giftgrantprovi.. 0.3125 0.8333 0.4545 6\ntransaction.transaction.n/a 0.3636 1.0000 0.5333 4\ntransaction.transaction.transfercontrol 0.3750 0.8571 0.5217 7\ntransaction.transfermoney.borrowlend 0.5000 1.0000 0.6667 4\ntransaction.transfermoney.embargosanct.. 0.3103 1.0000 0.4737 9\ntransaction.transfermoney.giftgrantpro.. 0.4000 1.0000 0.5714 8\ntransaction.transfermoney.n/a 0.3191 0.8824 0.4688 17\ntransaction.transfermoney.payforservice 0.2778 0.7692 0.4082 13\ntransaction.transfermoney.purchase 0.4000 1.0000 0.5714 14\ntransaction.transferownership.borrowlend 0.3077 1.0000 0.4706 8\ntransaction.transferownership.embargos.. 0.3684 1.0000 0.5385 14\ntransaction.transferownership.giftgran.. 0.3333 1.0000 0.5000 7\ntransaction.transferownership.n/a 0.3939 0.9286 0.5532 14\ntransaction.transferownership.purchase 0.3714 1.0000 0.5417 13\n----------------------------------------------------------------------------------\nmicro avg 0.3225 0.9330 0.4794 896\nmacro avg 0.3778 0.9431 0.5237 896", "eval_event_argument_strict_micro_precision": 0.005850272682201289, "eval_event_argument_strict_micro_recall": 0.08111824014665445, "eval_event_argument_strict_micro_f1": 0.010913463020624594, "eval_event_argument_strict_macro_precision": 0.006259044935496331, "eval_event_argument_strict_macro_recall": 0.09466604229081509, "eval_event_argument_strict_macro_f1": 0.011713733981644046, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0050 0.0769 0.0094 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.0038 0.0625 0.0071 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0027 0.0482 0.0050 83\ncandidate 0.0068 0.1111 0.0128 9\ncommunicator 0.0073 0.1223 0.0139 139\ncrashobject 0.0263 0.5000 0.0500 2\ncrime 0.0029 0.0256 0.0052 39\ndamager 0.0000 0.0000 0.0000 7\ndamagerdestroyer 0.0174 0.2500 0.0325 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 0.0030 0.0455 0.0057 44\ndemonstrator 0.0000 0.0000 0.0000 2\ndestination 0.0069 0.0698 0.0125 43\ndestroyer 0.0051 0.0909 0.0096 11\ndetainee 0.0152 0.2500 0.0286 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.0047 0.0882 0.0090 34\nexecutioner 0.0222 0.3333 0.0417 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.0039 0.0603 0.0073 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0000 0.0000 0.0000 4\ninjurer 0.0065 0.0976 0.0123 41\ninspectedentity 0.0147 0.1667 0.0270 6\ninspector 0.0000 0.0000 0.0000 7\ninstrument 0.0036 0.0370 0.0066 81\ninvestigator 0.0177 0.2000 0.0325 10\njailer 0.0122 0.2000 0.0230 5\njudgecourt 0.0140 0.2143 0.0263 14\nkiller 0.0038 0.0741 0.0072 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0124 0.1818 0.0233 11\nmoney 0.0020 0.0345 0.0037 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0000 0.0000 0.0000 9\norigin 0.0047 0.0444 0.0084 45\notherparticipant 0.0303 0.5000 0.0571 2\nparticipant 0.0040 0.0500 0.0074 120\npassenger 0.0087 0.1333 0.0163 30\nplace 0.0103 0.0909 0.0185 374\nplaceofemployment 0.0105 0.1111 0.0192 27\npreventer 0.0026 0.0385 0.0049 52\nprosecutor 0.0085 0.1111 0.0157 9\nrecipient 0.0064 0.0973 0.0120 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0000 0.0000 0.0000 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.0048 0.0800 0.0091 75\nterritoryorfacility 0.0164 0.2000 0.0303 5\ntransporter 0.0036 0.0612 0.0068 49\nvehicle 0.0152 0.2857 0.0288 7\nvictim 0.0064 0.1000 0.0120 110\nviolator 0.0278 0.5000 0.0526 2\nvoter 0.0078 0.1250 0.0147 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.0059 0.0811 0.0109 2182\nmacro avg 0.0063 0.0947 0.0117 2182", "eval_event_argument_relaxed_micro_precision": 0.05952735085109899, "eval_event_argument_relaxed_micro_recall": 0.8253895508707608, "eval_event_argument_relaxed_micro_f1": 0.11104602768443445, "eval_event_argument_relaxed_macro_precision": 0.05789425690291097, "eval_event_argument_relaxed_macro_recall": 0.82651970948527, "eval_event_argument_relaxed_macro_f1": 0.1079071522041834, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0448 0.6923 0.0842 104\nartifactmoney 0.0510 0.8333 0.0962 6\nattacker 0.0522 0.8625 0.0984 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0486 0.8795 0.0921 83\ncandidate 0.0612 1.0000 0.1154 9\ncommunicator 0.0549 0.9137 0.1036 139\ncrashobject 0.0263 0.5000 0.0500 2\ncrime 0.0756 0.6667 0.1358 39\ndamager 0.0472 0.7143 0.0885 7\ndamagerdestroyer 0.0609 0.8750 0.1138 8\ndeceased 0.0606 1.0000 0.1143 2\ndefendant 0.0595 0.8864 0.1114 44\ndemonstrator 0.0571 1.0000 0.1081 2\ndestination 0.0826 0.8372 0.1503 43\ndestroyer 0.0457 0.8182 0.0865 11\ndetainee 0.0606 1.0000 0.1143 8\ndriverpassenger 0.0588 1.0000 0.1111 2\nemployee 0.0490 0.9118 0.0930 34\nexecutioner 0.0667 1.0000 0.1250 3\nextraditer 0.0833 1.0000 0.1538 2\nfireexplosionobject 0.0625 0.6667 0.1143 3\nfounder 0.0645 1.0000 0.1212 2\ngiver 0.0533 0.8276 0.1001 116\ngovernmentbody 0.0541 0.8571 0.1017 7\ngpe 0.0769 1.0000 0.1429 1\ngranter 0.0536 0.7500 0.1000 4\ninjurer 0.0475 0.7073 0.0890 41\ninspectedentity 0.0588 0.6667 0.1081 6\ninspector 0.0909 1.0000 0.1667 7\ninstrument 0.0729 0.7407 0.1327 81\ninvestigator 0.0708 0.8000 0.1301 10\njailer 0.0610 1.0000 0.1149 5\njudgecourt 0.0607 0.9286 0.1140 14\nkiller 0.0494 0.9630 0.0940 27\nlaw 0.0597 1.0000 0.1127 4\nmanufacturer 0.0559 0.8182 0.1047 11\nmoney 0.0314 0.5517 0.0595 29\nmonitor 0.0571 0.6667 0.1053 3\nmonitoredentity 0.0588 0.6667 0.1081 3\nobservedentity 0.0500 0.7778 0.0940 9\norigin 0.0814 0.7778 0.1474 45\notherparticipant 0.0606 1.0000 0.1143 2\nparticipant 0.0691 0.8667 0.1280 120\npassenger 0.0609 0.9333 0.1143 30\nplace 0.0904 0.7995 0.1624 374\nplaceofemployment 0.0632 0.6667 0.1154 27\npreventer 0.0622 0.9231 0.1165 52\nprosecutor 0.0678 0.8889 0.1260 9\nrecipient 0.0535 0.8142 0.1005 226\nresult 0.0588 1.0000 0.1111 2\nretreater 0.0612 1.0000 0.1154 3\nspy 0.0462 0.6667 0.0865 12\nsurrenderer 0.1000 1.0000 0.1818 5\ntarget 0.0548 0.9067 0.1034 75\nterritoryorfacility 0.0328 0.4000 0.0606 5\ntransporter 0.0514 0.8776 0.0971 49\nvehicle 0.0379 0.7143 0.0719 7\nvictim 0.0547 0.8545 0.1028 110\nviolator 0.0278 0.5000 0.0526 2\nvoter 0.0547 0.8750 0.1029 8\nyielder 0.0636 1.0000 0.1197 7\n----------------------------------------------------------------------------------\nmicro avg 0.0595 0.8254 0.1110 2182\nmacro avg 0.0579 0.8265 0.1079 2182", "eval_event_strict_micro_precision": 0.056064514216253074, "eval_event_strict_micro_recall": 0.4758429793658782, "eval_event_strict_micro_f1": 0.10031032013367636, "eval_event_strict_macro_precision": 0.556890294164983, "eval_event_strict_macro_recall": 0.7946810395188676, "eval_event_strict_macro_f1": 0.6127323029123124, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0050 0.0769 0.0094 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.0038 0.0625 0.0071 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0027 0.0482 0.0050 83\narg:candidate 0.0068 0.1111 0.0128 9\narg:communicator 0.0073 0.1223 0.0139 139\narg:crashobject 0.0263 0.5000 0.0500 2\narg:crime 0.0029 0.0256 0.0052 39\narg:damager 0.0000 0.0000 0.0000 7\narg:damagerdestroyer 0.0174 0.2500 0.0325 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 0.0030 0.0455 0.0057 44\narg:demonstrator 0.0000 0.0000 0.0000 2\narg:destination 0.0069 0.0698 0.0125 43\narg:destroyer 0.0051 0.0909 0.0096 11\narg:detainee 0.0152 0.2500 0.0286 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.0047 0.0882 0.0090 34\narg:executioner 0.0222 0.3333 0.0417 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.0039 0.0603 0.0073 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0000 0.0000 0.0000 4\narg:injurer 0.0065 0.0976 0.0123 41\narg:inspectedentity 0.0147 0.1667 0.0270 6\narg:inspector 0.0000 0.0000 0.0000 7\narg:instrument 0.0036 0.0370 0.0066 81\narg:investigator 0.0177 0.2000 0.0325 10\narg:jailer 0.0122 0.2000 0.0230 5\narg:judgecourt 0.0140 0.2143 0.0263 14\narg:killer 0.0038 0.0741 0.0072 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0124 0.1818 0.0233 11\narg:money 0.0020 0.0345 0.0037 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0000 0.0000 0.0000 9\narg:origin 0.0047 0.0444 0.0084 45\narg:otherparticipant 0.0303 0.5000 0.0571 2\narg:participant 0.0040 0.0500 0.0074 120\narg:passenger 0.0087 0.1333 0.0163 30\narg:place 0.0103 0.0909 0.0185 374\narg:placeofemployment 0.0105 0.1111 0.0192 27\narg:preventer 0.0026 0.0385 0.0049 52\narg:prosecutor 0.0085 0.1111 0.0157 9\narg:recipient 0.0064 0.0973 0.0120 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0000 0.0000 0.0000 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.0048 0.0800 0.0091 75\narg:territoryorfacility 0.0164 0.2000 0.0303 5\narg:transporter 0.0036 0.0612 0.0068 49\narg:vehicle 0.0152 0.2857 0.0288 7\narg:victim 0.0064 0.1000 0.0120 110\narg:violator 0.0278 0.5000 0.0526 2\narg:voter 0.0078 0.1250 0.0147 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 0.3529 0.8571 0.5000 7\ntrigger:artifactexistence.damagedestro.. 0.3421 1.0000 0.5098 13\ntrigger:artifactexistence.damagedestro.. 0.4706 1.0000 0.6400 8\ntrigger:conflict.attack.airstrikemissi.. 0.1905 1.0000 0.3200 4\ntrigger:conflict.attack.biologicalchem.. 0.3750 1.0000 0.5455 3\ntrigger:conflict.attack.bombing 0.2258 1.0000 0.3684 7\ntrigger:conflict.attack.firearmattack 0.2500 1.0000 0.4000 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.2464 0.9714 0.3931 35\ntrigger:conflict.attack.selfdirectedba.. 0.2705 0.8049 0.4049 41\ntrigger:conflict.attack.setfire 0.1111 1.0000 0.2000 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3333 1.0000 0.5000 5\ntrigger:conflict.demonstrate.marchprot.. 0.3333 1.0000 0.5000 2\ntrigger:conflict.yield.n/a 0.2000 0.8571 0.3243 7\ntrigger:conflict.yield.retreat 0.3333 1.0000 0.5000 3\ntrigger:conflict.yield.surrender 0.2381 1.0000 0.3846 5\ntrigger:contact.collaborate.correspond.. 0.2857 0.5714 0.3810 7\ntrigger:contact.collaborate.n/a 0.2000 0.8571 0.3243 7\ntrigger:contact.commandorder.broadcast 0.3158 1.0000 0.4800 6\ntrigger:contact.commandorder.correspon.. 0.3333 1.0000 0.5000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.3333 1.0000 0.5000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 5\ntrigger:contact.commitmentpromiseexpre.. 0.3529 1.0000 0.5217 6\ntrigger:contact.commitmentpromiseexpre.. 0.2927 1.0000 0.4528 12\ntrigger:contact.commitmentpromiseexpre.. 0.2857 1.0000 0.4444 2\ntrigger:contact.discussion.corresponde.. 0.3333 0.9091 0.4878 11\ntrigger:contact.discussion.meet 0.3019 0.9412 0.4571 17\ntrigger:contact.discussion.n/a 0.3333 1.0000 0.5000 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.mediastatement.broadcast 0.2857 1.0000 0.4444 6\ntrigger:contact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.3810 1.0000 0.5517 8\ntrigger:contact.negotiate.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.prevarication.broadcast 0.3077 1.0000 0.4706 8\ntrigger:contact.prevarication.correspo.. 0.3462 1.0000 0.5143 9\ntrigger:contact.prevarication.meet 0.3125 1.0000 0.4762 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.3000 1.0000 0.4615 6\ntrigger:contact.publicstatementinperso.. 0.5714 0.8000 0.6667 5\ntrigger:contact.requestadvise.broadcast 0.3000 1.0000 0.4615 12\ntrigger:contact.requestadvise.correspo.. 0.4348 1.0000 0.6061 10\ntrigger:contact.requestadvise.meet 0.4375 1.0000 0.6087 7\ntrigger:contact.requestadvise.n/a 0.4000 1.0000 0.5714 6\ntrigger:contact.threatencoerce.broadcast 0.2222 1.0000 0.3636 4\ntrigger:contact.threatencoerce.corresp.. 0.3333 0.6000 0.4286 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.5000 0.8333 0.6250 6\ntrigger:disaster.accidentcrash.acciden.. 0.4286 1.0000 0.6000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.3750 1.0000 0.5455 3\ntrigger:government.agreements.acceptag.. 0.3529 1.0000 0.5217 6\ntrigger:government.agreements.n/a 0.3750 1.0000 0.5455 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 0.5000 1.0000 0.6667 1\ntrigger:government.legislate.legislate 0.4118 1.0000 0.5833 7\ntrigger:government.spy.spy 0.4000 0.6667 0.5000 12\ntrigger:government.vote.castvote 0.2143 1.0000 0.3529 3\ntrigger:government.vote.n/a 0.2667 1.0000 0.4211 4\ntrigger:government.vote.violationsprev.. 0.6667 1.0000 0.8000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5000 1.0000 0.6667 6\ntrigger:inspection.sensoryobserve.moni.. 0.3750 1.0000 0.5455 3\ntrigger:inspection.sensoryobserve.n/a 0.3333 1.0000 0.5000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5000 1.0000 0.6667 4\ntrigger:justice.arrestjaildetain.arres.. 0.3478 1.0000 0.5161 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.8333 0.3846 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.2593 0.8750 0.4000 8\ntrigger:justice.investigate.investigat.. 0.2759 1.0000 0.4324 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.4444 1.0000 0.6154 8\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 5\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 2\ntrigger:justice.judicialconsequences.n/a 0.6000 1.0000 0.7500 6\ntrigger:life.die.deathcausedbyviolente.. 0.2817 0.9302 0.4324 43\ntrigger:life.die.n/a 0.2540 0.8000 0.3855 20\ntrigger:life.die.nonviolentdeath 0.2857 0.8000 0.4211 10\ntrigger:life.injure.illnessdegradation.. 0.3077 1.0000 0.4706 8\ntrigger:life.injure.illnessdegradation.. 0.4545 1.0000 0.6250 5\ntrigger:life.injure.injurycausedbyviol.. 0.2264 0.9231 0.3636 26\ntrigger:life.injure.n/a 0.3387 0.8400 0.4828 25\ntrigger:manufacture.artifact.build 0.3333 1.0000 0.5000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2143 0.7500 0.3333 4\ntrigger:manufacture.artifact.n/a 0.4000 0.6667 0.5000 6\ntrigger:movement.transportartifact.bri.. 0.2727 1.0000 0.4286 3\ntrigger:movement.transportartifact.dis.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.2857 1.0000 0.4444 2\ntrigger:movement.transportartifact.hide 0.2000 0.5000 0.2857 2\ntrigger:movement.transportartifact.n/a 0.5000 1.0000 0.6667 8\ntrigger:movement.transportartifact.non.. 0.2500 1.0000 0.4000 1\ntrigger:movement.transportartifact.pre.. 0.2727 1.0000 0.4286 3\ntrigger:movement.transportartifact.pre.. 0.2273 1.0000 0.3704 5\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.sen.. 0.5000 1.0000 0.6667 5\ntrigger:movement.transportartifact.smu.. 0.3000 1.0000 0.4615 3\ntrigger:movement.transportperson.dispe.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportperson.evacu.. 0.2667 0.8889 0.4103 9\ntrigger:movement.transportperson.grant.. 0.4000 1.0000 0.5714 4\ntrigger:movement.transportperson.n/a 0.3913 1.0000 0.5625 9\ntrigger:movement.transportperson.preve.. 0.3125 1.0000 0.4762 5\ntrigger:movement.transportperson.preve.. 0.4500 1.0000 0.6207 9\ntrigger:movement.transportperson.selfm.. 0.4118 0.8750 0.5600 8\ntrigger:movement.transportperson.smugg.. 0.5000 1.0000 0.6667 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.3333 1.0000 0.5000 2\ntrigger:personnel.endposition.firingla.. 0.2632 0.8333 0.4000 12\ntrigger:personnel.endposition.n/a 0.2917 0.8750 0.4375 8\ntrigger:personnel.endposition.quitretire 0.3750 1.0000 0.5455 3\ntrigger:personnel.startposition.hiring 0.3704 1.0000 0.5405 10\ntrigger:personnel.startposition.n/a 0.3750 0.7500 0.5000 4\ntrigger:transaction.transaction.embarg.. 0.3636 1.0000 0.5333 16\ntrigger:transaction.transaction.giftgr.. 0.3125 0.8333 0.4545 6\ntrigger:transaction.transaction.n/a 0.3636 1.0000 0.5333 4\ntrigger:transaction.transaction.transf.. 0.3750 0.8571 0.5217 7\ntrigger:transaction.transfermoney.borr.. 0.5000 1.0000 0.6667 4\ntrigger:transaction.transfermoney.emba.. 0.3103 1.0000 0.4737 9\ntrigger:transaction.transfermoney.gift.. 0.4000 1.0000 0.5714 8\ntrigger:transaction.transfermoney.n/a 0.3191 0.8824 0.4688 17\ntrigger:transaction.transfermoney.payf.. 0.2500 0.6923 0.3673 13\ntrigger:transaction.transfermoney.purc.. 0.4000 1.0000 0.5714 14\ntrigger:transaction.transferownership... 0.3077 1.0000 0.4706 8\ntrigger:transaction.transferownership... 0.3684 1.0000 0.5385 14\ntrigger:transaction.transferownership... 0.3333 1.0000 0.5000 7\ntrigger:transaction.transferownership... 0.3939 0.9286 0.5532 14\ntrigger:transaction.transferownership... 0.3714 1.0000 0.5417 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 1.0000 1.0000 35\ntype:conflict.attack.selfdirectedbattle 1.0000 1.0000 1.0000 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.8571 0.9231 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.9091 0.9524 11\ntype:contact.discussion.meet 1.0000 1.0000 1.0000 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 1.0000 1.0000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.7500 0.8571 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 1.0000 1.0000 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.9600 0.9796 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.8571 0.9231 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.0561 0.4758 0.1003 3974\nmacro avg 0.5569 0.7947 0.6127 3974", "eval_event_relaxed_micro_precision": 0.10433158409677132, "eval_event_relaxed_micro_recall": 0.8855057876195269, "eval_event_relaxed_micro_f1": 0.1866694957960905, "eval_event_relaxed_macro_precision": 0.5674186650309667, "eval_event_relaxed_macro_recall": 0.9369209174284381, "eval_event_relaxed_macro_f1": 0.6320566362596277, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0448 0.6923 0.0842 104\narg:artifactmoney 0.0510 0.8333 0.0962 6\narg:attacker 0.0522 0.8625 0.0984 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0486 0.8795 0.0921 83\narg:candidate 0.0612 1.0000 0.1154 9\narg:communicator 0.0549 0.9137 0.1036 139\narg:crashobject 0.0263 0.5000 0.0500 2\narg:crime 0.0756 0.6667 0.1358 39\narg:damager 0.0472 0.7143 0.0885 7\narg:damagerdestroyer 0.0609 0.8750 0.1138 8\narg:deceased 0.0606 1.0000 0.1143 2\narg:defendant 0.0595 0.8864 0.1114 44\narg:demonstrator 0.0571 1.0000 0.1081 2\narg:destination 0.0826 0.8372 0.1503 43\narg:destroyer 0.0457 0.8182 0.0865 11\narg:detainee 0.0606 1.0000 0.1143 8\narg:driverpassenger 0.0588 1.0000 0.1111 2\narg:employee 0.0490 0.9118 0.0930 34\narg:executioner 0.0667 1.0000 0.1250 3\narg:extraditer 0.0833 1.0000 0.1538 2\narg:fireexplosionobject 0.0625 0.6667 0.1143 3\narg:founder 0.0645 1.0000 0.1212 2\narg:giver 0.0533 0.8276 0.1001 116\narg:governmentbody 0.0541 0.8571 0.1017 7\narg:gpe 0.0769 1.0000 0.1429 1\narg:granter 0.0536 0.7500 0.1000 4\narg:injurer 0.0475 0.7073 0.0890 41\narg:inspectedentity 0.0588 0.6667 0.1081 6\narg:inspector 0.0909 1.0000 0.1667 7\narg:instrument 0.0729 0.7407 0.1327 81\narg:investigator 0.0708 0.8000 0.1301 10\narg:jailer 0.0610 1.0000 0.1149 5\narg:judgecourt 0.0607 0.9286 0.1140 14\narg:killer 0.0494 0.9630 0.0940 27\narg:law 0.0597 1.0000 0.1127 4\narg:manufacturer 0.0559 0.8182 0.1047 11\narg:money 0.0314 0.5517 0.0595 29\narg:monitor 0.0571 0.6667 0.1053 3\narg:monitoredentity 0.0588 0.6667 0.1081 3\narg:observedentity 0.0500 0.7778 0.0940 9\narg:origin 0.0814 0.7778 0.1474 45\narg:otherparticipant 0.0606 1.0000 0.1143 2\narg:participant 0.0691 0.8667 0.1280 120\narg:passenger 0.0609 0.9333 0.1143 30\narg:place 0.0904 0.7995 0.1624 374\narg:placeofemployment 0.0632 0.6667 0.1154 27\narg:preventer 0.0622 0.9231 0.1165 52\narg:prosecutor 0.0678 0.8889 0.1260 9\narg:recipient 0.0535 0.8142 0.1005 226\narg:result 0.0588 1.0000 0.1111 2\narg:retreater 0.0612 1.0000 0.1154 3\narg:spy 0.0462 0.6667 0.0865 12\narg:surrenderer 0.1000 1.0000 0.1818 5\narg:target 0.0548 0.9067 0.1034 75\narg:territoryorfacility 0.0328 0.4000 0.0606 5\narg:transporter 0.0514 0.8776 0.0971 49\narg:vehicle 0.0379 0.7143 0.0719 7\narg:victim 0.0547 0.8545 0.1028 110\narg:violator 0.0278 0.5000 0.0526 2\narg:voter 0.0547 0.8750 0.1029 8\narg:yielder 0.0636 1.0000 0.1197 7\ntrigger:artifactexistence.damagedestro.. 0.3529 0.8571 0.5000 7\ntrigger:artifactexistence.damagedestro.. 0.3421 1.0000 0.5098 13\ntrigger:artifactexistence.damagedestro.. 0.4706 1.0000 0.6400 8\ntrigger:conflict.attack.airstrikemissi.. 0.1905 1.0000 0.3200 4\ntrigger:conflict.attack.biologicalchem.. 0.3750 1.0000 0.5455 3\ntrigger:conflict.attack.bombing 0.2258 1.0000 0.3684 7\ntrigger:conflict.attack.firearmattack 0.2500 1.0000 0.4000 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.2464 0.9714 0.3931 35\ntrigger:conflict.attack.selfdirectedba.. 0.2787 0.8293 0.4172 41\ntrigger:conflict.attack.setfire 0.1111 1.0000 0.2000 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3333 1.0000 0.5000 5\ntrigger:conflict.demonstrate.marchprot.. 0.3333 1.0000 0.5000 2\ntrigger:conflict.yield.n/a 0.2000 0.8571 0.3243 7\ntrigger:conflict.yield.retreat 0.3333 1.0000 0.5000 3\ntrigger:conflict.yield.surrender 0.2381 1.0000 0.3846 5\ntrigger:contact.collaborate.correspond.. 0.2857 0.5714 0.3810 7\ntrigger:contact.collaborate.n/a 0.2000 0.8571 0.3243 7\ntrigger:contact.commandorder.broadcast 0.3158 1.0000 0.4800 6\ntrigger:contact.commandorder.correspon.. 0.3333 1.0000 0.5000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.3333 1.0000 0.5000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 5\ntrigger:contact.commitmentpromiseexpre.. 0.3529 1.0000 0.5217 6\ntrigger:contact.commitmentpromiseexpre.. 0.2927 1.0000 0.4528 12\ntrigger:contact.commitmentpromiseexpre.. 0.2857 1.0000 0.4444 2\ntrigger:contact.discussion.corresponde.. 0.3333 0.9091 0.4878 11\ntrigger:contact.discussion.meet 0.3019 0.9412 0.4571 17\ntrigger:contact.discussion.n/a 0.3333 1.0000 0.5000 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.mediastatement.broadcast 0.2857 1.0000 0.4444 6\ntrigger:contact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.3810 1.0000 0.5517 8\ntrigger:contact.negotiate.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.prevarication.broadcast 0.3077 1.0000 0.4706 8\ntrigger:contact.prevarication.correspo.. 0.3462 1.0000 0.5143 9\ntrigger:contact.prevarication.meet 0.3125 1.0000 0.4762 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.3000 1.0000 0.4615 6\ntrigger:contact.publicstatementinperso.. 0.5714 0.8000 0.6667 5\ntrigger:contact.requestadvise.broadcast 0.3000 1.0000 0.4615 12\ntrigger:contact.requestadvise.correspo.. 0.4348 1.0000 0.6061 10\ntrigger:contact.requestadvise.meet 0.4375 1.0000 0.6087 7\ntrigger:contact.requestadvise.n/a 0.4000 1.0000 0.5714 6\ntrigger:contact.threatencoerce.broadcast 0.2222 1.0000 0.3636 4\ntrigger:contact.threatencoerce.corresp.. 0.4444 0.8000 0.5714 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.5000 0.8333 0.6250 6\ntrigger:disaster.accidentcrash.acciden.. 0.4286 1.0000 0.6000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.3750 1.0000 0.5455 3\ntrigger:government.agreements.acceptag.. 0.3529 1.0000 0.5217 6\ntrigger:government.agreements.n/a 0.3750 1.0000 0.5455 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 0.5000 1.0000 0.6667 1\ntrigger:government.legislate.legislate 0.4118 1.0000 0.5833 7\ntrigger:government.spy.spy 0.4000 0.6667 0.5000 12\ntrigger:government.vote.castvote 0.2143 1.0000 0.3529 3\ntrigger:government.vote.n/a 0.2667 1.0000 0.4211 4\ntrigger:government.vote.violationsprev.. 0.6667 1.0000 0.8000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5000 1.0000 0.6667 6\ntrigger:inspection.sensoryobserve.moni.. 0.3750 1.0000 0.5455 3\ntrigger:inspection.sensoryobserve.n/a 0.3333 1.0000 0.5000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5000 1.0000 0.6667 4\ntrigger:justice.arrestjaildetain.arres.. 0.3478 1.0000 0.5161 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.8333 0.3846 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.2593 0.8750 0.4000 8\ntrigger:justice.investigate.investigat.. 0.2759 1.0000 0.4324 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.4444 1.0000 0.6154 8\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 5\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 2\ntrigger:justice.judicialconsequences.n/a 0.6000 1.0000 0.7500 6\ntrigger:life.die.deathcausedbyviolente.. 0.2817 0.9302 0.4324 43\ntrigger:life.die.n/a 0.2540 0.8000 0.3855 20\ntrigger:life.die.nonviolentdeath 0.2857 0.8000 0.4211 10\ntrigger:life.injure.illnessdegradation.. 0.3077 1.0000 0.4706 8\ntrigger:life.injure.illnessdegradation.. 0.4545 1.0000 0.6250 5\ntrigger:life.injure.injurycausedbyviol.. 0.2264 0.9231 0.3636 26\ntrigger:life.injure.n/a 0.3387 0.8400 0.4828 25\ntrigger:manufacture.artifact.build 0.3333 1.0000 0.5000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2143 0.7500 0.3333 4\ntrigger:manufacture.artifact.n/a 0.4000 0.6667 0.5000 6\ntrigger:movement.transportartifact.bri.. 0.2727 1.0000 0.4286 3\ntrigger:movement.transportartifact.dis.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.2857 1.0000 0.4444 2\ntrigger:movement.transportartifact.hide 0.2000 0.5000 0.2857 2\ntrigger:movement.transportartifact.n/a 0.5000 1.0000 0.6667 8\ntrigger:movement.transportartifact.non.. 0.2500 1.0000 0.4000 1\ntrigger:movement.transportartifact.pre.. 0.2727 1.0000 0.4286 3\ntrigger:movement.transportartifact.pre.. 0.2273 1.0000 0.3704 5\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.sen.. 0.5000 1.0000 0.6667 5\ntrigger:movement.transportartifact.smu.. 0.3000 1.0000 0.4615 3\ntrigger:movement.transportperson.dispe.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportperson.evacu.. 0.2667 0.8889 0.4103 9\ntrigger:movement.transportperson.grant.. 0.4000 1.0000 0.5714 4\ntrigger:movement.transportperson.n/a 0.3913 1.0000 0.5625 9\ntrigger:movement.transportperson.preve.. 0.3125 1.0000 0.4762 5\ntrigger:movement.transportperson.preve.. 0.4500 1.0000 0.6207 9\ntrigger:movement.transportperson.selfm.. 0.4118 0.8750 0.5600 8\ntrigger:movement.transportperson.smugg.. 0.5000 1.0000 0.6667 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.3333 1.0000 0.5000 2\ntrigger:personnel.endposition.firingla.. 0.2632 0.8333 0.4000 12\ntrigger:personnel.endposition.n/a 0.3333 1.0000 0.5000 8\ntrigger:personnel.endposition.quitretire 0.3750 1.0000 0.5455 3\ntrigger:personnel.startposition.hiring 0.3704 1.0000 0.5405 10\ntrigger:personnel.startposition.n/a 0.3750 0.7500 0.5000 4\ntrigger:transaction.transaction.embarg.. 0.3636 1.0000 0.5333 16\ntrigger:transaction.transaction.giftgr.. 0.3125 0.8333 0.4545 6\ntrigger:transaction.transaction.n/a 0.3636 1.0000 0.5333 4\ntrigger:transaction.transaction.transf.. 0.3750 0.8571 0.5217 7\ntrigger:transaction.transfermoney.borr.. 0.5000 1.0000 0.6667 4\ntrigger:transaction.transfermoney.emba.. 0.3103 1.0000 0.4737 9\ntrigger:transaction.transfermoney.gift.. 0.4000 1.0000 0.5714 8\ntrigger:transaction.transfermoney.n/a 0.3191 0.8824 0.4688 17\ntrigger:transaction.transfermoney.payf.. 0.2778 0.7692 0.4082 13\ntrigger:transaction.transfermoney.purc.. 0.4000 1.0000 0.5714 14\ntrigger:transaction.transferownership... 0.3077 1.0000 0.4706 8\ntrigger:transaction.transferownership... 0.3684 1.0000 0.5385 14\ntrigger:transaction.transferownership... 0.3333 1.0000 0.5000 7\ntrigger:transaction.transferownership... 0.3939 0.9286 0.5532 14\ntrigger:transaction.transferownership... 0.3714 1.0000 0.5417 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 1.0000 1.0000 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 1.0000 1.0000 35\ntype:conflict.attack.selfdirectedbattle 1.0000 1.0000 1.0000 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.8571 0.9231 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 1.0000 1.0000 1.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.9091 0.9524 11\ntype:contact.discussion.meet 1.0000 1.0000 1.0000 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 1.0000 1.0000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.7500 0.8571 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 1.0000 1.0000 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.9600 0.9796 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 1.0000 1.0000 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 1.0000 1.0000 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.8571 0.9231 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.1043 0.8855 0.1867 3974\nmacro avg 0.5674 0.9369 0.6321 3974", "eval_event_trigger_error_COR": 832, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 2, "eval_event_trigger_error_BEL": 2, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 1756, "eval_event_trigger_error_FN": 60, "eval_event_trigger_fair_micro_precision": 0.32123552123552124, "eval_event_trigger_fair_micro_recall": 0.930648769574944, "eval_event_trigger_fair_micro_f1": 0.4776119402985074, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 832\nLE 0\nBES 2\nBEL 2\nBEO 0\nLBE 0\nFP 1756\nFN 60\n-----------------\nfair P / R / F1: 0.3212 / 0.9306 / 0.4776", "eval_event_argument_error_COR": 1211, "eval_event_argument_error_LE": 33, "eval_event_argument_error_BES": 342, "eval_event_argument_error_BEL": 147, "eval_event_argument_error_BEO": 83, "eval_event_argument_error_LBE": 50, "eval_event_argument_error_FP": 28389, "eval_event_argument_error_FN": 316, "eval_event_argument_fair_micro_precision": 0.040464455768106256, "eval_event_argument_fair_micro_recall": 0.6530062011323807, "eval_event_argument_fair_micro_f1": 0.07620665785664842, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 1211\nLE 33\nBES 342\nBEL 147\nBEO 83\nLBE 50\nFP 28389\nFN 316\n-----------------\nfair P / R / F1: 0.0405 / 0.6530 / 0.0762\n\nlabel confusions (gold -> pred):\n crime -> defendant: 5\n placeofemployment -> employee: 5\n origin -> artifact: 4\n place -> artifact: 4\n place -> communicator: 4\n destination -> passenger: 3\n place -> attacker: 3\n place -> killer: 3\n place -> participant: 3\n artifact -> instrument: 2\n artifact -> place: 2\n attacker -> instrument: 2\n beneficiary -> place: 2\n giver -> place: 2\n instrument -> place: 2\n place -> beneficiary: 2\n place -> instrument: 2\n place -> victim: 2\n recipient -> communicator: 2\n recipient -> place: 2\n target -> instrument: 2\n target -> place: 2\n artifact -> destroyer: 1\n attacker -> place: 1\n ballot -> place: 1\n crime -> investigator: 1\n crime -> place: 1\n destination -> granter: 1\n employee -> place: 1\n giver -> beneficiary: 1\n granter -> destination: 1\n injurer -> place: 1\n instrument -> artifact: 1\n instrument -> injurer: 1\n instrument -> killer: 1\n judgecourt -> place: 1\n origin -> retreater: 1\n participant -> place: 1\n place -> otherparticipant: 1\n preventer -> place: 1\n prosecutor -> defendant: 1\n recipient -> beneficiary: 1\n transporter -> destination: 1\n transporter -> origin: 1\n victim -> place: 1" }, "0.3": { "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.9642857142857143, "eval_event_type_strict_micro_f1": 0.9818181818181818, "eval_event_type_strict_macro_precision": 0.9923076923076923, "eval_event_type_strict_macro_recall": 0.9633968144953263, "eval_event_type_strict_macro_f1": 0.9758170764875643, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9429 0.9706 35\nconflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.8571 0.9231 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.9167 0.9565 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.9091 0.9524 11\ncontact.discussion.meet 1.0000 0.9412 0.9697 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 0.9000 0.9474 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.7500 0.8571 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9302 0.9639 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.9200 0.9583 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 0.8750 0.9333 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 0.9286 0.9630 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9643 0.9818 896\nmacro avg 0.9923 0.9634 0.9758 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.9642857142857143, "eval_event_type_relaxed_micro_f1": 0.9818181818181818, "eval_event_type_relaxed_macro_precision": 0.9923076923076923, "eval_event_type_relaxed_macro_recall": 0.9633968144953263, "eval_event_type_relaxed_macro_f1": 0.9758170764875643, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 1.0000 1.0000 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9429 0.9706 35\nconflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.8571 0.9231 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.9167 0.9565 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.9091 0.9524 11\ncontact.discussion.meet 1.0000 0.9412 0.9697 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ncontact.requestadvise.correspondence 1.0000 0.9000 0.9474 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 1.0000 1.0000 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 7\ngovernment.spy.spy 1.0000 0.7500 0.8571 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.monitorelect.. 1.0000 1.0000 1.0000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 1.0000 1.0000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9302 0.9639 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 1.0000 1.0000 10\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 8\nlife.injure.illnessdegradationphysical 1.0000 1.0000 1.0000 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.9200 0.9583 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 0.8750 0.9333 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 1.0000 1.0000 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 1.0000 1.0000 7\ntransaction.transferownership.n/a 1.0000 0.9286 0.9630 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9643 0.9818 896\nmacro avg 0.9923 0.9634 0.9758 896", "eval_event_trigger_strict_micro_precision": 0.3877450980392157, "eval_event_trigger_strict_micro_recall": 0.8828125, "eval_event_trigger_strict_micro_f1": 0.5388283378746594, "eval_event_trigger_strict_macro_precision": 0.4509431012996266, "eval_event_trigger_strict_macro_recall": 0.8966811992437311, "eval_event_trigger_strict_macro_f1": 0.5834293939774977, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.4615 0.8571 0.6000 7\nartifactexistence.damagedestroy.destroy 0.4444 0.9231 0.6000 13\nartifactexistence.damagedestroy.n/a 0.5385 0.8750 0.6667 8\nconflict.attack.airstrikemissilestrike 0.2105 1.0000 0.3478 4\nconflict.attack.biologicalchemicalpois.. 0.6000 1.0000 0.7500 3\nconflict.attack.bombing 0.2414 1.0000 0.3889 7\nconflict.attack.firearmattack 0.2857 1.0000 0.4444 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.2885 0.8571 0.4317 35\nconflict.attack.selfdirectedbattle 0.3371 0.7317 0.4615 41\nconflict.attack.setfire 0.1111 1.0000 0.2000 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3846 1.0000 0.5556 5\nconflict.demonstrate.marchprotestpolit.. 0.3333 1.0000 0.5000 2\nconflict.yield.n/a 0.2174 0.7143 0.3333 7\nconflict.yield.retreat 0.2857 0.6667 0.4000 3\nconflict.yield.surrender 0.2381 1.0000 0.3846 5\ncontact.collaborate.correspondence 0.3333 0.5714 0.4211 7\ncontact.collaborate.n/a 0.2609 0.8571 0.4000 7\ncontact.commandorder.broadcast 0.3750 1.0000 0.5455 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.5000 1.0000 0.6667 4\ncontact.commitmentpromiseexpressintent.. 0.5556 1.0000 0.7143 5\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 6\ncontact.commitmentpromiseexpressintent.. 0.2941 0.8333 0.4348 12\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 2\ncontact.discussion.correspondence 0.4000 0.9091 0.5556 11\ncontact.discussion.meet 0.4054 0.8824 0.5556 17\ncontact.discussion.n/a 0.3333 0.7500 0.4615 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 0.5000 1.0000 0.6667 1\ncontact.mediastatement.broadcast 0.4000 1.0000 0.5714 6\ncontact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.4444 1.0000 0.6154 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.3636 1.0000 0.5333 8\ncontact.prevarication.correspondence 0.4091 1.0000 0.5806 9\ncontact.prevarication.meet 0.3704 1.0000 0.5405 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.4615 1.0000 0.6316 6\ncontact.publicstatementinperson.n/a 0.6667 0.8000 0.7273 5\ncontact.requestadvise.broadcast 0.4000 1.0000 0.5714 12\ncontact.requestadvise.correspondence 0.4444 0.8000 0.5714 10\ncontact.requestadvise.meet 0.5385 1.0000 0.7000 7\ncontact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.broadcast 0.3077 1.0000 0.4706 4\ncontact.threatencoerce.correspondence 0.3750 0.6000 0.4615 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ndisaster.accidentcrash.accidentcrash 0.3333 0.6667 0.4444 3\ndisaster.fireexplosion.fireexplosion 0.4286 1.0000 0.6000 3\ngovernment.agreements.acceptagreementc.. 0.4615 1.0000 0.6316 6\ngovernment.agreements.n/a 0.6000 1.0000 0.7500 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.5833 1.0000 0.7368 7\ngovernment.spy.spy 0.4444 0.6667 0.5333 12\ngovernment.vote.castvote 0.1818 0.6667 0.2857 3\ngovernment.vote.n/a 0.3636 1.0000 0.5333 4\ngovernment.vote.violationspreventvote 0.6667 1.0000 0.8000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5455 1.0000 0.7059 6\ninspection.sensoryobserve.monitorelect.. 0.5000 1.0000 0.6667 3\ninspection.sensoryobserve.n/a 0.5000 1.0000 0.6667 1\ninspection.sensoryobserve.physicalinve.. 0.5000 1.0000 0.6667 4\njustice.arrestjaildetain.arrestjaildet.. 0.3529 0.7500 0.4800 8\njustice.initiatejudicialprocess.charge.. 0.2353 0.6667 0.3478 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.2800 0.8750 0.4242 8\njustice.investigate.investigatecrime 0.3333 1.0000 0.5000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.5000 1.0000 0.6667 8\njustice.judicialconsequences.execute 0.6250 1.0000 0.7692 5\njustice.judicialconsequences.extradite 0.5000 1.0000 0.6667 2\njustice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\nlife.die.deathcausedbyviolentevents 0.3158 0.8372 0.4586 43\nlife.die.n/a 0.2909 0.8000 0.4267 20\nlife.die.nonviolentdeath 0.3333 0.8000 0.4706 10\nlife.injure.illnessdegradationhungerth.. 0.3478 1.0000 0.5161 8\nlife.injure.illnessdegradationphysical 0.5000 0.8000 0.6154 5\nlife.injure.injurycausedbyviolentevents 0.2857 0.9231 0.4364 26\nlife.injure.n/a 0.4318 0.7600 0.5507 25\nmanufacture.artifact.build 0.4286 1.0000 0.6000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2500 0.7500 0.3750 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.3750 1.0000 0.5455 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.4000 1.0000 0.5714 2\nmovement.transportartifact.hide 0.2000 0.5000 0.2857 2\nmovement.transportartifact.n/a 0.5714 1.0000 0.7273 8\nmovement.transportartifact.nonviolentt.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.prevententry 0.3333 1.0000 0.5000 3\nmovement.transportartifact.preventexit 0.2667 0.8000 0.4000 5\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 1\nmovement.transportartifact.sendsupplye.. 0.5000 0.6000 0.5455 5\nmovement.transportartifact.smuggleextr.. 0.4286 1.0000 0.6000 3\nmovement.transportperson.dispersesepar.. 0.6000 1.0000 0.7500 3\nmovement.transportperson.evacuationres.. 0.3333 0.7778 0.4667 9\nmovement.transportperson.grantentryasy.. 0.4000 1.0000 0.5714 4\nmovement.transportperson.n/a 0.4444 0.8889 0.5926 9\nmovement.transportperson.prevententry 0.3333 0.8000 0.4706 5\nmovement.transportperson.preventexit 0.6429 1.0000 0.7826 9\nmovement.transportperson.selfmotion 0.4286 0.7500 0.5455 8\nmovement.transportperson.smuggleextract 0.6667 1.0000 0.8000 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.4000 1.0000 0.5714 2\npersonnel.endposition.firinglayoff 0.3226 0.8333 0.4651 12\npersonnel.endposition.n/a 0.4118 0.8750 0.5600 8\npersonnel.endposition.quitretire 0.5000 1.0000 0.6667 3\npersonnel.startposition.hiring 0.4286 0.9000 0.5806 10\npersonnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntransaction.transaction.embargosanction 0.4848 1.0000 0.6531 16\ntransaction.transaction.giftgrantprovi.. 0.3846 0.8333 0.5263 6\ntransaction.transaction.n/a 0.5000 1.0000 0.6667 4\ntransaction.transaction.transfercontrol 0.2857 0.5714 0.3810 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.4737 1.0000 0.6429 9\ntransaction.transfermoney.giftgrantpro.. 0.5333 1.0000 0.6957 8\ntransaction.transfermoney.n/a 0.4545 0.8824 0.6000 17\ntransaction.transfermoney.payforservice 0.3000 0.6923 0.4186 13\ntransaction.transfermoney.purchase 0.4375 1.0000 0.6087 14\ntransaction.transferownership.borrowlend 0.4211 1.0000 0.5926 8\ntransaction.transferownership.embargos.. 0.4667 1.0000 0.6364 14\ntransaction.transferownership.giftgran.. 0.5000 1.0000 0.6667 7\ntransaction.transferownership.n/a 0.5455 0.8571 0.6667 14\ntransaction.transferownership.purchase 0.4483 1.0000 0.6190 13\n----------------------------------------------------------------------------------\nmicro avg 0.3877 0.8828 0.5388 896\nmacro avg 0.4509 0.8967 0.5834 896", "eval_event_trigger_relaxed_micro_precision": 0.3897058823529412, "eval_event_trigger_relaxed_micro_recall": 0.8872767857142857, "eval_event_trigger_relaxed_micro_f1": 0.5415531335149864, "eval_event_trigger_relaxed_macro_precision": 0.4529278271001419, "eval_event_trigger_relaxed_macro_recall": 0.9015543701991919, "eval_event_trigger_relaxed_macro_f1": 0.5861674999629858, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.4615 0.8571 0.6000 7\nartifactexistence.damagedestroy.destroy 0.4444 0.9231 0.6000 13\nartifactexistence.damagedestroy.n/a 0.5385 0.8750 0.6667 8\nconflict.attack.airstrikemissilestrike 0.2105 1.0000 0.3478 4\nconflict.attack.biologicalchemicalpois.. 0.6000 1.0000 0.7500 3\nconflict.attack.bombing 0.2414 1.0000 0.3889 7\nconflict.attack.firearmattack 0.2857 1.0000 0.4444 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.2885 0.8571 0.4317 35\nconflict.attack.selfdirectedbattle 0.3371 0.7317 0.4615 41\nconflict.attack.setfire 0.1111 1.0000 0.2000 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3846 1.0000 0.5556 5\nconflict.demonstrate.marchprotestpolit.. 0.3333 1.0000 0.5000 2\nconflict.yield.n/a 0.2174 0.7143 0.3333 7\nconflict.yield.retreat 0.2857 0.6667 0.4000 3\nconflict.yield.surrender 0.2381 1.0000 0.3846 5\ncontact.collaborate.correspondence 0.3333 0.5714 0.4211 7\ncontact.collaborate.n/a 0.2609 0.8571 0.4000 7\ncontact.commandorder.broadcast 0.3750 1.0000 0.5455 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.5000 1.0000 0.6667 4\ncontact.commitmentpromiseexpressintent.. 0.5556 1.0000 0.7143 5\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 6\ncontact.commitmentpromiseexpressintent.. 0.2941 0.8333 0.4348 12\ncontact.commitmentpromiseexpressintent.. 0.5000 1.0000 0.6667 2\ncontact.discussion.correspondence 0.4000 0.9091 0.5556 11\ncontact.discussion.meet 0.4054 0.8824 0.5556 17\ncontact.discussion.n/a 0.3333 0.7500 0.4615 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 0.5000 1.0000 0.6667 1\ncontact.mediastatement.broadcast 0.4000 1.0000 0.5714 6\ncontact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.4444 1.0000 0.6154 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.3636 1.0000 0.5333 8\ncontact.prevarication.correspondence 0.4091 1.0000 0.5806 9\ncontact.prevarication.meet 0.3704 1.0000 0.5405 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.4615 1.0000 0.6316 6\ncontact.publicstatementinperson.n/a 0.6667 0.8000 0.7273 5\ncontact.requestadvise.broadcast 0.4000 1.0000 0.5714 12\ncontact.requestadvise.correspondence 0.4444 0.8000 0.5714 10\ncontact.requestadvise.meet 0.5385 1.0000 0.7000 7\ncontact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.broadcast 0.3077 1.0000 0.4706 4\ncontact.threatencoerce.correspondence 0.5000 0.8000 0.6154 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ndisaster.accidentcrash.accidentcrash 0.3333 0.6667 0.4444 3\ndisaster.fireexplosion.fireexplosion 0.4286 1.0000 0.6000 3\ngovernment.agreements.acceptagreementc.. 0.4615 1.0000 0.6316 6\ngovernment.agreements.n/a 0.6000 1.0000 0.7500 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.5833 1.0000 0.7368 7\ngovernment.spy.spy 0.4444 0.6667 0.5333 12\ngovernment.vote.castvote 0.2727 1.0000 0.4286 3\ngovernment.vote.n/a 0.3636 1.0000 0.5333 4\ngovernment.vote.violationspreventvote 0.6667 1.0000 0.8000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5455 1.0000 0.7059 6\ninspection.sensoryobserve.monitorelect.. 0.5000 1.0000 0.6667 3\ninspection.sensoryobserve.n/a 0.5000 1.0000 0.6667 1\ninspection.sensoryobserve.physicalinve.. 0.5000 1.0000 0.6667 4\njustice.arrestjaildetain.arrestjaildet.. 0.3529 0.7500 0.4800 8\njustice.initiatejudicialprocess.charge.. 0.2353 0.6667 0.3478 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.2800 0.8750 0.4242 8\njustice.investigate.investigatecrime 0.3333 1.0000 0.5000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.5000 1.0000 0.6667 8\njustice.judicialconsequences.execute 0.6250 1.0000 0.7692 5\njustice.judicialconsequences.extradite 0.5000 1.0000 0.6667 2\njustice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\nlife.die.deathcausedbyviolentevents 0.3246 0.8605 0.4713 43\nlife.die.n/a 0.2909 0.8000 0.4267 20\nlife.die.nonviolentdeath 0.3333 0.8000 0.4706 10\nlife.injure.illnessdegradationhungerth.. 0.3478 1.0000 0.5161 8\nlife.injure.illnessdegradationphysical 0.5000 0.8000 0.6154 5\nlife.injure.injurycausedbyviolentevents 0.2857 0.9231 0.4364 26\nlife.injure.n/a 0.4318 0.7600 0.5507 25\nmanufacture.artifact.build 0.4286 1.0000 0.6000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2500 0.7500 0.3750 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.3750 1.0000 0.5455 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.4000 1.0000 0.5714 2\nmovement.transportartifact.hide 0.2000 0.5000 0.2857 2\nmovement.transportartifact.n/a 0.5714 1.0000 0.7273 8\nmovement.transportartifact.nonviolentt.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.prevententry 0.3333 1.0000 0.5000 3\nmovement.transportartifact.preventexit 0.2667 0.8000 0.4000 5\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 1\nmovement.transportartifact.sendsupplye.. 0.5000 0.6000 0.5455 5\nmovement.transportartifact.smuggleextr.. 0.4286 1.0000 0.6000 3\nmovement.transportperson.dispersesepar.. 0.6000 1.0000 0.7500 3\nmovement.transportperson.evacuationres.. 0.3333 0.7778 0.4667 9\nmovement.transportperson.grantentryasy.. 0.4000 1.0000 0.5714 4\nmovement.transportperson.n/a 0.4444 0.8889 0.5926 9\nmovement.transportperson.prevententry 0.3333 0.8000 0.4706 5\nmovement.transportperson.preventexit 0.6429 1.0000 0.7826 9\nmovement.transportperson.selfmotion 0.4286 0.7500 0.5455 8\nmovement.transportperson.smuggleextract 0.6667 1.0000 0.8000 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.4000 1.0000 0.5714 2\npersonnel.endposition.firinglayoff 0.3226 0.8333 0.4651 12\npersonnel.endposition.n/a 0.4118 0.8750 0.5600 8\npersonnel.endposition.quitretire 0.5000 1.0000 0.6667 3\npersonnel.startposition.hiring 0.4286 0.9000 0.5806 10\npersonnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntransaction.transaction.embargosanction 0.4848 1.0000 0.6531 16\ntransaction.transaction.giftgrantprovi.. 0.3846 0.8333 0.5263 6\ntransaction.transaction.n/a 0.5000 1.0000 0.6667 4\ntransaction.transaction.transfercontrol 0.2857 0.5714 0.3810 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.4737 1.0000 0.6429 9\ntransaction.transfermoney.giftgrantpro.. 0.5333 1.0000 0.6957 8\ntransaction.transfermoney.n/a 0.4545 0.8824 0.6000 17\ntransaction.transfermoney.payforservice 0.3333 0.7692 0.4651 13\ntransaction.transfermoney.purchase 0.4375 1.0000 0.6087 14\ntransaction.transferownership.borrowlend 0.4211 1.0000 0.5926 8\ntransaction.transferownership.embargos.. 0.4667 1.0000 0.6364 14\ntransaction.transferownership.giftgran.. 0.5000 1.0000 0.6667 7\ntransaction.transferownership.n/a 0.5455 0.8571 0.6667 14\ntransaction.transferownership.purchase 0.4483 1.0000 0.6190 13\n----------------------------------------------------------------------------------\nmicro avg 0.3897 0.8873 0.5416 896\nmacro avg 0.4529 0.9016 0.5862 896", "eval_event_argument_strict_micro_precision": 0.014173017783126086, "eval_event_argument_strict_micro_recall": 0.09715857011915674, "eval_event_argument_strict_micro_f1": 0.02473745624270712, "eval_event_argument_strict_macro_precision": 0.016086980650883403, "eval_event_argument_strict_macro_recall": 0.11365193772395006, "eval_event_argument_strict_macro_f1": 0.027981795193166487, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0127 0.0962 0.0225 104\nartifactmoney 0.0213 0.1667 0.0377 6\nattacker 0.0064 0.0500 0.0114 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0136 0.1205 0.0245 83\ncandidate 0.0000 0.0000 0.0000 9\ncommunicator 0.0130 0.1223 0.0235 139\ncrashobject 0.1111 0.5000 0.1818 2\ncrime 0.0076 0.0256 0.0118 39\ndamager 0.0196 0.1429 0.0345 7\ndamagerdestroyer 0.0577 0.3750 0.1000 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 0.0082 0.0682 0.0147 44\ndemonstrator 0.0000 0.0000 0.0000 2\ndestination 0.0249 0.1163 0.0410 43\ndestroyer 0.0000 0.0000 0.0000 11\ndetainee 0.0267 0.2500 0.0482 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.0100 0.0882 0.0180 34\nexecutioner 0.0323 0.3333 0.0588 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0556 0.5000 0.1000 2\ngiver 0.0148 0.1121 0.0262 116\ngovernmentbody 0.0250 0.1429 0.0426 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0000 0.0000 0.0000 4\ninjurer 0.0065 0.0488 0.0115 41\ninspectedentity 0.0256 0.1667 0.0444 6\ninspector 0.0000 0.0000 0.0000 7\ninstrument 0.0058 0.0247 0.0094 81\ninvestigator 0.0312 0.2000 0.0541 10\njailer 0.0213 0.2000 0.0385 5\njudgecourt 0.0325 0.2857 0.0584 14\nkiller 0.0000 0.0000 0.0000 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0390 0.2727 0.0682 11\nmoney 0.0000 0.0000 0.0000 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0299 0.2222 0.0526 9\norigin 0.0243 0.1111 0.0398 45\notherparticipant 0.0769 0.5000 0.1333 2\nparticipant 0.0082 0.0583 0.0144 120\npassenger 0.0214 0.1667 0.0379 30\nplace 0.0271 0.1150 0.0438 374\nplaceofemployment 0.0078 0.0370 0.0129 27\npreventer 0.0132 0.0962 0.0232 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.0152 0.1150 0.0269 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0241 0.1667 0.0421 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.0104 0.0800 0.0184 75\nterritoryorfacility 0.0000 0.0000 0.0000 5\ntransporter 0.0121 0.1020 0.0216 49\nvehicle 0.0351 0.2857 0.0625 7\nvictim 0.0105 0.0818 0.0186 110\nviolator 0.0588 0.5000 0.1053 2\nvoter 0.0000 0.0000 0.0000 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.0142 0.0972 0.0247 2182\nmacro avg 0.0161 0.1137 0.0280 2182", "eval_event_argument_relaxed_micro_precision": 0.09820831661986897, "eval_event_argument_relaxed_micro_recall": 0.6732355637030247, "eval_event_argument_relaxed_micro_f1": 0.17141190198366393, "eval_event_argument_relaxed_macro_precision": 0.09236015242573872, "eval_event_argument_relaxed_macro_recall": 0.6411691785709234, "eval_event_argument_relaxed_macro_f1": 0.16020803558010838, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0674 0.5096 0.1191 104\nartifactmoney 0.0638 0.5000 0.1132 6\nattacker 0.0929 0.7250 0.1648 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0777 0.6867 0.1395 83\ncandidate 0.0658 0.5556 0.1176 9\ncommunicator 0.0849 0.7986 0.1535 139\ncrashobject 0.1111 0.5000 0.1818 2\ncrime 0.1374 0.4615 0.2118 39\ndamager 0.0980 0.7143 0.1724 7\ndamagerdestroyer 0.1154 0.7500 0.2000 8\ndeceased 0.0625 0.5000 0.1111 2\ndefendant 0.0907 0.7500 0.1618 44\ndemonstrator 0.0909 1.0000 0.1667 2\ndestination 0.1542 0.7209 0.2541 43\ndestroyer 0.0777 0.7273 0.1404 11\ndetainee 0.0800 0.7500 0.1446 8\ndriverpassenger 0.0714 0.5000 0.1250 2\nemployee 0.0702 0.6176 0.1261 34\nexecutioner 0.0968 1.0000 0.1765 3\nextraditer 0.1111 0.5000 0.1818 2\nfireexplosionobject 0.1250 0.6667 0.2105 3\nfounder 0.1111 1.0000 0.2000 2\ngiver 0.0844 0.6379 0.1490 116\ngovernmentbody 0.0250 0.1429 0.0426 7\ngpe 0.1429 1.0000 0.2500 1\ngranter 0.0690 0.5000 0.1212 4\ninjurer 0.0747 0.5610 0.1318 41\ninspectedentity 0.0769 0.5000 0.1333 6\ninspector 0.0976 0.5714 0.1667 7\ninstrument 0.1449 0.6173 0.2347 81\ninvestigator 0.1094 0.7000 0.1892 10\njailer 0.1064 1.0000 0.1923 5\njudgecourt 0.0894 0.7857 0.1606 14\nkiller 0.0932 0.8148 0.1673 27\nlaw 0.0870 0.5000 0.1481 4\nmanufacturer 0.1039 0.7273 0.1818 11\nmoney 0.0253 0.2069 0.0451 29\nmonitor 0.1053 0.6667 0.1818 3\nmonitoredentity 0.1053 0.6667 0.1818 3\nobservedentity 0.1045 0.7778 0.1842 9\norigin 0.1553 0.7111 0.2550 45\notherparticipant 0.0769 0.5000 0.1333 2\nparticipant 0.1102 0.7833 0.1932 120\npassenger 0.0983 0.7667 0.1742 30\nplace 0.1636 0.6952 0.2649 374\nplaceofemployment 0.0859 0.4074 0.1419 27\npreventer 0.1029 0.7500 0.1810 52\nprosecutor 0.0667 0.4444 0.1159 9\nrecipient 0.0879 0.6637 0.1552 226\nresult 0.0588 0.5000 0.1053 2\nretreater 0.1364 1.0000 0.2400 3\nspy 0.0843 0.5833 0.1474 12\nsurrenderer 0.1304 0.6000 0.2143 5\ntarget 0.0952 0.7333 0.1685 75\nterritoryorfacility 0.0357 0.2000 0.0606 5\ntransporter 0.0872 0.7347 0.1558 49\nvehicle 0.0877 0.7143 0.1562 7\nvictim 0.0863 0.6727 0.1531 110\nviolator 0.0588 0.5000 0.1053 2\nvoter 0.0833 0.6250 0.1471 8\nyielder 0.1333 0.8571 0.2308 7\n----------------------------------------------------------------------------------\nmicro avg 0.0982 0.6732 0.1714 2182\nmacro avg 0.0924 0.6412 0.1602 2182", "eval_event_strict_micro_precision": 0.10452356958907177, "eval_event_strict_micro_recall": 0.4698037242073478, "eval_event_strict_micro_f1": 0.17100201502106613, "eval_event_strict_macro_precision": 0.5857763849978453, "eval_event_strict_macro_recall": 0.7728464656054733, "eval_event_strict_macro_f1": 0.6348972436721566, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0127 0.0962 0.0225 104\narg:artifactmoney 0.0213 0.1667 0.0377 6\narg:attacker 0.0064 0.0500 0.0114 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0136 0.1205 0.0245 83\narg:candidate 0.0000 0.0000 0.0000 9\narg:communicator 0.0130 0.1223 0.0235 139\narg:crashobject 0.1111 0.5000 0.1818 2\narg:crime 0.0076 0.0256 0.0118 39\narg:damager 0.0196 0.1429 0.0345 7\narg:damagerdestroyer 0.0577 0.3750 0.1000 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 0.0082 0.0682 0.0147 44\narg:demonstrator 0.0000 0.0000 0.0000 2\narg:destination 0.0249 0.1163 0.0410 43\narg:destroyer 0.0000 0.0000 0.0000 11\narg:detainee 0.0267 0.2500 0.0482 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.0100 0.0882 0.0180 34\narg:executioner 0.0323 0.3333 0.0588 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0556 0.5000 0.1000 2\narg:giver 0.0148 0.1121 0.0262 116\narg:governmentbody 0.0250 0.1429 0.0426 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0000 0.0000 0.0000 4\narg:injurer 0.0065 0.0488 0.0115 41\narg:inspectedentity 0.0256 0.1667 0.0444 6\narg:inspector 0.0000 0.0000 0.0000 7\narg:instrument 0.0058 0.0247 0.0094 81\narg:investigator 0.0312 0.2000 0.0541 10\narg:jailer 0.0213 0.2000 0.0385 5\narg:judgecourt 0.0325 0.2857 0.0584 14\narg:killer 0.0000 0.0000 0.0000 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0390 0.2727 0.0682 11\narg:money 0.0000 0.0000 0.0000 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0299 0.2222 0.0526 9\narg:origin 0.0243 0.1111 0.0398 45\narg:otherparticipant 0.0769 0.5000 0.1333 2\narg:participant 0.0082 0.0583 0.0144 120\narg:passenger 0.0214 0.1667 0.0379 30\narg:place 0.0271 0.1150 0.0438 374\narg:placeofemployment 0.0078 0.0370 0.0129 27\narg:preventer 0.0132 0.0962 0.0232 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.0152 0.1150 0.0269 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0241 0.1667 0.0421 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.0104 0.0800 0.0184 75\narg:territoryorfacility 0.0000 0.0000 0.0000 5\narg:transporter 0.0121 0.1020 0.0216 49\narg:vehicle 0.0351 0.2857 0.0625 7\narg:victim 0.0105 0.0818 0.0186 110\narg:violator 0.0588 0.5000 0.1053 2\narg:voter 0.0000 0.0000 0.0000 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 0.4615 0.8571 0.6000 7\ntrigger:artifactexistence.damagedestro.. 0.4444 0.9231 0.6000 13\ntrigger:artifactexistence.damagedestro.. 0.5385 0.8750 0.6667 8\ntrigger:conflict.attack.airstrikemissi.. 0.2105 1.0000 0.3478 4\ntrigger:conflict.attack.biologicalchem.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.bombing 0.2414 1.0000 0.3889 7\ntrigger:conflict.attack.firearmattack 0.2857 1.0000 0.4444 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.2885 0.8571 0.4317 35\ntrigger:conflict.attack.selfdirectedba.. 0.3371 0.7317 0.4615 41\ntrigger:conflict.attack.setfire 0.1111 1.0000 0.2000 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3846 1.0000 0.5556 5\ntrigger:conflict.demonstrate.marchprot.. 0.3333 1.0000 0.5000 2\ntrigger:conflict.yield.n/a 0.2174 0.7143 0.3333 7\ntrigger:conflict.yield.retreat 0.2857 0.6667 0.4000 3\ntrigger:conflict.yield.surrender 0.2381 1.0000 0.3846 5\ntrigger:contact.collaborate.correspond.. 0.3333 0.5714 0.4211 7\ntrigger:contact.collaborate.n/a 0.2609 0.8571 0.4000 7\ntrigger:contact.commandorder.broadcast 0.3750 1.0000 0.5455 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.5000 1.0000 0.6667 4\ntrigger:contact.commitmentpromiseexpre.. 0.5556 1.0000 0.7143 5\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 6\ntrigger:contact.commitmentpromiseexpre.. 0.2941 0.8333 0.4348 12\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 2\ntrigger:contact.discussion.corresponde.. 0.4000 0.9091 0.5556 11\ntrigger:contact.discussion.meet 0.4054 0.8824 0.5556 17\ntrigger:contact.discussion.n/a 0.3333 0.7500 0.4615 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.mediastatement.broadcast 0.4000 1.0000 0.5714 6\ntrigger:contact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.4444 1.0000 0.6154 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.3636 1.0000 0.5333 8\ntrigger:contact.prevarication.correspo.. 0.4091 1.0000 0.5806 9\ntrigger:contact.prevarication.meet 0.3704 1.0000 0.5405 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.4615 1.0000 0.6316 6\ntrigger:contact.publicstatementinperso.. 0.6667 0.8000 0.7273 5\ntrigger:contact.requestadvise.broadcast 0.4000 1.0000 0.5714 12\ntrigger:contact.requestadvise.correspo.. 0.4444 0.8000 0.5714 10\ntrigger:contact.requestadvise.meet 0.5385 1.0000 0.7000 7\ntrigger:contact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.broadcast 0.3077 1.0000 0.4706 4\ntrigger:contact.threatencoerce.corresp.. 0.3750 0.6000 0.4615 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ntrigger:disaster.accidentcrash.acciden.. 0.3333 0.6667 0.4444 3\ntrigger:disaster.fireexplosion.fireexp.. 0.4286 1.0000 0.6000 3\ntrigger:government.agreements.acceptag.. 0.4615 1.0000 0.6316 6\ntrigger:government.agreements.n/a 0.6000 1.0000 0.7500 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.5833 1.0000 0.7368 7\ntrigger:government.spy.spy 0.4444 0.6667 0.5333 12\ntrigger:government.vote.castvote 0.1818 0.6667 0.2857 3\ntrigger:government.vote.n/a 0.3636 1.0000 0.5333 4\ntrigger:government.vote.violationsprev.. 0.6667 1.0000 0.8000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5455 1.0000 0.7059 6\ntrigger:inspection.sensoryobserve.moni.. 0.5000 1.0000 0.6667 3\ntrigger:inspection.sensoryobserve.n/a 0.5000 1.0000 0.6667 1\ntrigger:inspection.sensoryobserve.phys.. 0.5000 1.0000 0.6667 4\ntrigger:justice.arrestjaildetain.arres.. 0.3529 0.7500 0.4800 8\ntrigger:justice.initiatejudicialproces.. 0.2353 0.6667 0.3478 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.2800 0.8750 0.4242 8\ntrigger:justice.investigate.investigat.. 0.3333 1.0000 0.5000 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.5000 1.0000 0.6667 8\ntrigger:justice.judicialconsequences.e.. 0.6250 1.0000 0.7692 5\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 2\ntrigger:justice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\ntrigger:life.die.deathcausedbyviolente.. 0.3158 0.8372 0.4586 43\ntrigger:life.die.n/a 0.2909 0.8000 0.4267 20\ntrigger:life.die.nonviolentdeath 0.3333 0.8000 0.4706 10\ntrigger:life.injure.illnessdegradation.. 0.3478 1.0000 0.5161 8\ntrigger:life.injure.illnessdegradation.. 0.5000 0.8000 0.6154 5\ntrigger:life.injure.injurycausedbyviol.. 0.2857 0.9231 0.4364 26\ntrigger:life.injure.n/a 0.4318 0.7600 0.5507 25\ntrigger:manufacture.artifact.build 0.4286 1.0000 0.6000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2500 0.7500 0.3750 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.3750 1.0000 0.5455 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.4000 1.0000 0.5714 2\ntrigger:movement.transportartifact.hide 0.2000 0.5000 0.2857 2\ntrigger:movement.transportartifact.n/a 0.5714 1.0000 0.7273 8\ntrigger:movement.transportartifact.non.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.pre.. 0.3333 1.0000 0.5000 3\ntrigger:movement.transportartifact.pre.. 0.2667 0.8000 0.4000 5\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.sen.. 0.5000 0.6000 0.5455 5\ntrigger:movement.transportartifact.smu.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportperson.dispe.. 0.6000 1.0000 0.7500 3\ntrigger:movement.transportperson.evacu.. 0.3333 0.7778 0.4667 9\ntrigger:movement.transportperson.grant.. 0.4000 1.0000 0.5714 4\ntrigger:movement.transportperson.n/a 0.4444 0.8889 0.5926 9\ntrigger:movement.transportperson.preve.. 0.3333 0.8000 0.4706 5\ntrigger:movement.transportperson.preve.. 0.6429 1.0000 0.7826 9\ntrigger:movement.transportperson.selfm.. 0.4286 0.7500 0.5455 8\ntrigger:movement.transportperson.smugg.. 0.6667 1.0000 0.8000 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.4000 1.0000 0.5714 2\ntrigger:personnel.endposition.firingla.. 0.3226 0.8333 0.4651 12\ntrigger:personnel.endposition.n/a 0.4118 0.8750 0.5600 8\ntrigger:personnel.endposition.quitretire 0.5000 1.0000 0.6667 3\ntrigger:personnel.startposition.hiring 0.4286 0.9000 0.5806 10\ntrigger:personnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntrigger:transaction.transaction.embarg.. 0.4848 1.0000 0.6531 16\ntrigger:transaction.transaction.giftgr.. 0.3846 0.8333 0.5263 6\ntrigger:transaction.transaction.n/a 0.5000 1.0000 0.6667 4\ntrigger:transaction.transaction.transf.. 0.2857 0.5714 0.3810 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.4737 1.0000 0.6429 9\ntrigger:transaction.transfermoney.gift.. 0.5333 1.0000 0.6957 8\ntrigger:transaction.transfermoney.n/a 0.4545 0.8824 0.6000 17\ntrigger:transaction.transfermoney.payf.. 0.3000 0.6923 0.4186 13\ntrigger:transaction.transfermoney.purc.. 0.4375 1.0000 0.6087 14\ntrigger:transaction.transferownership... 0.4211 1.0000 0.5926 8\ntrigger:transaction.transferownership... 0.4667 1.0000 0.6364 14\ntrigger:transaction.transferownership... 0.5000 1.0000 0.6667 7\ntrigger:transaction.transferownership... 0.5455 0.8571 0.6667 14\ntrigger:transaction.transferownership... 0.4483 1.0000 0.6190 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9429 0.9706 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.8571 0.9231 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.9167 0.9565 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.9091 0.9524 11\ntype:contact.discussion.meet 1.0000 0.9412 0.9697 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.9000 0.9474 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.7500 0.8571 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9302 0.9639 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.9200 0.9583 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 0.8750 0.9333 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 0.9286 0.9630 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.1045 0.4698 0.1710 3974\nmacro avg 0.5858 0.7728 0.6349 3974", "eval_event_relaxed_micro_precision": 0.17512036726010524, "eval_event_relaxed_micro_recall": 0.7871162556618017, "eval_event_relaxed_micro_f1": 0.2864993588569335, "eval_event_relaxed_macro_precision": 0.6012638104764418, "eval_event_relaxed_macro_recall": 0.8763855375207599, "eval_event_relaxed_macro_f1": 0.6614624010699947, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0674 0.5096 0.1191 104\narg:artifactmoney 0.0638 0.5000 0.1132 6\narg:attacker 0.0929 0.7250 0.1648 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0777 0.6867 0.1395 83\narg:candidate 0.0658 0.5556 0.1176 9\narg:communicator 0.0849 0.7986 0.1535 139\narg:crashobject 0.1111 0.5000 0.1818 2\narg:crime 0.1374 0.4615 0.2118 39\narg:damager 0.0980 0.7143 0.1724 7\narg:damagerdestroyer 0.1154 0.7500 0.2000 8\narg:deceased 0.0625 0.5000 0.1111 2\narg:defendant 0.0907 0.7500 0.1618 44\narg:demonstrator 0.0909 1.0000 0.1667 2\narg:destination 0.1542 0.7209 0.2541 43\narg:destroyer 0.0777 0.7273 0.1404 11\narg:detainee 0.0800 0.7500 0.1446 8\narg:driverpassenger 0.0714 0.5000 0.1250 2\narg:employee 0.0702 0.6176 0.1261 34\narg:executioner 0.0968 1.0000 0.1765 3\narg:extraditer 0.1111 0.5000 0.1818 2\narg:fireexplosionobject 0.1250 0.6667 0.2105 3\narg:founder 0.1111 1.0000 0.2000 2\narg:giver 0.0844 0.6379 0.1490 116\narg:governmentbody 0.0250 0.1429 0.0426 7\narg:gpe 0.1429 1.0000 0.2500 1\narg:granter 0.0690 0.5000 0.1212 4\narg:injurer 0.0747 0.5610 0.1318 41\narg:inspectedentity 0.0769 0.5000 0.1333 6\narg:inspector 0.0976 0.5714 0.1667 7\narg:instrument 0.1449 0.6173 0.2347 81\narg:investigator 0.1094 0.7000 0.1892 10\narg:jailer 0.1064 1.0000 0.1923 5\narg:judgecourt 0.0894 0.7857 0.1606 14\narg:killer 0.0932 0.8148 0.1673 27\narg:law 0.0870 0.5000 0.1481 4\narg:manufacturer 0.1039 0.7273 0.1818 11\narg:money 0.0253 0.2069 0.0451 29\narg:monitor 0.1053 0.6667 0.1818 3\narg:monitoredentity 0.1053 0.6667 0.1818 3\narg:observedentity 0.1045 0.7778 0.1842 9\narg:origin 0.1553 0.7111 0.2550 45\narg:otherparticipant 0.0769 0.5000 0.1333 2\narg:participant 0.1102 0.7833 0.1932 120\narg:passenger 0.0983 0.7667 0.1742 30\narg:place 0.1636 0.6952 0.2649 374\narg:placeofemployment 0.0859 0.4074 0.1419 27\narg:preventer 0.1029 0.7500 0.1810 52\narg:prosecutor 0.0667 0.4444 0.1159 9\narg:recipient 0.0879 0.6637 0.1552 226\narg:result 0.0588 0.5000 0.1053 2\narg:retreater 0.1364 1.0000 0.2400 3\narg:spy 0.0843 0.5833 0.1474 12\narg:surrenderer 0.1304 0.6000 0.2143 5\narg:target 0.0952 0.7333 0.1685 75\narg:territoryorfacility 0.0357 0.2000 0.0606 5\narg:transporter 0.0872 0.7347 0.1558 49\narg:vehicle 0.0877 0.7143 0.1562 7\narg:victim 0.0863 0.6727 0.1531 110\narg:violator 0.0588 0.5000 0.1053 2\narg:voter 0.0833 0.6250 0.1471 8\narg:yielder 0.1333 0.8571 0.2308 7\ntrigger:artifactexistence.damagedestro.. 0.4615 0.8571 0.6000 7\ntrigger:artifactexistence.damagedestro.. 0.4444 0.9231 0.6000 13\ntrigger:artifactexistence.damagedestro.. 0.5385 0.8750 0.6667 8\ntrigger:conflict.attack.airstrikemissi.. 0.2105 1.0000 0.3478 4\ntrigger:conflict.attack.biologicalchem.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.bombing 0.2414 1.0000 0.3889 7\ntrigger:conflict.attack.firearmattack 0.2857 1.0000 0.4444 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.2885 0.8571 0.4317 35\ntrigger:conflict.attack.selfdirectedba.. 0.3371 0.7317 0.4615 41\ntrigger:conflict.attack.setfire 0.1111 1.0000 0.2000 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3846 1.0000 0.5556 5\ntrigger:conflict.demonstrate.marchprot.. 0.3333 1.0000 0.5000 2\ntrigger:conflict.yield.n/a 0.2174 0.7143 0.3333 7\ntrigger:conflict.yield.retreat 0.2857 0.6667 0.4000 3\ntrigger:conflict.yield.surrender 0.2381 1.0000 0.3846 5\ntrigger:contact.collaborate.correspond.. 0.3333 0.5714 0.4211 7\ntrigger:contact.collaborate.n/a 0.2609 0.8571 0.4000 7\ntrigger:contact.commandorder.broadcast 0.3750 1.0000 0.5455 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.5000 1.0000 0.6667 4\ntrigger:contact.commitmentpromiseexpre.. 0.5556 1.0000 0.7143 5\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 6\ntrigger:contact.commitmentpromiseexpre.. 0.2941 0.8333 0.4348 12\ntrigger:contact.commitmentpromiseexpre.. 0.5000 1.0000 0.6667 2\ntrigger:contact.discussion.corresponde.. 0.4000 0.9091 0.5556 11\ntrigger:contact.discussion.meet 0.4054 0.8824 0.5556 17\ntrigger:contact.discussion.n/a 0.3333 0.7500 0.4615 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.mediastatement.broadcast 0.4000 1.0000 0.5714 6\ntrigger:contact.mediastatement.n/a 0.2857 0.6667 0.4000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.4444 1.0000 0.6154 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.3636 1.0000 0.5333 8\ntrigger:contact.prevarication.correspo.. 0.4091 1.0000 0.5806 9\ntrigger:contact.prevarication.meet 0.3704 1.0000 0.5405 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.4615 1.0000 0.6316 6\ntrigger:contact.publicstatementinperso.. 0.6667 0.8000 0.7273 5\ntrigger:contact.requestadvise.broadcast 0.4000 1.0000 0.5714 12\ntrigger:contact.requestadvise.correspo.. 0.4444 0.8000 0.5714 10\ntrigger:contact.requestadvise.meet 0.5385 1.0000 0.7000 7\ntrigger:contact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.broadcast 0.3077 1.0000 0.4706 4\ntrigger:contact.threatencoerce.corresp.. 0.5000 0.8000 0.6154 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ntrigger:disaster.accidentcrash.acciden.. 0.3333 0.6667 0.4444 3\ntrigger:disaster.fireexplosion.fireexp.. 0.4286 1.0000 0.6000 3\ntrigger:government.agreements.acceptag.. 0.4615 1.0000 0.6316 6\ntrigger:government.agreements.n/a 0.6000 1.0000 0.7500 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.5833 1.0000 0.7368 7\ntrigger:government.spy.spy 0.4444 0.6667 0.5333 12\ntrigger:government.vote.castvote 0.2727 1.0000 0.4286 3\ntrigger:government.vote.n/a 0.3636 1.0000 0.5333 4\ntrigger:government.vote.violationsprev.. 0.6667 1.0000 0.8000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5455 1.0000 0.7059 6\ntrigger:inspection.sensoryobserve.moni.. 0.5000 1.0000 0.6667 3\ntrigger:inspection.sensoryobserve.n/a 0.5000 1.0000 0.6667 1\ntrigger:inspection.sensoryobserve.phys.. 0.5000 1.0000 0.6667 4\ntrigger:justice.arrestjaildetain.arres.. 0.3529 0.7500 0.4800 8\ntrigger:justice.initiatejudicialproces.. 0.2353 0.6667 0.3478 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.2800 0.8750 0.4242 8\ntrigger:justice.investigate.investigat.. 0.3333 1.0000 0.5000 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.5000 1.0000 0.6667 8\ntrigger:justice.judicialconsequences.e.. 0.6250 1.0000 0.7692 5\ntrigger:justice.judicialconsequences.e.. 0.5000 1.0000 0.6667 2\ntrigger:justice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\ntrigger:life.die.deathcausedbyviolente.. 0.3246 0.8605 0.4713 43\ntrigger:life.die.n/a 0.2909 0.8000 0.4267 20\ntrigger:life.die.nonviolentdeath 0.3333 0.8000 0.4706 10\ntrigger:life.injure.illnessdegradation.. 0.3478 1.0000 0.5161 8\ntrigger:life.injure.illnessdegradation.. 0.5000 0.8000 0.6154 5\ntrigger:life.injure.injurycausedbyviol.. 0.2857 0.9231 0.4364 26\ntrigger:life.injure.n/a 0.4318 0.7600 0.5507 25\ntrigger:manufacture.artifact.build 0.4286 1.0000 0.6000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2500 0.7500 0.3750 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.3750 1.0000 0.5455 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.4000 1.0000 0.5714 2\ntrigger:movement.transportartifact.hide 0.2000 0.5000 0.2857 2\ntrigger:movement.transportartifact.n/a 0.5714 1.0000 0.7273 8\ntrigger:movement.transportartifact.non.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.pre.. 0.3333 1.0000 0.5000 3\ntrigger:movement.transportartifact.pre.. 0.2667 0.8000 0.4000 5\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.sen.. 0.5000 0.6000 0.5455 5\ntrigger:movement.transportartifact.smu.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportperson.dispe.. 0.6000 1.0000 0.7500 3\ntrigger:movement.transportperson.evacu.. 0.3333 0.7778 0.4667 9\ntrigger:movement.transportperson.grant.. 0.4000 1.0000 0.5714 4\ntrigger:movement.transportperson.n/a 0.4444 0.8889 0.5926 9\ntrigger:movement.transportperson.preve.. 0.3333 0.8000 0.4706 5\ntrigger:movement.transportperson.preve.. 0.6429 1.0000 0.7826 9\ntrigger:movement.transportperson.selfm.. 0.4286 0.7500 0.5455 8\ntrigger:movement.transportperson.smugg.. 0.6667 1.0000 0.8000 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.4000 1.0000 0.5714 2\ntrigger:personnel.endposition.firingla.. 0.3226 0.8333 0.4651 12\ntrigger:personnel.endposition.n/a 0.4118 0.8750 0.5600 8\ntrigger:personnel.endposition.quitretire 0.5000 1.0000 0.6667 3\ntrigger:personnel.startposition.hiring 0.4286 0.9000 0.5806 10\ntrigger:personnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntrigger:transaction.transaction.embarg.. 0.4848 1.0000 0.6531 16\ntrigger:transaction.transaction.giftgr.. 0.3846 0.8333 0.5263 6\ntrigger:transaction.transaction.n/a 0.5000 1.0000 0.6667 4\ntrigger:transaction.transaction.transf.. 0.2857 0.5714 0.3810 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.4737 1.0000 0.6429 9\ntrigger:transaction.transfermoney.gift.. 0.5333 1.0000 0.6957 8\ntrigger:transaction.transfermoney.n/a 0.4545 0.8824 0.6000 17\ntrigger:transaction.transfermoney.payf.. 0.3333 0.7692 0.4651 13\ntrigger:transaction.transfermoney.purc.. 0.4375 1.0000 0.6087 14\ntrigger:transaction.transferownership... 0.4211 1.0000 0.5926 8\ntrigger:transaction.transferownership... 0.4667 1.0000 0.6364 14\ntrigger:transaction.transferownership... 0.5000 1.0000 0.6667 7\ntrigger:transaction.transferownership... 0.5455 0.8571 0.6667 14\ntrigger:transaction.transferownership... 0.4483 1.0000 0.6190 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9429 0.9706 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9756 0.9877 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.8571 0.9231 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.9167 0.9565 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.9091 0.9524 11\ntype:contact.discussion.meet 1.0000 0.9412 0.9697 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 1.0000 1.0000 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.9000 0.9474 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 1.0000 1.0000 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 7\ntype:government.spy.spy 1.0000 0.7500 0.8571 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 1.0000 1.0000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 1.0000 1.0000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9302 0.9639 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 1.0000 1.0000 10\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 8\ntype:life.injure.illnessdegradationphy.. 1.0000 1.0000 1.0000 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.9200 0.9583 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 0.8750 0.9333 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 1.0000 1.0000 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 1.0000 1.0000 7\ntype:transaction.transferownership.n/a 1.0000 0.9286 0.9630 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.1751 0.7871 0.2865 3974\nmacro avg 0.6013 0.8764 0.6615 3974", "eval_event_trigger_error_COR": 791, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 2, "eval_event_trigger_error_BEL": 2, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 1245, "eval_event_trigger_error_FN": 101, "eval_event_trigger_fair_micro_precision": 0.38812561334641804, "eval_event_trigger_fair_micro_recall": 0.8847874720357942, "eval_event_trigger_fair_micro_f1": 0.5395634379263301, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 791\nLE 0\nBES 2\nBEL 2\nBEO 0\nLBE 0\nFP 1245\nFN 101\n-----------------\nfair P / R / F1: 0.3881 / 0.8848 / 0.5396", "eval_event_argument_error_COR": 945, "eval_event_argument_error_LE": 40, "eval_event_argument_error_BES": 355, "eval_event_argument_error_BEL": 104, "eval_event_argument_error_BEO": 47, "eval_event_argument_error_LBE": 63, "eval_event_argument_error_FP": 13404, "eval_event_argument_error_FN": 628, "eval_event_argument_fair_micro_precision": 0.06448971235540997, "eval_event_argument_fair_micro_recall": 0.5033288948069241, "eval_event_argument_fair_micro_f1": 0.11433065150323635, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 945\nLE 40\nBES 355\nBEL 104\nBEO 47\nLBE 63\nFP 13404\nFN 628\n-----------------\nfair P / R / F1: 0.0645 / 0.5033 / 0.1143\n\nlabel confusions (gold -> pred):\n placeofemployment -> employee: 10\n place -> beneficiary: 6\n place -> communicator: 6\n crime -> defendant: 5\n giver -> beneficiary: 5\n giver -> place: 5\n place -> participant: 5\n recipient -> communicator: 4\n target -> place: 4\n place -> artifact: 3\n place -> killer: 3\n place -> victim: 3\n target -> instrument: 3\n crime -> judgecourt: 2\n employee -> placeofemployment: 2\n instrument -> attacker: 2\n origin -> artifact: 2\n participant -> place: 2\n victim -> place: 2\n artifact -> beneficiary: 1\n artifact -> damager: 1\n attacker -> place: 1\n attacker -> target: 1\n communicator -> recipient: 1\n deceased -> participant: 1\n defendant -> crime: 1\n destination -> transporter: 1\n employee -> place: 1\n giver -> money: 1\n injurer -> victim: 1\n inspectedentity -> place: 1\n instrument -> artifact: 1\n instrument -> killer: 1\n judgecourt -> crime: 1\n killer -> place: 1\n origin -> vehicle: 1\n passenger -> origin: 1\n place -> attacker: 1\n place -> injurer: 1\n place -> inspector: 1\n place -> instrument: 1\n place -> preventer: 1\n preventer -> passenger: 1\n preventer -> place: 1\n prosecutor -> defendant: 1\n prosecutor -> place: 1\n recipient -> place: 1\n result -> place: 1" }, "0.5": { "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.9330357142857143, "eval_event_type_strict_micro_f1": 0.9653579676674364, "eval_event_type_strict_macro_precision": 0.9923076923076923, "eval_event_type_strict_macro_recall": 0.9362556088332753, "eval_event_type_strict_macro_f1": 0.9605236205777712, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9429 0.9706 35\nconflict.attack.selfdirectedbattle 1.0000 0.9512 0.9750 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.7143 0.8333 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8333 0.9091 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.9167 0.9565 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.8182 0.9000 11\ncontact.discussion.meet 1.0000 0.9412 0.9697 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ncontact.requestadvise.correspondence 1.0000 0.8000 0.8889 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 0.8333 0.9091 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.8571 0.9231 7\ngovernment.spy.spy 1.0000 0.6667 0.8000 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.8333 0.9091 6\ninspection.sensoryobserve.monitorelect.. 1.0000 0.6667 0.8000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.8333 0.9091 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9070 0.9512 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 0.8000 0.8889 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 0.8000 0.8889 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.8800 0.9362 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 0.8889 0.9412 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 0.8750 0.9333 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 0.8000 0.8889 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 0.9375 0.9677 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.8750 0.9333 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.8571 0.9231 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9330 0.9654 896\nmacro avg 0.9923 0.9363 0.9605 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.9330357142857143, "eval_event_type_relaxed_micro_f1": 0.9653579676674364, "eval_event_type_relaxed_macro_precision": 0.9923076923076923, "eval_event_type_relaxed_macro_recall": 0.9362556088332753, "eval_event_type_relaxed_macro_f1": 0.9605236205777712, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.9429 0.9706 35\nconflict.attack.selfdirectedbattle 1.0000 0.9512 0.9750 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.7143 0.8333 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8333 0.9091 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.9167 0.9565 12\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.discussion.correspondence 1.0000 0.8182 0.9000 11\ncontact.discussion.meet 1.0000 0.9412 0.9697 17\ncontact.discussion.n/a 1.0000 1.0000 1.0000 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 1.0000 1.0000 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 1.0000 1.0000 10\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 1.0000 1.0000 6\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ncontact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ncontact.requestadvise.correspondence 1.0000 0.8000 0.8889 10\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 7\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 0.8333 0.9091 6\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 1.0000 1.0000 1.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.8571 0.9231 7\ngovernment.spy.spy 1.0000 0.6667 0.8000 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 1.0000 1.0000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.8333 0.9091 6\ninspection.sensoryobserve.monitorelect.. 1.0000 0.6667 0.8000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.8333 0.9091 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.9070 0.9512 43\nlife.die.n/a 1.0000 1.0000 1.0000 20\nlife.die.nonviolentdeath 1.0000 0.8000 0.8889 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 0.8000 0.8889 5\nlife.injure.injurycausedbyviolentevents 1.0000 1.0000 1.0000 26\nlife.injure.n/a 1.0000 0.8800 0.9362 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 8\nmovement.transportartifact.nonviolentt.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 1.0000 1.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 0.8889 0.9412 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 1.0000 1.0000 9\nmovement.transportperson.prevententry 1.0000 1.0000 1.0000 5\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 9\nmovement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 1.0000 1.0000 3\npersonnel.elect.winelection 1.0000 1.0000 1.0000 2\npersonnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\npersonnel.endposition.n/a 1.0000 0.8750 0.9333 8\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 3\npersonnel.startposition.hiring 1.0000 0.8000 0.8889 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 0.9375 0.9677 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.8750 0.9333 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 1.0000 1.0000 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.8571 0.9231 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9330 0.9654 896\nmacro avg 0.9923 0.9363 0.9605 896", "eval_event_trigger_strict_micro_precision": 0.4573019801980198, "eval_event_trigger_strict_micro_recall": 0.8247767857142857, "eval_event_trigger_strict_micro_f1": 0.588375796178344, "eval_event_trigger_strict_macro_precision": 0.5179656928708055, "eval_event_trigger_strict_macro_recall": 0.8384262508363023, "eval_event_trigger_strict_macro_f1": 0.6241127654829957, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.7500 0.8571 0.8000 7\nartifactexistence.damagedestroy.destroy 0.5455 0.9231 0.6857 13\nartifactexistence.damagedestroy.n/a 0.5833 0.8750 0.7000 8\nconflict.attack.airstrikemissilestrike 0.2857 1.0000 0.4444 4\nconflict.attack.biologicalchemicalpois.. 0.6000 1.0000 0.7500 3\nconflict.attack.bombing 0.3333 1.0000 0.5000 7\nconflict.attack.firearmattack 0.4000 1.0000 0.5714 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.3600 0.7714 0.4909 35\nconflict.attack.selfdirectedbattle 0.4219 0.6585 0.5143 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3636 0.8000 0.5000 5\nconflict.demonstrate.marchprotestpolit.. 0.4000 1.0000 0.5714 2\nconflict.yield.n/a 0.2941 0.7143 0.4167 7\nconflict.yield.retreat 0.2857 0.6667 0.4000 3\nconflict.yield.surrender 0.2778 1.0000 0.4348 5\ncontact.collaborate.correspondence 0.4444 0.5714 0.5000 7\ncontact.collaborate.n/a 0.4167 0.7143 0.5263 7\ncontact.commandorder.broadcast 0.5000 1.0000 0.6667 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.2500 0.2500 0.2500 4\ncontact.commitmentpromiseexpressintent.. 0.5556 1.0000 0.7143 5\ncontact.commitmentpromiseexpressintent.. 0.4444 0.6667 0.5333 6\ncontact.commitmentpromiseexpressintent.. 0.4000 0.8333 0.5405 12\ncontact.commitmentpromiseexpressintent.. 0.6667 1.0000 0.8000 2\ncontact.discussion.correspondence 0.4091 0.8182 0.5455 11\ncontact.discussion.meet 0.4375 0.8235 0.5714 17\ncontact.discussion.n/a 0.3750 0.7500 0.5000 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.5000 1.0000 0.6667 6\ncontact.mediastatement.n/a 0.4000 0.6667 0.5000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.5000 0.8750 0.6364 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.3889 0.8750 0.5385 8\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 9\ncontact.prevarication.meet 0.4545 1.0000 0.6250 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.5556 0.8333 0.6667 6\ncontact.publicstatementinperson.n/a 0.8000 0.8000 0.8000 5\ncontact.requestadvise.broadcast 0.4000 0.8333 0.5405 12\ncontact.requestadvise.correspondence 0.4286 0.6000 0.5000 10\ncontact.requestadvise.meet 0.5455 0.8571 0.6667 7\ncontact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.broadcast 0.4444 1.0000 0.6154 4\ncontact.threatencoerce.correspondence 0.4286 0.6000 0.5000 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ndisaster.accidentcrash.accidentcrash 0.4000 0.6667 0.5000 3\ndisaster.fireexplosion.fireexplosion 0.4286 1.0000 0.6000 3\ngovernment.agreements.acceptagreementc.. 0.4545 0.8333 0.5882 6\ngovernment.agreements.n/a 0.7500 1.0000 0.8571 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.6000 0.8571 0.7059 7\ngovernment.spy.spy 0.5833 0.5833 0.5833 12\ngovernment.vote.castvote 0.2857 0.6667 0.4000 3\ngovernment.vote.n/a 0.4444 1.0000 0.6154 4\ngovernment.vote.violationspreventvote 0.5000 0.5000 0.5000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5000 0.6667 0.5714 6\ninspection.sensoryobserve.monitorelect.. 0.5000 0.6667 0.5714 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.5714 1.0000 0.7273 4\njustice.arrestjaildetain.arrestjaildet.. 0.3333 0.3750 0.3529 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.5000 0.3333 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.3182 0.8750 0.4667 8\njustice.investigate.investigatecrime 0.3810 1.0000 0.5517 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.5000 1.0000 0.6667 8\njustice.judicialconsequences.execute 0.7143 1.0000 0.8333 5\njustice.judicialconsequences.extradite 0.3333 0.5000 0.4000 2\njustice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\nlife.die.deathcausedbyviolentevents 0.3804 0.8140 0.5185 43\nlife.die.n/a 0.4000 0.8000 0.5333 20\nlife.die.nonviolentdeath 0.4375 0.7000 0.5385 10\nlife.injure.illnessdegradationhungerth.. 0.5385 0.8750 0.6667 8\nlife.injure.illnessdegradationphysical 0.5000 0.6000 0.5455 5\nlife.injure.injurycausedbyviolentevents 0.3478 0.9231 0.5053 26\nlife.injure.n/a 0.4872 0.7600 0.5938 25\nmanufacture.artifact.build 0.6000 1.0000 0.7500 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.3750 0.7500 0.5000 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.5000 1.0000 0.6667 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.6667 1.0000 0.8000 2\nmovement.transportartifact.hide 0.2500 0.5000 0.3333 2\nmovement.transportartifact.n/a 0.7273 1.0000 0.8421 8\nmovement.transportartifact.nonviolentt.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.prevententry 0.4286 1.0000 0.6000 3\nmovement.transportartifact.preventexit 0.1818 0.4000 0.2500 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 0.5000 0.6000 0.5455 5\nmovement.transportartifact.smuggleextr.. 0.5000 1.0000 0.6667 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.4286 0.6667 0.5217 9\nmovement.transportperson.grantentryasy.. 0.5000 1.0000 0.6667 4\nmovement.transportperson.n/a 0.5714 0.8889 0.6957 9\nmovement.transportperson.prevententry 0.3750 0.6000 0.4615 5\nmovement.transportperson.preventexit 0.6667 0.8889 0.7619 9\nmovement.transportperson.selfmotion 0.4615 0.7500 0.5714 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.6667 1.0000 0.8000 2\npersonnel.endposition.firinglayoff 0.3846 0.8333 0.5263 12\npersonnel.endposition.n/a 0.5000 0.8750 0.6364 8\npersonnel.endposition.quitretire 0.4000 0.6667 0.5000 3\npersonnel.startposition.hiring 0.6154 0.8000 0.6957 10\npersonnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntransaction.transaction.embargosanction 0.5385 0.8750 0.6667 16\ntransaction.transaction.giftgrantprovi.. 0.5000 0.8333 0.6250 6\ntransaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntransaction.transaction.transfercontrol 0.3000 0.4286 0.3529 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.5294 1.0000 0.6923 9\ntransaction.transfermoney.giftgrantpro.. 0.5833 0.8750 0.7000 8\ntransaction.transfermoney.n/a 0.5000 0.8824 0.6383 17\ntransaction.transfermoney.payforservice 0.3333 0.6923 0.4500 13\ntransaction.transfermoney.purchase 0.5000 1.0000 0.6667 14\ntransaction.transferownership.borrowlend 0.5714 1.0000 0.7273 8\ntransaction.transferownership.embargos.. 0.5600 1.0000 0.7179 14\ntransaction.transferownership.giftgran.. 0.5455 0.8571 0.6667 7\ntransaction.transferownership.n/a 0.6111 0.7857 0.6875 14\ntransaction.transferownership.purchase 0.5000 1.0000 0.6667 13\n----------------------------------------------------------------------------------\nmicro avg 0.4573 0.8248 0.5884 896\nmacro avg 0.5180 0.8384 0.6241 896", "eval_event_trigger_relaxed_micro_precision": 0.4597772277227723, "eval_event_trigger_relaxed_micro_recall": 0.8292410714285714, "eval_event_trigger_relaxed_micro_f1": 0.5915605095541402, "eval_event_trigger_relaxed_macro_precision": 0.5232792601408944, "eval_event_trigger_relaxed_macro_recall": 0.8445814730738143, "eval_event_trigger_relaxed_macro_f1": 0.6297395461097762, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.7500 0.8571 0.8000 7\nartifactexistence.damagedestroy.destroy 0.5455 0.9231 0.6857 13\nartifactexistence.damagedestroy.n/a 0.5833 0.8750 0.7000 8\nconflict.attack.airstrikemissilestrike 0.2857 1.0000 0.4444 4\nconflict.attack.biologicalchemicalpois.. 0.6000 1.0000 0.7500 3\nconflict.attack.bombing 0.3333 1.0000 0.5000 7\nconflict.attack.firearmattack 0.4000 1.0000 0.5714 2\nconflict.attack.invade 0.2500 1.0000 0.4000 1\nconflict.attack.n/a 0.3600 0.7714 0.4909 35\nconflict.attack.selfdirectedbattle 0.4219 0.6585 0.5143 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 0.5000 1.0000 0.6667 1\nconflict.attack.stealrobhijack 0.3636 0.8000 0.5000 5\nconflict.demonstrate.marchprotestpolit.. 0.4000 1.0000 0.5714 2\nconflict.yield.n/a 0.2941 0.7143 0.4167 7\nconflict.yield.retreat 0.2857 0.6667 0.4000 3\nconflict.yield.surrender 0.2778 1.0000 0.4348 5\ncontact.collaborate.correspondence 0.4444 0.5714 0.5000 7\ncontact.collaborate.n/a 0.4167 0.7143 0.5263 7\ncontact.commandorder.broadcast 0.5000 1.0000 0.6667 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.5000 1.0000 0.6667 3\ncontact.commandorder.n/a 0.2500 0.2500 0.2500 4\ncontact.commitmentpromiseexpressintent.. 0.5556 1.0000 0.7143 5\ncontact.commitmentpromiseexpressintent.. 0.4444 0.6667 0.5333 6\ncontact.commitmentpromiseexpressintent.. 0.4000 0.8333 0.5405 12\ncontact.commitmentpromiseexpressintent.. 0.6667 1.0000 0.8000 2\ncontact.discussion.correspondence 0.4091 0.8182 0.5455 11\ncontact.discussion.meet 0.4375 0.8235 0.5714 17\ncontact.discussion.n/a 0.3750 0.7500 0.5000 4\ncontact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.5000 1.0000 0.6667 6\ncontact.mediastatement.n/a 0.4000 0.6667 0.5000 3\ncontact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ncontact.negotiate.meet 0.5000 0.8750 0.6364 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.3889 0.8750 0.5385 8\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 9\ncontact.prevarication.meet 0.4545 1.0000 0.6250 10\ncontact.prevarication.n/a 0.8000 1.0000 0.8889 4\ncontact.publicstatementinperson.broadc.. 0.5556 0.8333 0.6667 6\ncontact.publicstatementinperson.n/a 0.8000 0.8000 0.8000 5\ncontact.requestadvise.broadcast 0.4000 0.8333 0.5405 12\ncontact.requestadvise.correspondence 0.4286 0.6000 0.5000 10\ncontact.requestadvise.meet 0.5455 0.8571 0.6667 7\ncontact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.broadcast 0.4444 1.0000 0.6154 4\ncontact.threatencoerce.correspondence 0.5714 0.8000 0.6667 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ndisaster.accidentcrash.accidentcrash 0.4000 0.6667 0.5000 3\ndisaster.fireexplosion.fireexplosion 0.4286 1.0000 0.6000 3\ngovernment.agreements.acceptagreementc.. 0.4545 0.8333 0.5882 6\ngovernment.agreements.n/a 0.7500 1.0000 0.8571 3\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 2\ngovernment.formation.n/a 0.5000 1.0000 0.6667 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.6000 0.8571 0.7059 7\ngovernment.spy.spy 0.5833 0.5833 0.5833 12\ngovernment.vote.castvote 0.2857 0.6667 0.4000 3\ngovernment.vote.n/a 0.4444 1.0000 0.6154 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5000 0.6667 0.5714 6\ninspection.sensoryobserve.monitorelect.. 0.5000 0.6667 0.5714 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.5714 1.0000 0.7273 4\njustice.arrestjaildetain.arrestjaildet.. 0.3333 0.3750 0.3529 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.5000 0.3333 6\njustice.initiatejudicialprocess.n/a 0.3636 1.0000 0.5333 4\njustice.initiatejudicialprocess.trialh.. 0.3182 0.8750 0.4667 8\njustice.investigate.investigatecrime 0.3810 1.0000 0.5517 8\njustice.investigate.n/a 1.0000 0.5000 0.6667 2\njustice.judicialconsequences.convict 0.5000 1.0000 0.6667 8\njustice.judicialconsequences.execute 0.7143 1.0000 0.8333 5\njustice.judicialconsequences.extradite 0.3333 0.5000 0.4000 2\njustice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\nlife.die.deathcausedbyviolentevents 0.3913 0.8372 0.5333 43\nlife.die.n/a 0.4000 0.8000 0.5333 20\nlife.die.nonviolentdeath 0.4375 0.7000 0.5385 10\nlife.injure.illnessdegradationhungerth.. 0.5385 0.8750 0.6667 8\nlife.injure.illnessdegradationphysical 0.5000 0.6000 0.5455 5\nlife.injure.injurycausedbyviolentevents 0.3478 0.9231 0.5053 26\nlife.injure.n/a 0.4872 0.7600 0.5938 25\nmanufacture.artifact.build 0.6000 1.0000 0.7500 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.3750 0.7500 0.5000 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.5000 1.0000 0.6667 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 1\nmovement.transportartifact.grantentry 0.6667 1.0000 0.8000 2\nmovement.transportartifact.hide 0.2500 0.5000 0.3333 2\nmovement.transportartifact.n/a 0.7273 1.0000 0.8421 8\nmovement.transportartifact.nonviolentt.. 0.5000 1.0000 0.6667 1\nmovement.transportartifact.prevententry 0.4286 1.0000 0.6000 3\nmovement.transportartifact.preventexit 0.1818 0.4000 0.2500 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 0.5000 0.6000 0.5455 5\nmovement.transportartifact.smuggleextr.. 0.5000 1.0000 0.6667 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.4286 0.6667 0.5217 9\nmovement.transportperson.grantentryasy.. 0.5000 1.0000 0.6667 4\nmovement.transportperson.n/a 0.5714 0.8889 0.6957 9\nmovement.transportperson.prevententry 0.3750 0.6000 0.4615 5\nmovement.transportperson.preventexit 0.6667 0.8889 0.7619 9\nmovement.transportperson.selfmotion 0.4615 0.7500 0.5714 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 0.5000 1.0000 0.6667 3\npersonnel.elect.winelection 0.6667 1.0000 0.8000 2\npersonnel.endposition.firinglayoff 0.3846 0.8333 0.5263 12\npersonnel.endposition.n/a 0.5000 0.8750 0.6364 8\npersonnel.endposition.quitretire 0.4000 0.6667 0.5000 3\npersonnel.startposition.hiring 0.6154 0.8000 0.6957 10\npersonnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntransaction.transaction.embargosanction 0.5385 0.8750 0.6667 16\ntransaction.transaction.giftgrantprovi.. 0.5000 0.8333 0.6250 6\ntransaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntransaction.transaction.transfercontrol 0.3000 0.4286 0.3529 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.5294 1.0000 0.6923 9\ntransaction.transfermoney.giftgrantpro.. 0.5833 0.8750 0.7000 8\ntransaction.transfermoney.n/a 0.5000 0.8824 0.6383 17\ntransaction.transfermoney.payforservice 0.3704 0.7692 0.5000 13\ntransaction.transfermoney.purchase 0.5000 1.0000 0.6667 14\ntransaction.transferownership.borrowlend 0.5714 1.0000 0.7273 8\ntransaction.transferownership.embargos.. 0.5600 1.0000 0.7179 14\ntransaction.transferownership.giftgran.. 0.5455 0.8571 0.6667 7\ntransaction.transferownership.n/a 0.6111 0.7857 0.6875 14\ntransaction.transferownership.purchase 0.5000 1.0000 0.6667 13\n----------------------------------------------------------------------------------\nmicro avg 0.4598 0.8292 0.5916 896\nmacro avg 0.5233 0.8446 0.6297 896", "eval_event_argument_strict_micro_precision": 0.02622714148219442, "eval_event_argument_strict_micro_recall": 0.0999083409715857, "eval_event_argument_strict_micro_f1": 0.04154755098151324, "eval_event_argument_strict_macro_precision": 0.027195698400665443, "eval_event_argument_strict_macro_recall": 0.09895767182521208, "eval_event_argument_strict_macro_f1": 0.041746585077901736, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0120 0.0481 0.0193 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.0218 0.0875 0.0349 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0267 0.1205 0.0437 83\ncandidate 0.0000 0.0000 0.0000 9\ncommunicator 0.0208 0.1295 0.0358 139\ncrashobject 0.2000 0.5000 0.2857 2\ncrime 0.0000 0.0000 0.0000 39\ndamager 0.0870 0.2857 0.1333 7\ndamagerdestroyer 0.0312 0.1250 0.0500 8\ndeceased 0.1111 0.5000 0.1818 2\ndefendant 0.0148 0.0682 0.0243 44\ndemonstrator 0.0000 0.0000 0.0000 2\ndestination 0.0593 0.1628 0.0870 43\ndestroyer 0.0000 0.0000 0.0000 11\ndetainee 0.0435 0.2500 0.0741 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.0241 0.1176 0.0400 34\nexecutioner 0.0500 0.3333 0.0870 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.0252 0.0948 0.0398 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0556 0.2500 0.0909 4\ninjurer 0.0165 0.0732 0.0269 41\ninspectedentity 0.0000 0.0000 0.0000 6\ninspector 0.0000 0.0000 0.0000 7\ninstrument 0.0204 0.0370 0.0263 81\ninvestigator 0.0667 0.2000 0.1000 10\njailer 0.0370 0.2000 0.0625 5\njudgecourt 0.0390 0.2143 0.0659 14\nkiller 0.0076 0.0370 0.0126 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0476 0.1818 0.0755 11\nmoney 0.0000 0.0000 0.0000 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0294 0.1111 0.0465 9\norigin 0.0672 0.2000 0.1006 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.0287 0.1250 0.0467 120\npassenger 0.0438 0.2000 0.0719 30\nplace 0.0490 0.1203 0.0696 374\nplaceofemployment 0.0172 0.0370 0.0235 27\npreventer 0.0181 0.0769 0.0293 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.0272 0.1106 0.0437 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0233 0.0833 0.0364 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.0133 0.0533 0.0213 75\nterritoryorfacility 0.0000 0.0000 0.0000 5\ntransporter 0.0297 0.1429 0.0491 49\nvehicle 0.0556 0.2857 0.0930 7\nvictim 0.0160 0.0727 0.0262 110\nviolator 0.2500 0.5000 0.3333 2\nvoter 0.0000 0.0000 0.0000 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.0262 0.0999 0.0415 2182\nmacro avg 0.0272 0.0990 0.0417 2182", "eval_event_argument_relaxed_micro_precision": 0.1348652550529355, "eval_event_argument_relaxed_micro_recall": 0.5137488542621448, "eval_event_argument_relaxed_micro_f1": 0.21364589289117586, "eval_event_argument_relaxed_macro_precision": 0.11909997516125186, "eval_event_argument_relaxed_macro_recall": 0.4416186924407747, "eval_event_argument_relaxed_macro_f1": 0.18309216119550975, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0843 0.3365 0.1349 104\nartifactmoney 0.0455 0.1667 0.0714 6\nattacker 0.1308 0.5250 0.2095 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.1307 0.5904 0.2140 83\ncandidate 0.1190 0.5556 0.1961 9\ncommunicator 0.1153 0.7194 0.1988 139\ncrashobject 0.2000 0.5000 0.2857 2\ncrime 0.1786 0.2564 0.2105 39\ndamager 0.0870 0.2857 0.1333 7\ndamagerdestroyer 0.1250 0.5000 0.2000 8\ndeceased 0.1111 0.5000 0.1818 2\ndefendant 0.1232 0.5682 0.2024 44\ndemonstrator 0.1176 1.0000 0.2105 2\ndestination 0.1695 0.4651 0.2484 43\ndestroyer 0.1429 0.7273 0.2388 11\ndetainee 0.1304 0.7500 0.2222 8\ndriverpassenger 0.1111 0.5000 0.1818 2\nemployee 0.1145 0.5588 0.1900 34\nexecutioner 0.1500 1.0000 0.2609 3\nextraditer 0.2500 0.5000 0.3333 2\nfireexplosionobject 0.1000 0.3333 0.1538 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.1213 0.4569 0.1917 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0556 0.2500 0.0909 4\ninjurer 0.0989 0.4390 0.1614 41\ninspectedentity 0.0556 0.1667 0.0833 6\ninspector 0.1154 0.4286 0.1818 7\ninstrument 0.1973 0.3580 0.2544 81\ninvestigator 0.2000 0.6000 0.3000 10\njailer 0.1481 0.8000 0.2500 5\njudgecourt 0.0779 0.4286 0.1319 14\nkiller 0.1288 0.6296 0.2138 27\nlaw 0.0909 0.2500 0.1333 4\nmanufacturer 0.1667 0.6364 0.2642 11\nmoney 0.0354 0.1379 0.0563 29\nmonitor 0.1667 0.3333 0.2222 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0882 0.3333 0.1395 9\norigin 0.1791 0.5333 0.2682 45\notherparticipant 0.2500 0.5000 0.3333 2\nparticipant 0.1533 0.6667 0.2492 120\npassenger 0.1387 0.6333 0.2275 30\nplace 0.2307 0.5668 0.3279 374\nplaceofemployment 0.0690 0.1481 0.0941 27\npreventer 0.1538 0.6538 0.2491 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.1164 0.4735 0.1869 226\nresult 0.1429 0.5000 0.2222 2\nretreater 0.1818 0.6667 0.2857 3\nspy 0.1163 0.4167 0.1818 12\nsurrenderer 0.0909 0.2000 0.1250 5\ntarget 0.1296 0.5200 0.2074 75\nterritoryorfacility 0.0769 0.2000 0.1111 5\ntransporter 0.1144 0.5510 0.1895 49\nvehicle 0.1111 0.5714 0.1860 7\nvictim 0.1240 0.5636 0.2033 110\nviolator 0.2500 0.5000 0.3333 2\nvoter 0.1143 0.5000 0.1860 8\nyielder 0.1579 0.4286 0.2308 7\n----------------------------------------------------------------------------------\nmicro avg 0.1349 0.5137 0.2136 2182\nmacro avg 0.1191 0.4416 0.1831 2182", "eval_event_strict_micro_precision": 0.16657376439985136, "eval_event_strict_micro_recall": 0.45118268746854556, "eval_event_strict_micro_f1": 0.24331659655312798, "eval_event_strict_macro_precision": 0.6149741409131861, "eval_event_strict_macro_recall": 0.7355404267397776, "eval_event_strict_macro_f1": 0.6477981939836325, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0120 0.0481 0.0193 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.0218 0.0875 0.0349 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0267 0.1205 0.0437 83\narg:candidate 0.0000 0.0000 0.0000 9\narg:communicator 0.0208 0.1295 0.0358 139\narg:crashobject 0.2000 0.5000 0.2857 2\narg:crime 0.0000 0.0000 0.0000 39\narg:damager 0.0870 0.2857 0.1333 7\narg:damagerdestroyer 0.0312 0.1250 0.0500 8\narg:deceased 0.1111 0.5000 0.1818 2\narg:defendant 0.0148 0.0682 0.0243 44\narg:demonstrator 0.0000 0.0000 0.0000 2\narg:destination 0.0593 0.1628 0.0870 43\narg:destroyer 0.0000 0.0000 0.0000 11\narg:detainee 0.0435 0.2500 0.0741 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.0241 0.1176 0.0400 34\narg:executioner 0.0500 0.3333 0.0870 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.0252 0.0948 0.0398 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0556 0.2500 0.0909 4\narg:injurer 0.0165 0.0732 0.0269 41\narg:inspectedentity 0.0000 0.0000 0.0000 6\narg:inspector 0.0000 0.0000 0.0000 7\narg:instrument 0.0204 0.0370 0.0263 81\narg:investigator 0.0667 0.2000 0.1000 10\narg:jailer 0.0370 0.2000 0.0625 5\narg:judgecourt 0.0390 0.2143 0.0659 14\narg:killer 0.0076 0.0370 0.0126 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0476 0.1818 0.0755 11\narg:money 0.0000 0.0000 0.0000 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0294 0.1111 0.0465 9\narg:origin 0.0672 0.2000 0.1006 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.0287 0.1250 0.0467 120\narg:passenger 0.0438 0.2000 0.0719 30\narg:place 0.0490 0.1203 0.0696 374\narg:placeofemployment 0.0172 0.0370 0.0235 27\narg:preventer 0.0181 0.0769 0.0293 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.0272 0.1106 0.0437 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0233 0.0833 0.0364 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.0133 0.0533 0.0213 75\narg:territoryorfacility 0.0000 0.0000 0.0000 5\narg:transporter 0.0297 0.1429 0.0491 49\narg:vehicle 0.0556 0.2857 0.0930 7\narg:victim 0.0160 0.0727 0.0262 110\narg:violator 0.2500 0.5000 0.3333 2\narg:voter 0.0000 0.0000 0.0000 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 0.7500 0.8571 0.8000 7\ntrigger:artifactexistence.damagedestro.. 0.5455 0.9231 0.6857 13\ntrigger:artifactexistence.damagedestro.. 0.5833 0.8750 0.7000 8\ntrigger:conflict.attack.airstrikemissi.. 0.2857 1.0000 0.4444 4\ntrigger:conflict.attack.biologicalchem.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.bombing 0.3333 1.0000 0.5000 7\ntrigger:conflict.attack.firearmattack 0.4000 1.0000 0.5714 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.3600 0.7714 0.4909 35\ntrigger:conflict.attack.selfdirectedba.. 0.4219 0.6585 0.5143 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3636 0.8000 0.5000 5\ntrigger:conflict.demonstrate.marchprot.. 0.4000 1.0000 0.5714 2\ntrigger:conflict.yield.n/a 0.2941 0.7143 0.4167 7\ntrigger:conflict.yield.retreat 0.2857 0.6667 0.4000 3\ntrigger:conflict.yield.surrender 0.2778 1.0000 0.4348 5\ntrigger:contact.collaborate.correspond.. 0.4444 0.5714 0.5000 7\ntrigger:contact.collaborate.n/a 0.4167 0.7143 0.5263 7\ntrigger:contact.commandorder.broadcast 0.5000 1.0000 0.6667 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.2500 0.2500 0.2500 4\ntrigger:contact.commitmentpromiseexpre.. 0.5556 1.0000 0.7143 5\ntrigger:contact.commitmentpromiseexpre.. 0.4444 0.6667 0.5333 6\ntrigger:contact.commitmentpromiseexpre.. 0.4000 0.8333 0.5405 12\ntrigger:contact.commitmentpromiseexpre.. 0.6667 1.0000 0.8000 2\ntrigger:contact.discussion.corresponde.. 0.4091 0.8182 0.5455 11\ntrigger:contact.discussion.meet 0.4375 0.8235 0.5714 17\ntrigger:contact.discussion.n/a 0.3750 0.7500 0.5000 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.5000 1.0000 0.6667 6\ntrigger:contact.mediastatement.n/a 0.4000 0.6667 0.5000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.5000 0.8750 0.6364 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.3889 0.8750 0.5385 8\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 9\ntrigger:contact.prevarication.meet 0.4545 1.0000 0.6250 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.5556 0.8333 0.6667 6\ntrigger:contact.publicstatementinperso.. 0.8000 0.8000 0.8000 5\ntrigger:contact.requestadvise.broadcast 0.4000 0.8333 0.5405 12\ntrigger:contact.requestadvise.correspo.. 0.4286 0.6000 0.5000 10\ntrigger:contact.requestadvise.meet 0.5455 0.8571 0.6667 7\ntrigger:contact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.broadcast 0.4444 1.0000 0.6154 4\ntrigger:contact.threatencoerce.corresp.. 0.4286 0.6000 0.5000 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ntrigger:disaster.accidentcrash.acciden.. 0.4000 0.6667 0.5000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.4286 1.0000 0.6000 3\ntrigger:government.agreements.acceptag.. 0.4545 0.8333 0.5882 6\ntrigger:government.agreements.n/a 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.6000 0.8571 0.7059 7\ntrigger:government.spy.spy 0.5833 0.5833 0.5833 12\ntrigger:government.vote.castvote 0.2857 0.6667 0.4000 3\ntrigger:government.vote.n/a 0.4444 1.0000 0.6154 4\ntrigger:government.vote.violationsprev.. 0.5000 0.5000 0.5000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5000 0.6667 0.5714 6\ntrigger:inspection.sensoryobserve.moni.. 0.5000 0.6667 0.5714 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5714 1.0000 0.7273 4\ntrigger:justice.arrestjaildetain.arres.. 0.3333 0.3750 0.3529 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.5000 0.3333 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.3182 0.8750 0.4667 8\ntrigger:justice.investigate.investigat.. 0.3810 1.0000 0.5517 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.5000 1.0000 0.6667 8\ntrigger:justice.judicialconsequences.e.. 0.7143 1.0000 0.8333 5\ntrigger:justice.judicialconsequences.e.. 0.3333 0.5000 0.4000 2\ntrigger:justice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\ntrigger:life.die.deathcausedbyviolente.. 0.3804 0.8140 0.5185 43\ntrigger:life.die.n/a 0.4000 0.8000 0.5333 20\ntrigger:life.die.nonviolentdeath 0.4375 0.7000 0.5385 10\ntrigger:life.injure.illnessdegradation.. 0.5385 0.8750 0.6667 8\ntrigger:life.injure.illnessdegradation.. 0.5000 0.6000 0.5455 5\ntrigger:life.injure.injurycausedbyviol.. 0.3478 0.9231 0.5053 26\ntrigger:life.injure.n/a 0.4872 0.7600 0.5938 25\ntrigger:manufacture.artifact.build 0.6000 1.0000 0.7500 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.3750 0.7500 0.5000 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.hide 0.2500 0.5000 0.3333 2\ntrigger:movement.transportartifact.n/a 0.7273 1.0000 0.8421 8\ntrigger:movement.transportartifact.non.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.pre.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportartifact.pre.. 0.1818 0.4000 0.2500 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 0.5000 0.6000 0.5455 5\ntrigger:movement.transportartifact.smu.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.4286 0.6667 0.5217 9\ntrigger:movement.transportperson.grant.. 0.5000 1.0000 0.6667 4\ntrigger:movement.transportperson.n/a 0.5714 0.8889 0.6957 9\ntrigger:movement.transportperson.preve.. 0.3750 0.6000 0.4615 5\ntrigger:movement.transportperson.preve.. 0.6667 0.8889 0.7619 9\ntrigger:movement.transportperson.selfm.. 0.4615 0.7500 0.5714 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.6667 1.0000 0.8000 2\ntrigger:personnel.endposition.firingla.. 0.3846 0.8333 0.5263 12\ntrigger:personnel.endposition.n/a 0.5000 0.8750 0.6364 8\ntrigger:personnel.endposition.quitretire 0.4000 0.6667 0.5000 3\ntrigger:personnel.startposition.hiring 0.6154 0.8000 0.6957 10\ntrigger:personnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntrigger:transaction.transaction.embarg.. 0.5385 0.8750 0.6667 16\ntrigger:transaction.transaction.giftgr.. 0.5000 0.8333 0.6250 6\ntrigger:transaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntrigger:transaction.transaction.transf.. 0.3000 0.4286 0.3529 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.5294 1.0000 0.6923 9\ntrigger:transaction.transfermoney.gift.. 0.5833 0.8750 0.7000 8\ntrigger:transaction.transfermoney.n/a 0.5000 0.8824 0.6383 17\ntrigger:transaction.transfermoney.payf.. 0.3333 0.6923 0.4500 13\ntrigger:transaction.transfermoney.purc.. 0.5000 1.0000 0.6667 14\ntrigger:transaction.transferownership... 0.5714 1.0000 0.7273 8\ntrigger:transaction.transferownership... 0.5600 1.0000 0.7179 14\ntrigger:transaction.transferownership... 0.5455 0.8571 0.6667 7\ntrigger:transaction.transferownership... 0.6111 0.7857 0.6875 14\ntrigger:transaction.transferownership... 0.5000 1.0000 0.6667 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8571 0.9231 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9429 0.9706 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9512 0.9750 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.7143 0.8333 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8333 0.9091 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.9167 0.9565 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.8182 0.9000 11\ntype:contact.discussion.meet 1.0000 0.9412 0.9697 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.8000 0.8889 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 0.8333 0.9091 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.8571 0.9231 7\ntype:government.spy.spy 1.0000 0.6667 0.8000 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.8333 0.9091 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 0.6667 0.8000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.8333 0.9091 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9070 0.9512 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 0.8000 0.8889 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.8000 0.8889 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.8800 0.9362 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 0.8750 0.9333 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 0.8000 0.8889 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 0.9375 0.9677 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.8750 0.9333 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.8571 0.9231 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.1666 0.4512 0.2433 3974\nmacro avg 0.6150 0.7355 0.6478 3974", "eval_event_relaxed_micro_precision": 0.2508361204013378, "eval_event_relaxed_micro_recall": 0.6794162053346754, "eval_event_relaxed_micro_f1": 0.3663997828742028, "eval_event_relaxed_macro_precision": 0.6348152244668134, "eval_event_relaxed_macro_recall": 0.8040036632895955, "eval_event_relaxed_macro_f1": 0.6772854834270274, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0843 0.3365 0.1349 104\narg:artifactmoney 0.0455 0.1667 0.0714 6\narg:attacker 0.1308 0.5250 0.2095 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.1307 0.5904 0.2140 83\narg:candidate 0.1190 0.5556 0.1961 9\narg:communicator 0.1153 0.7194 0.1988 139\narg:crashobject 0.2000 0.5000 0.2857 2\narg:crime 0.1786 0.2564 0.2105 39\narg:damager 0.0870 0.2857 0.1333 7\narg:damagerdestroyer 0.1250 0.5000 0.2000 8\narg:deceased 0.1111 0.5000 0.1818 2\narg:defendant 0.1232 0.5682 0.2024 44\narg:demonstrator 0.1176 1.0000 0.2105 2\narg:destination 0.1695 0.4651 0.2484 43\narg:destroyer 0.1429 0.7273 0.2388 11\narg:detainee 0.1304 0.7500 0.2222 8\narg:driverpassenger 0.1111 0.5000 0.1818 2\narg:employee 0.1145 0.5588 0.1900 34\narg:executioner 0.1500 1.0000 0.2609 3\narg:extraditer 0.2500 0.5000 0.3333 2\narg:fireexplosionobject 0.1000 0.3333 0.1538 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.1213 0.4569 0.1917 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0556 0.2500 0.0909 4\narg:injurer 0.0989 0.4390 0.1614 41\narg:inspectedentity 0.0556 0.1667 0.0833 6\narg:inspector 0.1154 0.4286 0.1818 7\narg:instrument 0.1973 0.3580 0.2544 81\narg:investigator 0.2000 0.6000 0.3000 10\narg:jailer 0.1481 0.8000 0.2500 5\narg:judgecourt 0.0779 0.4286 0.1319 14\narg:killer 0.1288 0.6296 0.2138 27\narg:law 0.0909 0.2500 0.1333 4\narg:manufacturer 0.1667 0.6364 0.2642 11\narg:money 0.0354 0.1379 0.0563 29\narg:monitor 0.1667 0.3333 0.2222 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0882 0.3333 0.1395 9\narg:origin 0.1791 0.5333 0.2682 45\narg:otherparticipant 0.2500 0.5000 0.3333 2\narg:participant 0.1533 0.6667 0.2492 120\narg:passenger 0.1387 0.6333 0.2275 30\narg:place 0.2307 0.5668 0.3279 374\narg:placeofemployment 0.0690 0.1481 0.0941 27\narg:preventer 0.1538 0.6538 0.2491 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.1164 0.4735 0.1869 226\narg:result 0.1429 0.5000 0.2222 2\narg:retreater 0.1818 0.6667 0.2857 3\narg:spy 0.1163 0.4167 0.1818 12\narg:surrenderer 0.0909 0.2000 0.1250 5\narg:target 0.1296 0.5200 0.2074 75\narg:territoryorfacility 0.0769 0.2000 0.1111 5\narg:transporter 0.1144 0.5510 0.1895 49\narg:vehicle 0.1111 0.5714 0.1860 7\narg:victim 0.1240 0.5636 0.2033 110\narg:violator 0.2500 0.5000 0.3333 2\narg:voter 0.1143 0.5000 0.1860 8\narg:yielder 0.1579 0.4286 0.2308 7\ntrigger:artifactexistence.damagedestro.. 0.7500 0.8571 0.8000 7\ntrigger:artifactexistence.damagedestro.. 0.5455 0.9231 0.6857 13\ntrigger:artifactexistence.damagedestro.. 0.5833 0.8750 0.7000 8\ntrigger:conflict.attack.airstrikemissi.. 0.2857 1.0000 0.4444 4\ntrigger:conflict.attack.biologicalchem.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.bombing 0.3333 1.0000 0.5000 7\ntrigger:conflict.attack.firearmattack 0.4000 1.0000 0.5714 2\ntrigger:conflict.attack.invade 0.2500 1.0000 0.4000 1\ntrigger:conflict.attack.n/a 0.3600 0.7714 0.4909 35\ntrigger:conflict.attack.selfdirectedba.. 0.4219 0.6585 0.5143 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 0.5000 1.0000 0.6667 1\ntrigger:conflict.attack.stealrobhijack 0.3636 0.8000 0.5000 5\ntrigger:conflict.demonstrate.marchprot.. 0.4000 1.0000 0.5714 2\ntrigger:conflict.yield.n/a 0.2941 0.7143 0.4167 7\ntrigger:conflict.yield.retreat 0.2857 0.6667 0.4000 3\ntrigger:conflict.yield.surrender 0.2778 1.0000 0.4348 5\ntrigger:contact.collaborate.correspond.. 0.4444 0.5714 0.5000 7\ntrigger:contact.collaborate.n/a 0.4167 0.7143 0.5263 7\ntrigger:contact.commandorder.broadcast 0.5000 1.0000 0.6667 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.5000 1.0000 0.6667 3\ntrigger:contact.commandorder.n/a 0.2500 0.2500 0.2500 4\ntrigger:contact.commitmentpromiseexpre.. 0.5556 1.0000 0.7143 5\ntrigger:contact.commitmentpromiseexpre.. 0.4444 0.6667 0.5333 6\ntrigger:contact.commitmentpromiseexpre.. 0.4000 0.8333 0.5405 12\ntrigger:contact.commitmentpromiseexpre.. 0.6667 1.0000 0.8000 2\ntrigger:contact.discussion.corresponde.. 0.4091 0.8182 0.5455 11\ntrigger:contact.discussion.meet 0.4375 0.8235 0.5714 17\ntrigger:contact.discussion.n/a 0.3750 0.7500 0.5000 4\ntrigger:contact.funeralvigil.meet 0.5000 1.0000 0.6667 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.5000 1.0000 0.6667 6\ntrigger:contact.mediastatement.n/a 0.4000 0.6667 0.5000 3\ntrigger:contact.negotiate.correspondence 0.4000 1.0000 0.5714 2\ntrigger:contact.negotiate.meet 0.5000 0.8750 0.6364 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.3889 0.8750 0.5385 8\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 9\ntrigger:contact.prevarication.meet 0.4545 1.0000 0.6250 10\ntrigger:contact.prevarication.n/a 0.8000 1.0000 0.8889 4\ntrigger:contact.publicstatementinperso.. 0.5556 0.8333 0.6667 6\ntrigger:contact.publicstatementinperso.. 0.8000 0.8000 0.8000 5\ntrigger:contact.requestadvise.broadcast 0.4000 0.8333 0.5405 12\ntrigger:contact.requestadvise.correspo.. 0.4286 0.6000 0.5000 10\ntrigger:contact.requestadvise.meet 0.5455 0.8571 0.6667 7\ntrigger:contact.requestadvise.n/a 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.broadcast 0.4444 1.0000 0.6154 4\ntrigger:contact.threatencoerce.corresp.. 0.5714 0.8000 0.6667 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.7143 0.8333 0.7692 6\ntrigger:disaster.accidentcrash.acciden.. 0.4000 0.6667 0.5000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.4286 1.0000 0.6000 3\ntrigger:government.agreements.acceptag.. 0.4545 0.8333 0.5882 6\ntrigger:government.agreements.n/a 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.violatea.. 1.0000 1.0000 1.0000 2\ntrigger:government.formation.n/a 0.5000 1.0000 0.6667 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.6000 0.8571 0.7059 7\ntrigger:government.spy.spy 0.5833 0.5833 0.5833 12\ntrigger:government.vote.castvote 0.2857 0.6667 0.4000 3\ntrigger:government.vote.n/a 0.4444 1.0000 0.6154 4\ntrigger:government.vote.violationsprev.. 1.0000 1.0000 1.0000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5000 0.6667 0.5714 6\ntrigger:inspection.sensoryobserve.moni.. 0.5000 0.6667 0.5714 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5714 1.0000 0.7273 4\ntrigger:justice.arrestjaildetain.arres.. 0.3333 0.3750 0.3529 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.5000 0.3333 6\ntrigger:justice.initiatejudicialproces.. 0.3636 1.0000 0.5333 4\ntrigger:justice.initiatejudicialproces.. 0.3182 0.8750 0.4667 8\ntrigger:justice.investigate.investigat.. 0.3810 1.0000 0.5517 8\ntrigger:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntrigger:justice.judicialconsequences.c.. 0.5000 1.0000 0.6667 8\ntrigger:justice.judicialconsequences.e.. 0.7143 1.0000 0.8333 5\ntrigger:justice.judicialconsequences.e.. 0.3333 0.5000 0.4000 2\ntrigger:justice.judicialconsequences.n/a 0.7500 1.0000 0.8571 6\ntrigger:life.die.deathcausedbyviolente.. 0.3913 0.8372 0.5333 43\ntrigger:life.die.n/a 0.4000 0.8000 0.5333 20\ntrigger:life.die.nonviolentdeath 0.4375 0.7000 0.5385 10\ntrigger:life.injure.illnessdegradation.. 0.5385 0.8750 0.6667 8\ntrigger:life.injure.illnessdegradation.. 0.5000 0.6000 0.5455 5\ntrigger:life.injure.injurycausedbyviol.. 0.3478 0.9231 0.5053 26\ntrigger:life.injure.n/a 0.4872 0.7600 0.5938 25\ntrigger:manufacture.artifact.build 0.6000 1.0000 0.7500 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.3750 0.7500 0.5000 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.gra.. 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.hide 0.2500 0.5000 0.3333 2\ntrigger:movement.transportartifact.n/a 0.7273 1.0000 0.8421 8\ntrigger:movement.transportartifact.non.. 0.5000 1.0000 0.6667 1\ntrigger:movement.transportartifact.pre.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportartifact.pre.. 0.1818 0.4000 0.2500 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 0.5000 0.6000 0.5455 5\ntrigger:movement.transportartifact.smu.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.4286 0.6667 0.5217 9\ntrigger:movement.transportperson.grant.. 0.5000 1.0000 0.6667 4\ntrigger:movement.transportperson.n/a 0.5714 0.8889 0.6957 9\ntrigger:movement.transportperson.preve.. 0.3750 0.6000 0.4615 5\ntrigger:movement.transportperson.preve.. 0.6667 0.8889 0.7619 9\ntrigger:movement.transportperson.selfm.. 0.4615 0.7500 0.5714 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 0.5000 1.0000 0.6667 3\ntrigger:personnel.elect.winelection 0.6667 1.0000 0.8000 2\ntrigger:personnel.endposition.firingla.. 0.3846 0.8333 0.5263 12\ntrigger:personnel.endposition.n/a 0.5000 0.8750 0.6364 8\ntrigger:personnel.endposition.quitretire 0.4000 0.6667 0.5000 3\ntrigger:personnel.startposition.hiring 0.6154 0.8000 0.6957 10\ntrigger:personnel.startposition.n/a 0.6000 0.7500 0.6667 4\ntrigger:transaction.transaction.embarg.. 0.5385 0.8750 0.6667 16\ntrigger:transaction.transaction.giftgr.. 0.5000 0.8333 0.6250 6\ntrigger:transaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntrigger:transaction.transaction.transf.. 0.3000 0.4286 0.3529 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.5294 1.0000 0.6923 9\ntrigger:transaction.transfermoney.gift.. 0.5833 0.8750 0.7000 8\ntrigger:transaction.transfermoney.n/a 0.5000 0.8824 0.6383 17\ntrigger:transaction.transfermoney.payf.. 0.3704 0.7692 0.5000 13\ntrigger:transaction.transfermoney.purc.. 0.5000 1.0000 0.6667 14\ntrigger:transaction.transferownership... 0.5714 1.0000 0.7273 8\ntrigger:transaction.transferownership... 0.5600 1.0000 0.7179 14\ntrigger:transaction.transferownership... 0.5455 0.8571 0.6667 7\ntrigger:transaction.transferownership... 0.6111 0.7857 0.6875 14\ntrigger:transaction.transferownership... 0.5000 1.0000 0.6667 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8571 0.9231 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.9429 0.9706 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9512 0.9750 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.7143 0.8333 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8333 0.9091 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.9167 0.9565 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.discussion.correspondence 1.0000 0.8182 0.9000 11\ntype:contact.discussion.meet 1.0000 0.9412 0.9697 17\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 1.0000 1.0000 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 1.0000 1.0000 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 10\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 1.0000 1.0000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 5\ntype:contact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.8000 0.8889 10\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 7\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.8333 0.9091 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 0.8333 0.9091 6\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 2\ntype:government.formation.n/a 1.0000 1.0000 1.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.8571 0.9231 7\ntype:government.spy.spy 1.0000 0.6667 0.8000 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 1.0000 1.0000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.8333 0.9091 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 0.6667 0.8000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.8333 0.9091 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.n/a 1.0000 0.5000 0.6667 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 1.0000 1.0000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9070 0.9512 43\ntype:life.die.n/a 1.0000 1.0000 1.0000 20\ntype:life.die.nonviolentdeath 1.0000 0.8000 0.8889 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.8000 0.8889 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 1.0000 1.0000 26\ntype:life.injure.n/a 1.0000 0.8800 0.9362 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 8\ntype:movement.transportartifact.nonvio.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 9\ntype:movement.transportperson.selfmotion 1.0000 0.8750 0.9333 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 3\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 1.0000 1.0000 12\ntype:personnel.endposition.n/a 1.0000 0.8750 0.9333 8\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 3\ntype:personnel.startposition.hiring 1.0000 0.8000 0.8889 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 0.9375 0.9677 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.8750 0.9333 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 1.0000 1.0000 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.8571 0.9231 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.2508 0.6794 0.3664 3974\nmacro avg 0.6348 0.8040 0.6773 3974", "eval_event_trigger_error_COR": 739, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 2, "eval_event_trigger_error_BEL": 2, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 873, "eval_event_trigger_error_FN": 153, "eval_event_trigger_fair_micro_precision": 0.45786864931846344, "eval_event_trigger_fair_micro_recall": 0.8266219239373602, "eval_event_trigger_fair_micro_f1": 0.5893141945773526, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 739\nLE 0\nBES 2\nBEL 2\nBEO 0\nLBE 0\nFP 873\nFN 153\n-----------------\nfair P / R / F1: 0.4579 / 0.8266 / 0.5893", "eval_event_argument_error_COR": 713, "eval_event_argument_error_LE": 50, "eval_event_argument_error_BES": 295, "eval_event_argument_error_BEL": 68, "eval_event_argument_error_BEO": 36, "eval_event_argument_error_LBE": 74, "eval_event_argument_error_FP": 7076, "eval_event_argument_error_FN": 946, "eval_event_argument_fair_micro_precision": 0.08856592758213776, "eval_event_argument_fair_micro_recall": 0.3712574850299401, "eval_event_argument_fair_micro_f1": 0.14301474275398657, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 713\nLE 50\nBES 295\nBEL 68\nBEO 36\nLBE 74\nFP 7076\nFN 946\n-----------------\nfair P / R / F1: 0.0886 / 0.3713 / 0.1430\n\nlabel confusions (gold -> pred):\n recipient -> communicator: 11\n placeofemployment -> employee: 9\n place -> communicator: 8\n crime -> defendant: 7\n target -> place: 6\n victim -> place: 5\n attacker -> place: 4\n giver -> place: 4\n instrument -> attacker: 4\n place -> participant: 4\n place -> artifact: 3\n place -> beneficiary: 3\n place -> killer: 3\n attacker -> target: 2\n crime -> judgecourt: 2\n defendant -> crime: 2\n destination -> origin: 2\n destination -> transporter: 2\n giver -> beneficiary: 2\n judgecourt -> defendant: 2\n judgecourt -> place: 2\n killer -> place: 2\n place -> inspector: 2\n place -> victim: 2\n prosecutor -> place: 2\n target -> attacker: 2\n artifact -> damager: 1\n artifact -> damagerdestroyer: 1\n artifact -> destination: 1\n artifact -> instrument: 1\n damager -> place: 1\n deceased -> participant: 1\n defendant -> origin: 1\n employee -> place: 1\n employee -> placeofemployment: 1\n granter -> origin: 1\n instrument -> victim: 1\n killer -> instrument: 1\n observedentity -> place: 1\n participant -> place: 1\n place -> attacker: 1\n place -> crime: 1\n place -> injurer: 1\n place -> instrument: 1\n preventer -> place: 1\n prosecutor -> defendant: 1\n recipient -> beneficiary: 1\n recipient -> place: 1\n surrenderer -> place: 1\n transporter -> artifact: 1\n transporter -> origin: 1\n victim -> injurer: 1\n yielder -> place: 1" }, "0.7": { "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.8080357142857143, "eval_event_type_strict_micro_f1": 0.8938271604938272, "eval_event_type_strict_macro_precision": 0.9615384615384616, "eval_event_type_strict_macro_recall": 0.8047033860049645, "eval_event_type_strict_macro_f1": 0.8664386377280481, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 1.0000 0.8462 0.9167 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.6571 0.7931 35\nconflict.attack.selfdirectedbattle 1.0000 0.7073 0.8286 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 0.7143 0.8333 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.7143 0.8333 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 0.2500 0.4000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8000 0.8889 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.3333 0.5000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.7500 0.8571 12\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5000 0.6667 2\ncontact.discussion.correspondence 1.0000 0.6364 0.7778 11\ncontact.discussion.meet 1.0000 0.8235 0.9032 17\ncontact.discussion.n/a 1.0000 0.7500 0.8571 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.7500 0.8571 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 0.9000 0.9474 10\ncontact.prevarication.n/a 1.0000 0.7500 0.8571 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.6667 0.8000 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ncontact.requestadvise.correspondence 1.0000 0.6000 0.7500 10\ncontact.requestadvise.meet 1.0000 0.8571 0.9231 7\ncontact.requestadvise.n/a 1.0000 0.8333 0.9091 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 0.8000 0.8889 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.6667 0.8000 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 0.6667 0.8000 6\ngovernment.agreements.n/a 1.0000 0.6667 0.8000 3\ngovernment.agreements.violateagreement 1.0000 0.5000 0.6667 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.7143 0.8333 7\ngovernment.spy.spy 1.0000 0.5833 0.7368 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 0.7500 0.8571 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.8333 0.9091 6\ninspection.sensoryobserve.monitorelect.. 1.0000 0.6667 0.8000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 0.6250 0.7692 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.6667 0.8000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 0.8750 0.9333 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 0.8000 0.8889 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 0.8333 0.9091 6\nlife.die.deathcausedbyviolentevents 1.0000 0.8372 0.9114 43\nlife.die.n/a 1.0000 0.8500 0.9189 20\nlife.die.nonviolentdeath 1.0000 0.8000 0.8889 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.8846 0.9388 26\nlife.injure.n/a 1.0000 0.8000 0.8889 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 0.7500 0.8571 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 0.8750 0.9333 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 0.8000 0.8889 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 0.6667 0.8000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 0.8000 0.8889 5\nmovement.transportperson.preventexit 1.0000 0.6667 0.8000 9\nmovement.transportperson.selfmotion 1.0000 0.6250 0.7692 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 0.6667 0.8000 3\npersonnel.elect.winelection 1.0000 0.5000 0.6667 2\npersonnel.endposition.firinglayoff 1.0000 0.9167 0.9565 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.6667 0.8000 3\npersonnel.startposition.hiring 1.0000 0.6000 0.7500 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 0.8750 0.9333 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.5000 0.6667 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 0.9231 0.9600 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.7143 0.8333 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.8080 0.8938 896\nmacro avg 0.9615 0.8047 0.8664 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.8080357142857143, "eval_event_type_relaxed_micro_f1": 0.8938271604938272, "eval_event_type_relaxed_macro_precision": 0.9615384615384616, "eval_event_type_relaxed_macro_recall": 0.8047033860049645, "eval_event_type_relaxed_macro_f1": 0.8664386377280481, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 1.0000 0.8462 0.9167 13\nartifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 3\nconflict.attack.bombing 1.0000 1.0000 1.0000 7\nconflict.attack.firearmattack 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 1\nconflict.attack.n/a 1.0000 0.6571 0.7931 35\nconflict.attack.selfdirectedbattle 1.0000 0.7073 0.8286 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 0.7143 0.8333 7\nconflict.yield.retreat 1.0000 1.0000 1.0000 3\nconflict.yield.surrender 1.0000 1.0000 1.0000 5\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.n/a 1.0000 0.7143 0.8333 7\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 1.0000 1.0000 3\ncontact.commandorder.n/a 1.0000 0.2500 0.4000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8000 0.8889 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.3333 0.5000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.7500 0.8571 12\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5000 0.6667 2\ncontact.discussion.correspondence 1.0000 0.6364 0.7778 11\ncontact.discussion.meet 1.0000 0.8235 0.9032 17\ncontact.discussion.n/a 1.0000 0.7500 0.8571 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ncontact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.7500 0.8571 8\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 9\ncontact.prevarication.meet 1.0000 0.9000 0.9474 10\ncontact.prevarication.n/a 1.0000 0.7500 0.8571 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.6667 0.8000 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ncontact.requestadvise.correspondence 1.0000 0.6000 0.7500 10\ncontact.requestadvise.meet 1.0000 0.8571 0.9231 7\ncontact.requestadvise.n/a 1.0000 0.8333 0.9091 6\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.correspondence 1.0000 0.8000 0.8889 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 1.0000 0.6667 0.8000 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 3\ngovernment.agreements.acceptagreementc.. 1.0000 0.6667 0.8000 6\ngovernment.agreements.n/a 1.0000 0.6667 0.8000 3\ngovernment.agreements.violateagreement 1.0000 0.5000 0.6667 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.7143 0.8333 7\ngovernment.spy.spy 1.0000 0.5833 0.7368 12\ngovernment.vote.castvote 1.0000 1.0000 1.0000 3\ngovernment.vote.n/a 1.0000 0.7500 0.8571 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.8333 0.9091 6\ninspection.sensoryobserve.monitorelect.. 1.0000 0.6667 0.8000 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 0.6250 0.7692 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.6667 0.8000 6\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 8\njustice.investigate.investigatecrime 1.0000 0.8750 0.9333 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 1.0000 1.0000 8\njustice.judicialconsequences.execute 1.0000 0.8000 0.8889 5\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 2\njustice.judicialconsequences.n/a 1.0000 0.8333 0.9091 6\nlife.die.deathcausedbyviolentevents 1.0000 0.8372 0.9114 43\nlife.die.n/a 1.0000 0.8500 0.9189 20\nlife.die.nonviolentdeath 1.0000 0.8000 0.8889 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.8750 0.9333 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.8846 0.9388 26\nlife.injure.n/a 1.0000 0.8000 0.8889 25\nmanufacture.artifact.build 1.0000 1.0000 1.0000 3\nmanufacture.artifact.createintellectua.. 1.0000 1.0000 1.0000 1\nmanufacture.artifact.createmanufacture 1.0000 0.7500 0.8571 4\nmanufacture.artifact.n/a 1.0000 0.8333 0.9091 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 1.0000 1.0000 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 2\nmovement.transportartifact.n/a 1.0000 0.8750 0.9333 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 1.0000 1.0000 3\nmovement.transportartifact.preventexit 1.0000 0.8000 0.8889 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.8000 0.8889 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 0.6667 0.8000 9\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 4\nmovement.transportperson.n/a 1.0000 0.8889 0.9412 9\nmovement.transportperson.prevententry 1.0000 0.8000 0.8889 5\nmovement.transportperson.preventexit 1.0000 0.6667 0.8000 9\nmovement.transportperson.selfmotion 1.0000 0.6250 0.7692 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 1.0000 0.6667 0.8000 3\npersonnel.elect.winelection 1.0000 0.5000 0.6667 2\npersonnel.endposition.firinglayoff 1.0000 0.9167 0.9565 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.6667 0.8000 3\npersonnel.startposition.hiring 1.0000 0.6000 0.7500 10\npersonnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.embargosanction 1.0000 0.8750 0.9333 16\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8333 0.9091 6\ntransaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.transfercontrol 1.0000 0.7143 0.8333 7\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transfermoney.embargosanct.. 1.0000 1.0000 1.0000 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.5000 0.6667 8\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntransaction.transfermoney.payforservice 1.0000 0.9231 0.9600 13\ntransaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 8\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 14\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.7143 0.8333 14\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.8080 0.8938 896\nmacro avg 0.9615 0.8047 0.8664 896", "eval_event_trigger_strict_micro_precision": 0.555956678700361, "eval_event_trigger_strict_micro_recall": 0.6875, "eval_event_trigger_strict_micro_f1": 0.6147704590818364, "eval_event_trigger_strict_macro_precision": 0.5821862713040946, "eval_event_trigger_strict_macro_recall": 0.6818070100245046, "eval_event_trigger_strict_macro_f1": 0.6102639429855495, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 0.5882 0.7692 0.6667 13\nartifactexistence.damagedestroy.n/a 0.7778 0.8750 0.8235 8\nconflict.attack.airstrikemissilestrike 0.3000 0.7500 0.4286 4\nconflict.attack.biologicalchemicalpois.. 0.5000 0.6667 0.5714 3\nconflict.attack.bombing 0.4545 0.7143 0.5556 7\nconflict.attack.firearmattack 0.3333 0.5000 0.4000 2\nconflict.attack.invade 0.3333 1.0000 0.5000 1\nconflict.attack.n/a 0.3902 0.4571 0.4211 35\nconflict.attack.selfdirectedbattle 0.5897 0.5610 0.5750 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\nconflict.demonstrate.marchprotestpolit.. 0.3333 0.5000 0.4000 2\nconflict.yield.n/a 0.3000 0.4286 0.3529 7\nconflict.yield.retreat 0.6667 0.6667 0.6667 3\nconflict.yield.surrender 0.3636 0.8000 0.5000 5\ncontact.collaborate.correspondence 0.5714 0.5714 0.5714 7\ncontact.collaborate.n/a 0.3333 0.4286 0.3750 7\ncontact.commandorder.broadcast 0.6667 1.0000 0.8000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.7500 1.0000 0.8571 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 0.6000 0.5455 5\ncontact.commitmentpromiseexpressintent.. 0.6667 0.3333 0.4444 6\ncontact.commitmentpromiseexpressintent.. 0.6429 0.7500 0.6923 12\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5000 0.6667 2\ncontact.discussion.correspondence 0.4000 0.5455 0.4615 11\ncontact.discussion.meet 0.5000 0.7647 0.6047 17\ncontact.discussion.n/a 0.2857 0.5000 0.3636 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.4545 0.8333 0.5882 6\ncontact.mediastatement.n/a 0.5000 0.6667 0.5714 3\ncontact.negotiate.correspondence 0.5000 1.0000 0.6667 2\ncontact.negotiate.meet 0.7500 0.7500 0.7500 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.5000 0.8750 0.6364 8\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 9\ncontact.prevarication.meet 0.5000 0.8000 0.6154 10\ncontact.prevarication.n/a 1.0000 0.7500 0.8571 4\ncontact.publicstatementinperson.broadc.. 0.6000 0.5000 0.5455 6\ncontact.publicstatementinperson.n/a 0.7500 0.6000 0.6667 5\ncontact.requestadvise.broadcast 0.4118 0.5833 0.4828 12\ncontact.requestadvise.correspondence 0.6250 0.5000 0.5556 10\ncontact.requestadvise.meet 0.7500 0.8571 0.8000 7\ncontact.requestadvise.n/a 0.6667 0.6667 0.6667 6\ncontact.threatencoerce.broadcast 0.5714 1.0000 0.7273 4\ncontact.threatencoerce.correspondence 0.3333 0.4000 0.3636 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.8000 0.6667 0.7273 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 0.7500 1.0000 0.8571 3\ngovernment.agreements.acceptagreementc.. 0.5714 0.6667 0.6154 6\ngovernment.agreements.n/a 0.6667 0.6667 0.6667 3\ngovernment.agreements.violateagreement 1.0000 0.5000 0.6667 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.7143 0.7143 0.7143 7\ngovernment.spy.spy 0.6000 0.5000 0.5455 12\ngovernment.vote.castvote 0.1667 0.3333 0.2222 3\ngovernment.vote.n/a 0.6000 0.7500 0.6667 4\ngovernment.vote.violationspreventvote 0.5000 0.5000 0.5000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5714 0.6667 0.6154 6\ninspection.sensoryobserve.monitorelect.. 0.3333 0.3333 0.3333 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.5714 1.0000 0.7273 4\njustice.arrestjaildetain.arrestjaildet.. 0.6000 0.3750 0.4615 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.3333 0.2857 6\njustice.initiatejudicialprocess.n/a 0.5714 1.0000 0.7273 4\njustice.initiatejudicialprocess.trialh.. 0.3529 0.7500 0.4800 8\njustice.investigate.investigatecrime 0.4286 0.7500 0.5455 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 0.5455 0.7500 0.6316 8\njustice.judicialconsequences.execute 0.6667 0.8000 0.7273 5\njustice.judicialconsequences.extradite 0.3333 0.5000 0.4000 2\njustice.judicialconsequences.n/a 0.7143 0.8333 0.7692 6\nlife.die.deathcausedbyviolentevents 0.5593 0.7674 0.6471 43\nlife.die.n/a 0.6667 0.8000 0.7273 20\nlife.die.nonviolentdeath 0.5000 0.6000 0.5455 10\nlife.injure.illnessdegradationhungerth.. 0.6000 0.7500 0.6667 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 0.3488 0.5769 0.4348 26\nlife.injure.n/a 0.5357 0.6000 0.5660 25\nmanufacture.artifact.build 0.5000 0.6667 0.5714 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2500 0.2500 0.2500 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.5000 0.6667 0.5714 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 0.6667 1.0000 0.8000 2\nmovement.transportartifact.hide 0.5000 0.5000 0.5000 2\nmovement.transportartifact.n/a 0.7778 0.8750 0.8235 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 0.4000 0.6667 0.5000 3\nmovement.transportartifact.preventexit 0.2500 0.4000 0.3077 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 0.6000 0.6000 0.6000 5\nmovement.transportartifact.smuggleextr.. 0.6000 1.0000 0.7500 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.4444 0.4444 0.4444 9\nmovement.transportperson.grantentryasy.. 0.5714 1.0000 0.7273 4\nmovement.transportperson.n/a 0.7000 0.7778 0.7368 9\nmovement.transportperson.prevententry 0.6000 0.6000 0.6000 5\nmovement.transportperson.preventexit 1.0000 0.6667 0.8000 9\nmovement.transportperson.selfmotion 0.6250 0.6250 0.6250 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 0.2500 0.3333 0.2857 3\npersonnel.elect.winelection 1.0000 0.5000 0.6667 2\npersonnel.endposition.firinglayoff 0.7500 0.7500 0.7500 12\npersonnel.endposition.n/a 0.5000 0.5000 0.5000 8\npersonnel.endposition.quitretire 1.0000 0.6667 0.8000 3\npersonnel.startposition.hiring 0.6250 0.5000 0.5556 10\npersonnel.startposition.n/a 0.7500 0.7500 0.7500 4\ntransaction.transaction.embargosanction 0.8235 0.8750 0.8485 16\ntransaction.transaction.giftgrantprovi.. 0.7143 0.8333 0.7692 6\ntransaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntransaction.transaction.transfercontrol 0.4286 0.4286 0.4286 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.7500 1.0000 0.8571 9\ntransaction.transfermoney.giftgrantpro.. 0.8000 0.5000 0.6154 8\ntransaction.transfermoney.n/a 0.5769 0.8824 0.6977 17\ntransaction.transfermoney.payforservice 0.4211 0.6154 0.5000 13\ntransaction.transfermoney.purchase 0.5909 0.9286 0.7222 14\ntransaction.transferownership.borrowlend 0.6667 1.0000 0.8000 8\ntransaction.transferownership.embargos.. 0.7000 1.0000 0.8235 14\ntransaction.transferownership.giftgran.. 0.6667 0.8571 0.7500 7\ntransaction.transferownership.n/a 0.6667 0.7143 0.6897 14\ntransaction.transferownership.purchase 0.6316 0.9231 0.7500 13\n----------------------------------------------------------------------------------\nmicro avg 0.5560 0.6875 0.6148 896\nmacro avg 0.5822 0.6818 0.6103 896", "eval_event_trigger_relaxed_micro_precision": 0.5622743682310469, "eval_event_trigger_relaxed_micro_recall": 0.6953125, "eval_event_trigger_relaxed_micro_f1": 0.6217564870259481, "eval_event_trigger_relaxed_macro_precision": 0.5928497128283747, "eval_event_trigger_relaxed_macro_recall": 0.6950717893715738, "eval_event_trigger_relaxed_macro_f1": 0.6220067382747249, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.8571 0.9231 7\nartifactexistence.damagedestroy.destroy 0.5882 0.7692 0.6667 13\nartifactexistence.damagedestroy.n/a 0.7778 0.8750 0.8235 8\nconflict.attack.airstrikemissilestrike 0.3000 0.7500 0.4286 4\nconflict.attack.biologicalchemicalpois.. 0.7500 1.0000 0.8571 3\nconflict.attack.bombing 0.4545 0.7143 0.5556 7\nconflict.attack.firearmattack 0.3333 0.5000 0.4000 2\nconflict.attack.invade 0.3333 1.0000 0.5000 1\nconflict.attack.n/a 0.3902 0.4571 0.4211 35\nconflict.attack.selfdirectedbattle 0.5897 0.5610 0.5750 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 1.0000 1.0000 1.0000 1\nconflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\nconflict.demonstrate.marchprotestpolit.. 0.6667 1.0000 0.8000 2\nconflict.yield.n/a 0.3000 0.4286 0.3529 7\nconflict.yield.retreat 0.6667 0.6667 0.6667 3\nconflict.yield.surrender 0.3636 0.8000 0.5000 5\ncontact.collaborate.correspondence 0.5714 0.5714 0.5714 7\ncontact.collaborate.n/a 0.3333 0.4286 0.3750 7\ncontact.commandorder.broadcast 0.6667 1.0000 0.8000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 0.7500 1.0000 0.8571 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 0.6000 0.5455 5\ncontact.commitmentpromiseexpressintent.. 0.6667 0.3333 0.4444 6\ncontact.commitmentpromiseexpressintent.. 0.6429 0.7500 0.6923 12\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5000 0.6667 2\ncontact.discussion.correspondence 0.4667 0.6364 0.5385 11\ncontact.discussion.meet 0.5000 0.7647 0.6047 17\ncontact.discussion.n/a 0.2857 0.5000 0.3636 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.4545 0.8333 0.5882 6\ncontact.mediastatement.n/a 0.5000 0.6667 0.5714 3\ncontact.negotiate.correspondence 0.5000 1.0000 0.6667 2\ncontact.negotiate.meet 0.7500 0.7500 0.7500 8\ncontact.negotiate.n/a 0.5000 1.0000 0.6667 1\ncontact.prevarication.broadcast 0.5000 0.8750 0.6364 8\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 9\ncontact.prevarication.meet 0.5000 0.8000 0.6154 10\ncontact.prevarication.n/a 1.0000 0.7500 0.8571 4\ncontact.publicstatementinperson.broadc.. 0.6000 0.5000 0.5455 6\ncontact.publicstatementinperson.n/a 0.7500 0.6000 0.6667 5\ncontact.requestadvise.broadcast 0.4118 0.5833 0.4828 12\ncontact.requestadvise.correspondence 0.6250 0.5000 0.5556 10\ncontact.requestadvise.meet 0.7500 0.8571 0.8000 7\ncontact.requestadvise.n/a 0.6667 0.6667 0.6667 6\ncontact.threatencoerce.broadcast 0.5714 1.0000 0.7273 4\ncontact.threatencoerce.correspondence 0.5000 0.6000 0.5455 5\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ncontact.threatencoerce.n/a 0.8000 0.6667 0.7273 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.6667 0.8000 3\ndisaster.fireexplosion.fireexplosion 0.7500 1.0000 0.8571 3\ngovernment.agreements.acceptagreementc.. 0.5714 0.6667 0.6154 6\ngovernment.agreements.n/a 0.6667 0.6667 0.6667 3\ngovernment.agreements.violateagreement 1.0000 0.5000 0.6667 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 0.7143 0.7143 0.7143 7\ngovernment.spy.spy 0.6000 0.5000 0.5455 12\ngovernment.vote.castvote 0.1667 0.3333 0.2222 3\ngovernment.vote.n/a 0.6000 0.7500 0.6667 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 0.5714 0.6667 0.6154 6\ninspection.sensoryobserve.monitorelect.. 0.3333 0.3333 0.3333 3\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ninspection.sensoryobserve.physicalinve.. 0.5714 1.0000 0.7273 4\njustice.arrestjaildetain.arrestjaildet.. 0.6000 0.3750 0.4615 8\njustice.initiatejudicialprocess.charge.. 0.2500 0.3333 0.2857 6\njustice.initiatejudicialprocess.n/a 0.5714 1.0000 0.7273 4\njustice.initiatejudicialprocess.trialh.. 0.3529 0.7500 0.4800 8\njustice.investigate.investigatecrime 0.4286 0.7500 0.5455 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 0.5455 0.7500 0.6316 8\njustice.judicialconsequences.execute 0.6667 0.8000 0.7273 5\njustice.judicialconsequences.extradite 0.3333 0.5000 0.4000 2\njustice.judicialconsequences.n/a 0.7143 0.8333 0.7692 6\nlife.die.deathcausedbyviolentevents 0.5763 0.7907 0.6667 43\nlife.die.n/a 0.6667 0.8000 0.7273 20\nlife.die.nonviolentdeath 0.5000 0.6000 0.5455 10\nlife.injure.illnessdegradationhungerth.. 0.6000 0.7500 0.6667 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 0.3488 0.5769 0.4348 26\nlife.injure.n/a 0.5357 0.6000 0.5660 25\nmanufacture.artifact.build 0.5000 0.6667 0.5714 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.2500 0.2500 0.2500 4\nmanufacture.artifact.n/a 0.6667 0.6667 0.6667 6\nmovement.transportartifact.bringcarryu.. 0.5000 0.6667 0.5714 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 0.6667 1.0000 0.8000 2\nmovement.transportartifact.hide 0.5000 0.5000 0.5000 2\nmovement.transportartifact.n/a 0.7778 0.8750 0.8235 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 0.4000 0.6667 0.5000 3\nmovement.transportartifact.preventexit 0.2500 0.4000 0.3077 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 0.6000 0.6000 0.6000 5\nmovement.transportartifact.smuggleextr.. 0.6000 1.0000 0.7500 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 0.4444 0.4444 0.4444 9\nmovement.transportperson.grantentryasy.. 0.5714 1.0000 0.7273 4\nmovement.transportperson.n/a 0.7000 0.7778 0.7368 9\nmovement.transportperson.prevententry 0.6000 0.6000 0.6000 5\nmovement.transportperson.preventexit 1.0000 0.6667 0.8000 9\nmovement.transportperson.selfmotion 0.6250 0.6250 0.6250 8\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 2\npersonnel.elect.n/a 0.2500 0.3333 0.2857 3\npersonnel.elect.winelection 1.0000 0.5000 0.6667 2\npersonnel.endposition.firinglayoff 0.7500 0.7500 0.7500 12\npersonnel.endposition.n/a 0.5000 0.5000 0.5000 8\npersonnel.endposition.quitretire 1.0000 0.6667 0.8000 3\npersonnel.startposition.hiring 0.6250 0.5000 0.5556 10\npersonnel.startposition.n/a 0.7500 0.7500 0.7500 4\ntransaction.transaction.embargosanction 0.8235 0.8750 0.8485 16\ntransaction.transaction.giftgrantprovi.. 0.7143 0.8333 0.7692 6\ntransaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntransaction.transaction.transfercontrol 0.4286 0.4286 0.4286 7\ntransaction.transfermoney.borrowlend 0.6667 1.0000 0.8000 4\ntransaction.transfermoney.embargosanct.. 0.7500 1.0000 0.8571 9\ntransaction.transfermoney.giftgrantpro.. 0.8000 0.5000 0.6154 8\ntransaction.transfermoney.n/a 0.5769 0.8824 0.6977 17\ntransaction.transfermoney.payforservice 0.4737 0.6923 0.5625 13\ntransaction.transfermoney.purchase 0.5909 0.9286 0.7222 14\ntransaction.transferownership.borrowlend 0.6667 1.0000 0.8000 8\ntransaction.transferownership.embargos.. 0.7000 1.0000 0.8235 14\ntransaction.transferownership.giftgran.. 0.6667 0.8571 0.7500 7\ntransaction.transferownership.n/a 0.6667 0.7143 0.6897 14\ntransaction.transferownership.purchase 0.6316 0.9231 0.7500 13\n----------------------------------------------------------------------------------\nmicro avg 0.5623 0.6953 0.6218 896\nmacro avg 0.5928 0.6951 0.6220 896", "eval_event_argument_strict_micro_precision": 0.04943679599499374, "eval_event_argument_strict_micro_recall": 0.07241063244729606, "eval_event_argument_strict_micro_f1": 0.05875790256600967, "eval_event_argument_strict_macro_precision": 0.03214094583397197, "eval_event_argument_strict_macro_recall": 0.051066026984211754, "eval_event_argument_strict_macro_f1": 0.0369228716647108, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0138 0.0192 0.0161 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.0455 0.0625 0.0526 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0483 0.0843 0.0614 83\ncandidate 0.0000 0.0000 0.0000 9\ncommunicator 0.0576 0.1655 0.0855 139\ncrashobject 0.3333 0.5000 0.4000 2\ncrime 0.1176 0.0513 0.0714 39\ndamager 0.0000 0.0000 0.0000 7\ndamagerdestroyer 0.0000 0.0000 0.0000 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 0.0244 0.0455 0.0317 44\ndemonstrator 0.1000 0.5000 0.1667 2\ndestination 0.0588 0.0698 0.0638 43\ndestroyer 0.0000 0.0000 0.0000 11\ndetainee 0.0000 0.0000 0.0000 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.1111 0.1765 0.1364 34\nexecutioner 0.0000 0.0000 0.0000 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.0288 0.0345 0.0314 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.1000 0.2500 0.1429 4\ninjurer 0.0145 0.0244 0.0182 41\ninspectedentity 0.0000 0.0000 0.0000 6\ninspector 0.0000 0.0000 0.0000 7\ninstrument 0.0513 0.0247 0.0333 81\ninvestigator 0.0000 0.0000 0.0000 10\njailer 0.0000 0.0000 0.0000 5\njudgecourt 0.0385 0.0714 0.0500 14\nkiller 0.0154 0.0370 0.0217 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0000 0.0000 0.0000 11\nmoney 0.0000 0.0000 0.0000 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0000 0.0000 0.0000 9\norigin 0.0972 0.1556 0.1197 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.0338 0.0667 0.0448 120\npassenger 0.0784 0.1333 0.0988 30\nplace 0.1032 0.1203 0.1111 374\nplaceofemployment 0.0000 0.0000 0.0000 27\npreventer 0.0308 0.0385 0.0342 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.0458 0.0575 0.0510 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0833 0.0833 0.0833 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.0280 0.0400 0.0330 75\nterritoryorfacility 0.2500 0.2000 0.2222 5\ntransporter 0.0476 0.0816 0.0602 49\nvehicle 0.0000 0.0000 0.0000 7\nvictim 0.0357 0.0727 0.0479 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.0000 0.0000 0.0000 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.0494 0.0724 0.0588 2182\nmacro avg 0.0321 0.0511 0.0369 2182", "eval_event_argument_relaxed_micro_precision": 0.18491864831038798, "eval_event_argument_relaxed_micro_recall": 0.270852428964253, "eval_event_argument_relaxed_micro_f1": 0.21978430643361846, "eval_event_argument_relaxed_macro_precision": 0.1486488697367326, "eval_event_argument_relaxed_macro_recall": 0.20535155806361502, "eval_event_argument_relaxed_macro_f1": 0.15901864009750863, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.1172 0.1635 0.1365 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.1364 0.1875 0.1579 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.1793 0.3133 0.2281 83\ncandidate 0.1818 0.2222 0.2000 9\ncommunicator 0.1579 0.4532 0.2342 139\ncrashobject 0.3333 0.5000 0.4000 2\ncrime 0.2353 0.1026 0.1429 39\ndamager 0.0000 0.0000 0.0000 7\ndamagerdestroyer 0.0667 0.1250 0.0870 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 0.1829 0.3409 0.2381 44\ndemonstrator 0.2000 1.0000 0.3333 2\ndestination 0.2353 0.2791 0.2553 43\ndestroyer 0.2174 0.4545 0.2941 11\ndetainee 0.0000 0.0000 0.0000 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.1852 0.2941 0.2273 34\nexecutioner 0.2857 0.6667 0.4000 3\nextraditer 0.3333 0.5000 0.4000 2\nfireexplosionobject 0.5000 0.3333 0.4000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.1511 0.1810 0.1647 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.1000 0.2500 0.1429 4\ninjurer 0.1014 0.1707 0.1273 41\ninspectedentity 0.0000 0.0000 0.0000 6\ninspector 0.1538 0.2857 0.2000 7\ninstrument 0.2564 0.1235 0.1667 81\ninvestigator 0.1429 0.1000 0.1176 10\njailer 0.5000 0.2000 0.2857 5\njudgecourt 0.1154 0.2143 0.1500 14\nkiller 0.1846 0.4444 0.2609 27\nlaw 0.1667 0.2500 0.2000 4\nmanufacturer 0.2222 0.1818 0.2000 11\nmoney 0.0645 0.0690 0.0667 29\nmonitor 0.3333 0.3333 0.3333 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0833 0.1111 0.0952 9\norigin 0.2361 0.3778 0.2906 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.2068 0.4083 0.2745 120\npassenger 0.1961 0.3333 0.2469 30\nplace 0.3096 0.3610 0.3333 374\nplaceofemployment 0.0000 0.0000 0.0000 27\npreventer 0.1846 0.2308 0.2051 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.1690 0.2124 0.1882 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.1667 0.1667 0.1667 12\nsurrenderer 0.1667 0.2000 0.1818 5\ntarget 0.1682 0.2400 0.1978 75\nterritoryorfacility 0.2500 0.2000 0.2222 5\ntransporter 0.1310 0.2245 0.1654 49\nvehicle 0.1000 0.2857 0.1481 7\nvictim 0.1830 0.3727 0.2455 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.1250 0.1250 0.1250 8\nyielder 0.5000 0.1429 0.2222 7\n----------------------------------------------------------------------------------\nmicro avg 0.1849 0.2709 0.2198 2182\nmacro avg 0.1486 0.2054 0.1590 2182", "eval_event_strict_micro_precision": 0.2979315831344471, "eval_event_strict_micro_recall": 0.37695017614494214, "eval_event_strict_micro_f1": 0.3328149300155521, "eval_event_strict_macro_precision": 0.6294315338858341, "eval_event_strict_macro_recall": 0.6099765377541994, "eval_event_strict_macro_f1": 0.6032936445216767, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0138 0.0192 0.0161 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.0455 0.0625 0.0526 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0483 0.0843 0.0614 83\narg:candidate 0.0000 0.0000 0.0000 9\narg:communicator 0.0576 0.1655 0.0855 139\narg:crashobject 0.3333 0.5000 0.4000 2\narg:crime 0.1176 0.0513 0.0714 39\narg:damager 0.0000 0.0000 0.0000 7\narg:damagerdestroyer 0.0000 0.0000 0.0000 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 0.0244 0.0455 0.0317 44\narg:demonstrator 0.1000 0.5000 0.1667 2\narg:destination 0.0588 0.0698 0.0638 43\narg:destroyer 0.0000 0.0000 0.0000 11\narg:detainee 0.0000 0.0000 0.0000 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.1111 0.1765 0.1364 34\narg:executioner 0.0000 0.0000 0.0000 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.0288 0.0345 0.0314 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.1000 0.2500 0.1429 4\narg:injurer 0.0145 0.0244 0.0182 41\narg:inspectedentity 0.0000 0.0000 0.0000 6\narg:inspector 0.0000 0.0000 0.0000 7\narg:instrument 0.0513 0.0247 0.0333 81\narg:investigator 0.0000 0.0000 0.0000 10\narg:jailer 0.0000 0.0000 0.0000 5\narg:judgecourt 0.0385 0.0714 0.0500 14\narg:killer 0.0154 0.0370 0.0217 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0000 0.0000 0.0000 11\narg:money 0.0000 0.0000 0.0000 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0000 0.0000 0.0000 9\narg:origin 0.0972 0.1556 0.1197 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.0338 0.0667 0.0448 120\narg:passenger 0.0784 0.1333 0.0988 30\narg:place 0.1032 0.1203 0.1111 374\narg:placeofemployment 0.0000 0.0000 0.0000 27\narg:preventer 0.0308 0.0385 0.0342 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.0458 0.0575 0.0510 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0833 0.0833 0.0833 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.0280 0.0400 0.0330 75\narg:territoryorfacility 0.2500 0.2000 0.2222 5\narg:transporter 0.0476 0.0816 0.0602 49\narg:vehicle 0.0000 0.0000 0.0000 7\narg:victim 0.0357 0.0727 0.0479 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.0000 0.0000 0.0000 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 1.0000 0.8571 0.9231 7\ntrigger:artifactexistence.damagedestro.. 0.5882 0.7692 0.6667 13\ntrigger:artifactexistence.damagedestro.. 0.7778 0.8750 0.8235 8\ntrigger:conflict.attack.airstrikemissi.. 0.3000 0.7500 0.4286 4\ntrigger:conflict.attack.biologicalchem.. 0.5000 0.6667 0.5714 3\ntrigger:conflict.attack.bombing 0.4545 0.7143 0.5556 7\ntrigger:conflict.attack.firearmattack 0.3333 0.5000 0.4000 2\ntrigger:conflict.attack.invade 0.3333 1.0000 0.5000 1\ntrigger:conflict.attack.n/a 0.3902 0.4571 0.4211 35\ntrigger:conflict.attack.selfdirectedba.. 0.5897 0.5610 0.5750 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\ntrigger:conflict.demonstrate.marchprot.. 0.3333 0.5000 0.4000 2\ntrigger:conflict.yield.n/a 0.3000 0.4286 0.3529 7\ntrigger:conflict.yield.retreat 0.6667 0.6667 0.6667 3\ntrigger:conflict.yield.surrender 0.3636 0.8000 0.5000 5\ntrigger:contact.collaborate.correspond.. 0.5714 0.5714 0.5714 7\ntrigger:contact.collaborate.n/a 0.3333 0.4286 0.3750 7\ntrigger:contact.commandorder.broadcast 0.6667 1.0000 0.8000 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.7500 1.0000 0.8571 3\ntrigger:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.6000 0.5455 5\ntrigger:contact.commitmentpromiseexpre.. 0.6667 0.3333 0.4444 6\ntrigger:contact.commitmentpromiseexpre.. 0.6429 0.7500 0.6923 12\ntrigger:contact.commitmentpromiseexpre.. 1.0000 0.5000 0.6667 2\ntrigger:contact.discussion.corresponde.. 0.4000 0.5455 0.4615 11\ntrigger:contact.discussion.meet 0.5000 0.7647 0.6047 17\ntrigger:contact.discussion.n/a 0.2857 0.5000 0.3636 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.4545 0.8333 0.5882 6\ntrigger:contact.mediastatement.n/a 0.5000 0.6667 0.5714 3\ntrigger:contact.negotiate.correspondence 0.5000 1.0000 0.6667 2\ntrigger:contact.negotiate.meet 0.7500 0.7500 0.7500 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.5000 0.8750 0.6364 8\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 9\ntrigger:contact.prevarication.meet 0.5000 0.8000 0.6154 10\ntrigger:contact.prevarication.n/a 1.0000 0.7500 0.8571 4\ntrigger:contact.publicstatementinperso.. 0.6000 0.5000 0.5455 6\ntrigger:contact.publicstatementinperso.. 0.7500 0.6000 0.6667 5\ntrigger:contact.requestadvise.broadcast 0.4118 0.5833 0.4828 12\ntrigger:contact.requestadvise.correspo.. 0.6250 0.5000 0.5556 10\ntrigger:contact.requestadvise.meet 0.7500 0.8571 0.8000 7\ntrigger:contact.requestadvise.n/a 0.6667 0.6667 0.6667 6\ntrigger:contact.threatencoerce.broadcast 0.5714 1.0000 0.7273 4\ntrigger:contact.threatencoerce.corresp.. 0.3333 0.4000 0.3636 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.8000 0.6667 0.7273 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 0.6667 0.8000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.acceptag.. 0.5714 0.6667 0.6154 6\ntrigger:government.agreements.n/a 0.6667 0.6667 0.6667 3\ntrigger:government.agreements.violatea.. 1.0000 0.5000 0.6667 2\ntrigger:government.formation.n/a 0.0000 0.0000 0.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.7143 0.7143 0.7143 7\ntrigger:government.spy.spy 0.6000 0.5000 0.5455 12\ntrigger:government.vote.castvote 0.1667 0.3333 0.2222 3\ntrigger:government.vote.n/a 0.6000 0.7500 0.6667 4\ntrigger:government.vote.violationsprev.. 0.5000 0.5000 0.5000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5714 0.6667 0.6154 6\ntrigger:inspection.sensoryobserve.moni.. 0.3333 0.3333 0.3333 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5714 1.0000 0.7273 4\ntrigger:justice.arrestjaildetain.arres.. 0.6000 0.3750 0.4615 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.3333 0.2857 6\ntrigger:justice.initiatejudicialproces.. 0.5714 1.0000 0.7273 4\ntrigger:justice.initiatejudicialproces.. 0.3529 0.7500 0.4800 8\ntrigger:justice.investigate.investigat.. 0.4286 0.7500 0.5455 8\ntrigger:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.c.. 0.5455 0.7500 0.6316 8\ntrigger:justice.judicialconsequences.e.. 0.6667 0.8000 0.7273 5\ntrigger:justice.judicialconsequences.e.. 0.3333 0.5000 0.4000 2\ntrigger:justice.judicialconsequences.n/a 0.7143 0.8333 0.7692 6\ntrigger:life.die.deathcausedbyviolente.. 0.5593 0.7674 0.6471 43\ntrigger:life.die.n/a 0.6667 0.8000 0.7273 20\ntrigger:life.die.nonviolentdeath 0.5000 0.6000 0.5455 10\ntrigger:life.injure.illnessdegradation.. 0.6000 0.7500 0.6667 8\ntrigger:life.injure.illnessdegradation.. 1.0000 0.6000 0.7500 5\ntrigger:life.injure.injurycausedbyviol.. 0.3488 0.5769 0.4348 26\ntrigger:life.injure.n/a 0.5357 0.6000 0.5660 25\ntrigger:manufacture.artifact.build 0.5000 0.6667 0.5714 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2500 0.2500 0.2500 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.5000 0.6667 0.5714 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.hide 0.5000 0.5000 0.5000 2\ntrigger:movement.transportartifact.n/a 0.7778 0.8750 0.8235 8\ntrigger:movement.transportartifact.non.. 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.pre.. 0.4000 0.6667 0.5000 3\ntrigger:movement.transportartifact.pre.. 0.2500 0.4000 0.3077 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 0.6000 0.6000 0.6000 5\ntrigger:movement.transportartifact.smu.. 0.6000 1.0000 0.7500 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.4444 0.4444 0.4444 9\ntrigger:movement.transportperson.grant.. 0.5714 1.0000 0.7273 4\ntrigger:movement.transportperson.n/a 0.7000 0.7778 0.7368 9\ntrigger:movement.transportperson.preve.. 0.6000 0.6000 0.6000 5\ntrigger:movement.transportperson.preve.. 1.0000 0.6667 0.8000 9\ntrigger:movement.transportperson.selfm.. 0.6250 0.6250 0.6250 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 0.2500 0.3333 0.2857 3\ntrigger:personnel.elect.winelection 1.0000 0.5000 0.6667 2\ntrigger:personnel.endposition.firingla.. 0.7500 0.7500 0.7500 12\ntrigger:personnel.endposition.n/a 0.5000 0.5000 0.5000 8\ntrigger:personnel.endposition.quitretire 1.0000 0.6667 0.8000 3\ntrigger:personnel.startposition.hiring 0.6250 0.5000 0.5556 10\ntrigger:personnel.startposition.n/a 0.7500 0.7500 0.7500 4\ntrigger:transaction.transaction.embarg.. 0.8235 0.8750 0.8485 16\ntrigger:transaction.transaction.giftgr.. 0.7143 0.8333 0.7692 6\ntrigger:transaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntrigger:transaction.transaction.transf.. 0.4286 0.4286 0.4286 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.7500 1.0000 0.8571 9\ntrigger:transaction.transfermoney.gift.. 0.8000 0.5000 0.6154 8\ntrigger:transaction.transfermoney.n/a 0.5769 0.8824 0.6977 17\ntrigger:transaction.transfermoney.payf.. 0.4211 0.6154 0.5000 13\ntrigger:transaction.transfermoney.purc.. 0.5909 0.9286 0.7222 14\ntrigger:transaction.transferownership... 0.6667 1.0000 0.8000 8\ntrigger:transaction.transferownership... 0.7000 1.0000 0.8235 14\ntrigger:transaction.transferownership... 0.6667 0.8571 0.7500 7\ntrigger:transaction.transferownership... 0.6667 0.7143 0.6897 14\ntrigger:transaction.transferownership... 0.6316 0.9231 0.7500 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8571 0.9231 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8462 0.9167 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.6571 0.7931 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.7073 0.8286 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 0.7143 0.8333 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.7143 0.8333 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 0.2500 0.4000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8000 0.8889 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.3333 0.5000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.7500 0.8571 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.5000 0.6667 2\ntype:contact.discussion.correspondence 1.0000 0.6364 0.7778 11\ntype:contact.discussion.meet 1.0000 0.8235 0.9032 17\ntype:contact.discussion.n/a 1.0000 0.7500 0.8571 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 0.7500 0.8571 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 0.9000 0.9474 10\ntype:contact.prevarication.n/a 1.0000 0.7500 0.8571 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.6667 0.8000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ntype:contact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.6000 0.7500 10\ntype:contact.requestadvise.meet 1.0000 0.8571 0.9231 7\ntype:contact.requestadvise.n/a 1.0000 0.8333 0.9091 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 0.8000 0.8889 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.6667 0.8000 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 0.6667 0.8000 6\ntype:government.agreements.n/a 1.0000 0.6667 0.8000 3\ntype:government.agreements.violateagre.. 1.0000 0.5000 0.6667 2\ntype:government.formation.n/a 0.0000 0.0000 0.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.7143 0.8333 7\ntype:government.spy.spy 1.0000 0.5833 0.7368 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 0.7500 0.8571 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.8333 0.9091 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 0.6667 0.8000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 0.6250 0.7692 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.6667 0.8000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 0.8750 0.9333 8\ntype:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 0.8000 0.8889 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 0.8333 0.9091 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.8372 0.9114 43\ntype:life.die.n/a 1.0000 0.8500 0.9189 20\ntype:life.die.nonviolentdeath 1.0000 0.8000 0.8889 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.6000 0.7500 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.8846 0.9388 26\ntype:life.injure.n/a 1.0000 0.8000 0.8889 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 0.7500 0.8571 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 0.8750 0.9333 8\ntype:movement.transportartifact.nonvio.. 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.6667 0.8000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.prevente.. 1.0000 0.8000 0.8889 5\ntype:movement.transportperson.prevente.. 1.0000 0.6667 0.8000 9\ntype:movement.transportperson.selfmotion 1.0000 0.6250 0.7692 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 0.6667 0.8000 3\ntype:personnel.elect.winelection 1.0000 0.5000 0.6667 2\ntype:personnel.endposition.firinglayoff 1.0000 0.9167 0.9565 12\ntype:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntype:personnel.endposition.quitretire 1.0000 0.6667 0.8000 3\ntype:personnel.startposition.hiring 1.0000 0.6000 0.7500 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 0.8750 0.9333 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.5000 0.6667 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 0.9231 0.9600 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.7143 0.8333 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.2979 0.3770 0.3328 3974\nmacro avg 0.6294 0.6100 0.6033 3974", "eval_event_relaxed_micro_precision": 0.3854415274463007, "eval_event_relaxed_micro_recall": 0.4876698540513337, "eval_event_relaxed_micro_f1": 0.43057098422572765, "eval_event_relaxed_macro_precision": 0.6561698527682177, "eval_event_relaxed_macro_recall": 0.6450390354002924, "eval_event_relaxed_macro_f1": 0.6315436477217583, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.1172 0.1635 0.1365 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.1364 0.1875 0.1579 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.1793 0.3133 0.2281 83\narg:candidate 0.1818 0.2222 0.2000 9\narg:communicator 0.1579 0.4532 0.2342 139\narg:crashobject 0.3333 0.5000 0.4000 2\narg:crime 0.2353 0.1026 0.1429 39\narg:damager 0.0000 0.0000 0.0000 7\narg:damagerdestroyer 0.0667 0.1250 0.0870 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 0.1829 0.3409 0.2381 44\narg:demonstrator 0.2000 1.0000 0.3333 2\narg:destination 0.2353 0.2791 0.2553 43\narg:destroyer 0.2174 0.4545 0.2941 11\narg:detainee 0.0000 0.0000 0.0000 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.1852 0.2941 0.2273 34\narg:executioner 0.2857 0.6667 0.4000 3\narg:extraditer 0.3333 0.5000 0.4000 2\narg:fireexplosionobject 0.5000 0.3333 0.4000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.1511 0.1810 0.1647 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.1000 0.2500 0.1429 4\narg:injurer 0.1014 0.1707 0.1273 41\narg:inspectedentity 0.0000 0.0000 0.0000 6\narg:inspector 0.1538 0.2857 0.2000 7\narg:instrument 0.2564 0.1235 0.1667 81\narg:investigator 0.1429 0.1000 0.1176 10\narg:jailer 0.5000 0.2000 0.2857 5\narg:judgecourt 0.1154 0.2143 0.1500 14\narg:killer 0.1846 0.4444 0.2609 27\narg:law 0.1667 0.2500 0.2000 4\narg:manufacturer 0.2222 0.1818 0.2000 11\narg:money 0.0645 0.0690 0.0667 29\narg:monitor 0.3333 0.3333 0.3333 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0833 0.1111 0.0952 9\narg:origin 0.2361 0.3778 0.2906 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.2068 0.4083 0.2745 120\narg:passenger 0.1961 0.3333 0.2469 30\narg:place 0.3096 0.3610 0.3333 374\narg:placeofemployment 0.0000 0.0000 0.0000 27\narg:preventer 0.1846 0.2308 0.2051 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.1690 0.2124 0.1882 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.1667 0.1667 0.1667 12\narg:surrenderer 0.1667 0.2000 0.1818 5\narg:target 0.1682 0.2400 0.1978 75\narg:territoryorfacility 0.2500 0.2000 0.2222 5\narg:transporter 0.1310 0.2245 0.1654 49\narg:vehicle 0.1000 0.2857 0.1481 7\narg:victim 0.1830 0.3727 0.2455 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.1250 0.1250 0.1250 8\narg:yielder 0.5000 0.1429 0.2222 7\ntrigger:artifactexistence.damagedestro.. 1.0000 0.8571 0.9231 7\ntrigger:artifactexistence.damagedestro.. 0.5882 0.7692 0.6667 13\ntrigger:artifactexistence.damagedestro.. 0.7778 0.8750 0.8235 8\ntrigger:conflict.attack.airstrikemissi.. 0.3000 0.7500 0.4286 4\ntrigger:conflict.attack.biologicalchem.. 0.7500 1.0000 0.8571 3\ntrigger:conflict.attack.bombing 0.4545 0.7143 0.5556 7\ntrigger:conflict.attack.firearmattack 0.3333 0.5000 0.4000 2\ntrigger:conflict.attack.invade 0.3333 1.0000 0.5000 1\ntrigger:conflict.attack.n/a 0.3902 0.4571 0.4211 35\ntrigger:conflict.attack.selfdirectedba.. 0.5897 0.5610 0.5750 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntrigger:conflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\ntrigger:conflict.demonstrate.marchprot.. 0.6667 1.0000 0.8000 2\ntrigger:conflict.yield.n/a 0.3000 0.4286 0.3529 7\ntrigger:conflict.yield.retreat 0.6667 0.6667 0.6667 3\ntrigger:conflict.yield.surrender 0.3636 0.8000 0.5000 5\ntrigger:contact.collaborate.correspond.. 0.5714 0.5714 0.5714 7\ntrigger:contact.collaborate.n/a 0.3333 0.4286 0.3750 7\ntrigger:contact.commandorder.broadcast 0.6667 1.0000 0.8000 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 0.7500 1.0000 0.8571 3\ntrigger:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.6000 0.5455 5\ntrigger:contact.commitmentpromiseexpre.. 0.6667 0.3333 0.4444 6\ntrigger:contact.commitmentpromiseexpre.. 0.6429 0.7500 0.6923 12\ntrigger:contact.commitmentpromiseexpre.. 1.0000 0.5000 0.6667 2\ntrigger:contact.discussion.corresponde.. 0.4667 0.6364 0.5385 11\ntrigger:contact.discussion.meet 0.5000 0.7647 0.6047 17\ntrigger:contact.discussion.n/a 0.2857 0.5000 0.3636 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.4545 0.8333 0.5882 6\ntrigger:contact.mediastatement.n/a 0.5000 0.6667 0.5714 3\ntrigger:contact.negotiate.correspondence 0.5000 1.0000 0.6667 2\ntrigger:contact.negotiate.meet 0.7500 0.7500 0.7500 8\ntrigger:contact.negotiate.n/a 0.5000 1.0000 0.6667 1\ntrigger:contact.prevarication.broadcast 0.5000 0.8750 0.6364 8\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 9\ntrigger:contact.prevarication.meet 0.5000 0.8000 0.6154 10\ntrigger:contact.prevarication.n/a 1.0000 0.7500 0.8571 4\ntrigger:contact.publicstatementinperso.. 0.6000 0.5000 0.5455 6\ntrigger:contact.publicstatementinperso.. 0.7500 0.6000 0.6667 5\ntrigger:contact.requestadvise.broadcast 0.4118 0.5833 0.4828 12\ntrigger:contact.requestadvise.correspo.. 0.6250 0.5000 0.5556 10\ntrigger:contact.requestadvise.meet 0.7500 0.8571 0.8000 7\ntrigger:contact.requestadvise.n/a 0.6667 0.6667 0.6667 6\ntrigger:contact.threatencoerce.broadcast 0.5714 1.0000 0.7273 4\ntrigger:contact.threatencoerce.corresp.. 0.5000 0.6000 0.5455 5\ntrigger:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntrigger:contact.threatencoerce.n/a 0.8000 0.6667 0.7273 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 0.6667 0.8000 3\ntrigger:disaster.fireexplosion.fireexp.. 0.7500 1.0000 0.8571 3\ntrigger:government.agreements.acceptag.. 0.5714 0.6667 0.6154 6\ntrigger:government.agreements.n/a 0.6667 0.6667 0.6667 3\ntrigger:government.agreements.violatea.. 1.0000 0.5000 0.6667 2\ntrigger:government.formation.n/a 0.0000 0.0000 0.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 0.7143 0.7143 0.7143 7\ntrigger:government.spy.spy 0.6000 0.5000 0.5455 12\ntrigger:government.vote.castvote 0.1667 0.3333 0.2222 3\ntrigger:government.vote.n/a 0.6000 0.7500 0.6667 4\ntrigger:government.vote.violationsprev.. 1.0000 1.0000 1.0000 2\ntrigger:inspection.sensoryobserve.insp.. 0.5714 0.6667 0.6154 6\ntrigger:inspection.sensoryobserve.moni.. 0.3333 0.3333 0.3333 3\ntrigger:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.5714 1.0000 0.7273 4\ntrigger:justice.arrestjaildetain.arres.. 0.6000 0.3750 0.4615 8\ntrigger:justice.initiatejudicialproces.. 0.2500 0.3333 0.2857 6\ntrigger:justice.initiatejudicialproces.. 0.5714 1.0000 0.7273 4\ntrigger:justice.initiatejudicialproces.. 0.3529 0.7500 0.4800 8\ntrigger:justice.investigate.investigat.. 0.4286 0.7500 0.5455 8\ntrigger:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.c.. 0.5455 0.7500 0.6316 8\ntrigger:justice.judicialconsequences.e.. 0.6667 0.8000 0.7273 5\ntrigger:justice.judicialconsequences.e.. 0.3333 0.5000 0.4000 2\ntrigger:justice.judicialconsequences.n/a 0.7143 0.8333 0.7692 6\ntrigger:life.die.deathcausedbyviolente.. 0.5763 0.7907 0.6667 43\ntrigger:life.die.n/a 0.6667 0.8000 0.7273 20\ntrigger:life.die.nonviolentdeath 0.5000 0.6000 0.5455 10\ntrigger:life.injure.illnessdegradation.. 0.6000 0.7500 0.6667 8\ntrigger:life.injure.illnessdegradation.. 1.0000 0.6000 0.7500 5\ntrigger:life.injure.injurycausedbyviol.. 0.3488 0.5769 0.4348 26\ntrigger:life.injure.n/a 0.5357 0.6000 0.5660 25\ntrigger:manufacture.artifact.build 0.5000 0.6667 0.5714 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.2500 0.2500 0.2500 4\ntrigger:manufacture.artifact.n/a 0.6667 0.6667 0.6667 6\ntrigger:movement.transportartifact.bri.. 0.5000 0.6667 0.5714 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.hide 0.5000 0.5000 0.5000 2\ntrigger:movement.transportartifact.n/a 0.7778 0.8750 0.8235 8\ntrigger:movement.transportartifact.non.. 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.pre.. 0.4000 0.6667 0.5000 3\ntrigger:movement.transportartifact.pre.. 0.2500 0.4000 0.3077 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 0.6000 0.6000 0.6000 5\ntrigger:movement.transportartifact.smu.. 0.6000 1.0000 0.7500 3\ntrigger:movement.transportperson.dispe.. 1.0000 1.0000 1.0000 3\ntrigger:movement.transportperson.evacu.. 0.4444 0.4444 0.4444 9\ntrigger:movement.transportperson.grant.. 0.5714 1.0000 0.7273 4\ntrigger:movement.transportperson.n/a 0.7000 0.7778 0.7368 9\ntrigger:movement.transportperson.preve.. 0.6000 0.6000 0.6000 5\ntrigger:movement.transportperson.preve.. 1.0000 0.6667 0.8000 9\ntrigger:movement.transportperson.selfm.. 0.6250 0.6250 0.6250 8\ntrigger:movement.transportperson.smugg.. 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.n/a 0.2500 0.3333 0.2857 3\ntrigger:personnel.elect.winelection 1.0000 0.5000 0.6667 2\ntrigger:personnel.endposition.firingla.. 0.7500 0.7500 0.7500 12\ntrigger:personnel.endposition.n/a 0.5000 0.5000 0.5000 8\ntrigger:personnel.endposition.quitretire 1.0000 0.6667 0.8000 3\ntrigger:personnel.startposition.hiring 0.6250 0.5000 0.5556 10\ntrigger:personnel.startposition.n/a 0.7500 0.7500 0.7500 4\ntrigger:transaction.transaction.embarg.. 0.8235 0.8750 0.8485 16\ntrigger:transaction.transaction.giftgr.. 0.7143 0.8333 0.7692 6\ntrigger:transaction.transaction.n/a 0.8000 1.0000 0.8889 4\ntrigger:transaction.transaction.transf.. 0.4286 0.4286 0.4286 7\ntrigger:transaction.transfermoney.borr.. 0.6667 1.0000 0.8000 4\ntrigger:transaction.transfermoney.emba.. 0.7500 1.0000 0.8571 9\ntrigger:transaction.transfermoney.gift.. 0.8000 0.5000 0.6154 8\ntrigger:transaction.transfermoney.n/a 0.5769 0.8824 0.6977 17\ntrigger:transaction.transfermoney.payf.. 0.4737 0.6923 0.5625 13\ntrigger:transaction.transfermoney.purc.. 0.5909 0.9286 0.7222 14\ntrigger:transaction.transferownership... 0.6667 1.0000 0.8000 8\ntrigger:transaction.transferownership... 0.7000 1.0000 0.8235 14\ntrigger:transaction.transferownership... 0.6667 0.8571 0.7500 7\ntrigger:transaction.transferownership... 0.6667 0.7143 0.6897 14\ntrigger:transaction.transferownership... 0.6316 0.9231 0.7500 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8571 0.9231 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.8462 0.9167 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8750 0.9333 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 7\ntype:conflict.attack.firearmattack 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 1\ntype:conflict.attack.n/a 1.0000 0.6571 0.7931 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.7073 0.8286 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 0.7143 0.8333 7\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 3\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 5\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.n/a 1.0000 0.7143 0.8333 7\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.n/a 1.0000 0.2500 0.4000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8000 0.8889 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.3333 0.5000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.7500 0.8571 12\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.5000 0.6667 2\ntype:contact.discussion.correspondence 1.0000 0.6364 0.7778 11\ntype:contact.discussion.meet 1.0000 0.8235 0.9032 17\ntype:contact.discussion.n/a 1.0000 0.7500 0.8571 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 6\ntype:contact.mediastatement.n/a 1.0000 0.6667 0.8000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 0.7500 0.8571 8\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 9\ntype:contact.prevarication.meet 1.0000 0.9000 0.9474 10\ntype:contact.prevarication.n/a 1.0000 0.7500 0.8571 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.6667 0.8000 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ntype:contact.requestadvise.broadcast 1.0000 0.8333 0.9091 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.6000 0.7500 10\ntype:contact.requestadvise.meet 1.0000 0.8571 0.9231 7\ntype:contact.requestadvise.n/a 1.0000 0.8333 0.9091 6\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.correspond.. 1.0000 0.8000 0.8889 5\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 3\ntype:contact.threatencoerce.n/a 1.0000 0.6667 0.8000 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.6667 0.8000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 3\ntype:government.agreements.acceptagree.. 1.0000 0.6667 0.8000 6\ntype:government.agreements.n/a 1.0000 0.6667 0.8000 3\ntype:government.agreements.violateagre.. 1.0000 0.5000 0.6667 2\ntype:government.formation.n/a 0.0000 0.0000 0.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.7143 0.8333 7\ntype:government.spy.spy 1.0000 0.5833 0.7368 12\ntype:government.vote.castvote 1.0000 1.0000 1.0000 3\ntype:government.vote.n/a 1.0000 0.7500 0.8571 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.8333 0.9091 6\ntype:inspection.sensoryobserve.monitor.. 1.0000 0.6667 0.8000 3\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 0.6250 0.7692 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.6667 0.8000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 8\ntype:justice.investigate.investigatecr.. 1.0000 0.8750 0.9333 8\ntype:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 1.0000 1.0000 8\ntype:justice.judicialconsequences.exec.. 1.0000 0.8000 0.8889 5\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 0.8333 0.9091 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.8372 0.9114 43\ntype:life.die.n/a 1.0000 0.8500 0.9189 20\ntype:life.die.nonviolentdeath 1.0000 0.8000 0.8889 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.8750 0.9333 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.6000 0.7500 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.8846 0.9388 26\ntype:life.injure.n/a 1.0000 0.8000 0.8889 25\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 3\ntype:manufacture.artifact.createintell.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.createmanufa.. 1.0000 0.7500 0.8571 4\ntype:manufacture.artifact.n/a 1.0000 0.8333 0.9091 6\ntype:movement.transportartifact.bringc.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.grante.. 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.n/a 1.0000 0.8750 0.9333 8\ntype:movement.transportartifact.nonvio.. 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.preven.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.preven.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.8000 0.8889 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.6667 0.8000 9\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 4\ntype:movement.transportperson.n/a 1.0000 0.8889 0.9412 9\ntype:movement.transportperson.prevente.. 1.0000 0.8000 0.8889 5\ntype:movement.transportperson.prevente.. 1.0000 0.6667 0.8000 9\ntype:movement.transportperson.selfmotion 1.0000 0.6250 0.7692 8\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 2\ntype:personnel.elect.n/a 1.0000 0.6667 0.8000 3\ntype:personnel.elect.winelection 1.0000 0.5000 0.6667 2\ntype:personnel.endposition.firinglayoff 1.0000 0.9167 0.9565 12\ntype:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntype:personnel.endposition.quitretire 1.0000 0.6667 0.8000 3\ntype:personnel.startposition.hiring 1.0000 0.6000 0.7500 10\ntype:personnel.startposition.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.embargosa.. 1.0000 0.8750 0.9333 16\ntype:transaction.transaction.giftgrant.. 1.0000 0.8333 0.9091 6\ntype:transaction.transaction.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.transferc.. 1.0000 0.7143 0.8333 7\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 4\ntype:transaction.transfermoney.embargo.. 1.0000 1.0000 1.0000 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.5000 0.6667 8\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 17\ntype:transaction.transfermoney.payfors.. 1.0000 0.9231 0.9600 13\ntype:transaction.transfermoney.purchase 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 8\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 14\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.7143 0.8333 14\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 13\n----------------------------------------------------------------------------------\nmicro avg 0.3854 0.4877 0.4306 3974\nmacro avg 0.6562 0.6450 0.6315 3974", "eval_event_trigger_error_COR": 616, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 4, "eval_event_trigger_error_BEL": 3, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 485, "eval_event_trigger_error_FN": 273, "eval_event_trigger_fair_micro_precision": 0.5577184246265279, "eval_event_trigger_fair_micro_recall": 0.6901960784313725, "eval_event_trigger_fair_micro_f1": 0.6169253880821233, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 616\nLE 0\nBES 4\nBEL 3\nBEO 0\nLBE 0\nFP 485\nFN 273\n-----------------\nfair P / R / F1: 0.5577 / 0.6902 / 0.6169", "eval_event_argument_error_COR": 386, "eval_event_argument_error_LE": 45, "eval_event_argument_error_BES": 145, "eval_event_argument_error_BEL": 31, "eval_event_argument_error_BEO": 25, "eval_event_argument_error_LBE": 58, "eval_event_argument_error_FP": 2506, "eval_event_argument_error_FN": 1492, "eval_event_argument_fair_micro_precision": 0.12680683311432325, "eval_event_argument_fair_micro_recall": 0.19014778325123152, "eval_event_argument_fair_micro_f1": 0.1521482065431612, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 386\nLE 45\nBES 145\nBEL 31\nBEO 25\nLBE 58\nFP 2506\nFN 1492\n-----------------\nfair P / R / F1: 0.1268 / 0.1901 / 0.1521\n\nlabel confusions (gold -> pred):\n recipient -> communicator: 12\n giver -> beneficiary: 6\n crime -> defendant: 4\n giver -> place: 4\n place -> communicator: 4\n victim -> place: 4\n judgecourt -> place: 3\n transporter -> destination: 3\n attacker -> place: 2\n destination -> origin: 2\n instrument -> attacker: 2\n place -> attacker: 2\n place -> beneficiary: 2\n place -> participant: 2\n placeofemployment -> employee: 2\n preventer -> place: 2\n recipient -> place: 2\n transporter -> origin: 2\n artifact -> beneficiary: 1\n artifact -> instrument: 1\n attacker -> target: 1\n beneficiary -> giver: 1\n beneficiary -> place: 1\n communicator -> place: 1\n crime -> detainee: 1\n crime -> judgecourt: 1\n crime -> place: 1\n damager -> place: 1\n deceased -> participant: 1\n defendant -> crime: 1\n destroyer -> place: 1\n employee -> placeofemployment: 1\n giver -> artifact: 1\n giver -> preventer: 1\n granter -> origin: 1\n injurer -> place: 1\n instrument -> target: 1\n instrument -> victim: 1\n investigator -> defendant: 1\n jailer -> place: 1\n judgecourt -> defendant: 1\n killer -> place: 1\n manufacturer -> artifact: 1\n origin -> artifact: 1\n origin -> extraditer: 1\n participant -> place: 1\n place -> artifact: 1\n place -> damager: 1\n place -> demonstrator: 1\n place -> inspector: 1\n place -> instrument: 1\n place -> killer: 1\n place -> victim: 1\n preventer -> artifact: 1\n prosecutor -> place: 1\n retreater -> origin: 1\n surrenderer -> place: 1\n target -> instrument: 1\n transporter -> passenger: 1\n victim -> instrument: 1\n yielder -> place: 1" }, "0.9": { "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.4720982142857143, "eval_event_type_strict_micro_f1": 0.6413949962092494, "eval_event_type_strict_macro_precision": 0.8307692307692308, "eval_event_type_strict_macro_recall": 0.447165172934316, "eval_event_type_strict_macro_f1": 0.5574012073763944, "eval_event_type_strict_support": 896, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7143 0.8333 7\nartifactexistence.damagedestroy.destroy 1.0000 0.3077 0.4706 13\nartifactexistence.damagedestroy.n/a 1.0000 0.5000 0.6667 8\nconflict.attack.airstrikemissilestrike 1.0000 0.2500 0.4000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 0.6667 0.8000 3\nconflict.attack.bombing 1.0000 0.2857 0.4444 7\nconflict.attack.firearmattack 0.0000 0.0000 0.0000 2\nconflict.attack.invade 0.0000 0.0000 0.0000 1\nconflict.attack.n/a 1.0000 0.3429 0.5106 35\nconflict.attack.selfdirectedbattle 1.0000 0.2439 0.3922 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 0.0000 0.0000 0.0000 1\nconflict.attack.stealrobhijack 1.0000 0.8000 0.8889 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 0.5000 0.6667 2\nconflict.yield.n/a 1.0000 0.2857 0.4444 7\nconflict.yield.retreat 1.0000 0.6667 0.8000 3\nconflict.yield.surrender 1.0000 0.8000 0.8889 5\ncontact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ncontact.collaborate.n/a 1.0000 0.2857 0.4444 7\ncontact.commandorder.broadcast 1.0000 0.3333 0.5000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 0.3333 0.5000 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 0.2000 0.3333 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.3333 0.5000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5833 0.7368 12\ncontact.commitmentpromiseexpressintent.. 0.0000 0.0000 0.0000 2\ncontact.discussion.correspondence 1.0000 0.4545 0.6250 11\ncontact.discussion.meet 1.0000 0.5882 0.7407 17\ncontact.discussion.n/a 1.0000 0.7500 0.8571 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 0.8333 0.9091 6\ncontact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.2500 0.4000 8\ncontact.negotiate.n/a 0.0000 0.0000 0.0000 1\ncontact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ncontact.prevarication.correspondence 1.0000 0.8889 0.9412 9\ncontact.prevarication.meet 1.0000 0.7000 0.8235 10\ncontact.prevarication.n/a 1.0000 0.5000 0.6667 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.1667 0.2857 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 1.0000 0.4167 0.5882 12\ncontact.requestadvise.correspondence 1.0000 0.6000 0.7500 10\ncontact.requestadvise.meet 1.0000 0.8571 0.9231 7\ncontact.requestadvise.n/a 1.0000 0.5000 0.6667 6\ncontact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ncontact.threatencoerce.correspondence 1.0000 0.4000 0.5714 5\ncontact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ncontact.threatencoerce.n/a 1.0000 0.5000 0.6667 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.3333 0.5000 3\ndisaster.fireexplosion.fireexplosion 1.0000 0.3333 0.5000 3\ngovernment.agreements.acceptagreementc.. 0.0000 0.0000 0.0000 6\ngovernment.agreements.n/a 0.0000 0.0000 0.0000 3\ngovernment.agreements.violateagreement 0.0000 0.0000 0.0000 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.5714 0.7273 7\ngovernment.spy.spy 1.0000 0.2500 0.4000 12\ngovernment.vote.castvote 1.0000 0.3333 0.5000 3\ngovernment.vote.n/a 1.0000 0.2500 0.4000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.5000 0.6667 6\ninspection.sensoryobserve.monitorelect.. 0.0000 0.0000 0.0000 3\ninspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 0.7500 0.8571 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 0.3750 0.5455 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.3333 0.5000 6\njustice.initiatejudicialprocess.n/a 1.0000 0.5000 0.6667 4\njustice.initiatejudicialprocess.trialh.. 1.0000 0.3750 0.5455 8\njustice.investigate.investigatecrime 1.0000 0.5000 0.6667 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 0.1250 0.2222 8\njustice.judicialconsequences.execute 1.0000 0.4000 0.5714 5\njustice.judicialconsequences.extradite 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.6279 0.7714 43\nlife.die.n/a 1.0000 0.5000 0.6667 20\nlife.die.nonviolentdeath 1.0000 0.7000 0.8235 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.7500 0.8571 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.3462 0.5143 26\nlife.injure.n/a 1.0000 0.4800 0.6486 25\nmanufacture.artifact.build 1.0000 0.6667 0.8000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.0000 0.0000 0.0000 4\nmanufacture.artifact.n/a 1.0000 0.3333 0.5000 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 0.5000 0.6667 2\nmovement.transportartifact.n/a 1.0000 0.6250 0.7692 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 0.6667 0.8000 3\nmovement.transportartifact.preventexit 1.0000 0.2000 0.3333 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.6000 0.7500 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 0.3333 0.5000 3\nmovement.transportperson.evacuationres.. 1.0000 0.4444 0.6154 9\nmovement.transportperson.grantentryasy.. 1.0000 0.7500 0.8571 4\nmovement.transportperson.n/a 1.0000 0.3333 0.5000 9\nmovement.transportperson.prevententry 1.0000 0.4000 0.5714 5\nmovement.transportperson.preventexit 1.0000 0.3333 0.5000 9\nmovement.transportperson.selfmotion 1.0000 0.5000 0.6667 8\nmovement.transportperson.smuggleextract 1.0000 0.5000 0.6667 2\npersonnel.elect.n/a 1.0000 0.3333 0.5000 3\npersonnel.elect.winelection 0.0000 0.0000 0.0000 2\npersonnel.endposition.firinglayoff 1.0000 0.5833 0.7368 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.3333 0.5000 3\npersonnel.startposition.hiring 1.0000 0.4000 0.5714 10\npersonnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntransaction.transaction.embargosanction 1.0000 0.4375 0.6087 16\ntransaction.transaction.giftgrantprovi.. 0.0000 0.0000 0.0000 6\ntransaction.transaction.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.transfercontrol 1.0000 0.4286 0.6000 7\ntransaction.transfermoney.borrowlend 1.0000 0.5000 0.6667 4\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.3750 0.5455 8\ntransaction.transfermoney.n/a 1.0000 0.7647 0.8667 17\ntransaction.transfermoney.payforservice 1.0000 0.3077 0.4706 13\ntransaction.transfermoney.purchase 1.0000 0.9286 0.9630 14\ntransaction.transferownership.borrowlend 1.0000 0.7500 0.8571 8\ntransaction.transferownership.embargos.. 1.0000 0.6429 0.7826 14\ntransaction.transferownership.giftgran.. 1.0000 0.1429 0.2500 7\ntransaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntransaction.transferownership.purchase 1.0000 0.8462 0.9167 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.4721 0.6414 896\nmacro avg 0.8308 0.4472 0.5574 896", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.4720982142857143, "eval_event_type_relaxed_micro_f1": 0.6413949962092494, "eval_event_type_relaxed_macro_precision": 0.8307692307692308, "eval_event_type_relaxed_macro_recall": 0.447165172934316, "eval_event_type_relaxed_macro_f1": 0.5574012073763944, "eval_event_type_relaxed_support": 896, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7143 0.8333 7\nartifactexistence.damagedestroy.destroy 1.0000 0.3077 0.4706 13\nartifactexistence.damagedestroy.n/a 1.0000 0.5000 0.6667 8\nconflict.attack.airstrikemissilestrike 1.0000 0.2500 0.4000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 0.6667 0.8000 3\nconflict.attack.bombing 1.0000 0.2857 0.4444 7\nconflict.attack.firearmattack 0.0000 0.0000 0.0000 2\nconflict.attack.invade 0.0000 0.0000 0.0000 1\nconflict.attack.n/a 1.0000 0.3429 0.5106 35\nconflict.attack.selfdirectedbattle 1.0000 0.2439 0.3922 41\nconflict.attack.setfire 1.0000 1.0000 1.0000 1\nconflict.attack.stabbing 0.0000 0.0000 0.0000 1\nconflict.attack.stealrobhijack 1.0000 0.8000 0.8889 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 0.5000 0.6667 2\nconflict.yield.n/a 1.0000 0.2857 0.4444 7\nconflict.yield.retreat 1.0000 0.6667 0.8000 3\nconflict.yield.surrender 1.0000 0.8000 0.8889 5\ncontact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ncontact.collaborate.n/a 1.0000 0.2857 0.4444 7\ncontact.commandorder.broadcast 1.0000 0.3333 0.5000 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 0.3333 0.5000 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 1.0000 0.2000 0.3333 5\ncontact.commitmentpromiseexpressintent.. 1.0000 0.3333 0.5000 6\ncontact.commitmentpromiseexpressintent.. 1.0000 0.5833 0.7368 12\ncontact.commitmentpromiseexpressintent.. 0.0000 0.0000 0.0000 2\ncontact.discussion.correspondence 1.0000 0.4545 0.6250 11\ncontact.discussion.meet 1.0000 0.5882 0.7407 17\ncontact.discussion.n/a 1.0000 0.7500 0.8571 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 1.0000 0.8333 0.9091 6\ncontact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.2500 0.4000 8\ncontact.negotiate.n/a 0.0000 0.0000 0.0000 1\ncontact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ncontact.prevarication.correspondence 1.0000 0.8889 0.9412 9\ncontact.prevarication.meet 1.0000 0.7000 0.8235 10\ncontact.prevarication.n/a 1.0000 0.5000 0.6667 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.1667 0.2857 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 1.0000 0.4167 0.5882 12\ncontact.requestadvise.correspondence 1.0000 0.6000 0.7500 10\ncontact.requestadvise.meet 1.0000 0.8571 0.9231 7\ncontact.requestadvise.n/a 1.0000 0.5000 0.6667 6\ncontact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ncontact.threatencoerce.correspondence 1.0000 0.4000 0.5714 5\ncontact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ncontact.threatencoerce.n/a 1.0000 0.5000 0.6667 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.3333 0.5000 3\ndisaster.fireexplosion.fireexplosion 1.0000 0.3333 0.5000 3\ngovernment.agreements.acceptagreementc.. 0.0000 0.0000 0.0000 6\ngovernment.agreements.n/a 0.0000 0.0000 0.0000 3\ngovernment.agreements.violateagreement 0.0000 0.0000 0.0000 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.5714 0.7273 7\ngovernment.spy.spy 1.0000 0.2500 0.4000 12\ngovernment.vote.castvote 1.0000 0.3333 0.5000 3\ngovernment.vote.n/a 1.0000 0.2500 0.4000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 0.5000 0.6667 6\ninspection.sensoryobserve.monitorelect.. 0.0000 0.0000 0.0000 3\ninspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ninspection.sensoryobserve.physicalinve.. 1.0000 0.7500 0.8571 4\njustice.arrestjaildetain.arrestjaildet.. 1.0000 0.3750 0.5455 8\njustice.initiatejudicialprocess.charge.. 1.0000 0.3333 0.5000 6\njustice.initiatejudicialprocess.n/a 1.0000 0.5000 0.6667 4\njustice.initiatejudicialprocess.trialh.. 1.0000 0.3750 0.5455 8\njustice.investigate.investigatecrime 1.0000 0.5000 0.6667 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 0.1250 0.2222 8\njustice.judicialconsequences.execute 1.0000 0.4000 0.5714 5\njustice.judicialconsequences.extradite 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\nlife.die.deathcausedbyviolentevents 1.0000 0.6279 0.7714 43\nlife.die.n/a 1.0000 0.5000 0.6667 20\nlife.die.nonviolentdeath 1.0000 0.7000 0.8235 10\nlife.injure.illnessdegradationhungerth.. 1.0000 0.7500 0.8571 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 1.0000 0.3462 0.5143 26\nlife.injure.n/a 1.0000 0.4800 0.6486 25\nmanufacture.artifact.build 1.0000 0.6667 0.8000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.0000 0.0000 0.0000 4\nmanufacture.artifact.n/a 1.0000 0.3333 0.5000 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 0.5000 0.6667 2\nmovement.transportartifact.n/a 1.0000 0.6250 0.7692 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 0.6667 0.8000 3\nmovement.transportartifact.preventexit 1.0000 0.2000 0.3333 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.6000 0.7500 5\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 0.3333 0.5000 3\nmovement.transportperson.evacuationres.. 1.0000 0.4444 0.6154 9\nmovement.transportperson.grantentryasy.. 1.0000 0.7500 0.8571 4\nmovement.transportperson.n/a 1.0000 0.3333 0.5000 9\nmovement.transportperson.prevententry 1.0000 0.4000 0.5714 5\nmovement.transportperson.preventexit 1.0000 0.3333 0.5000 9\nmovement.transportperson.selfmotion 1.0000 0.5000 0.6667 8\nmovement.transportperson.smuggleextract 1.0000 0.5000 0.6667 2\npersonnel.elect.n/a 1.0000 0.3333 0.5000 3\npersonnel.elect.winelection 0.0000 0.0000 0.0000 2\npersonnel.endposition.firinglayoff 1.0000 0.5833 0.7368 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.3333 0.5000 3\npersonnel.startposition.hiring 1.0000 0.4000 0.5714 10\npersonnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntransaction.transaction.embargosanction 1.0000 0.4375 0.6087 16\ntransaction.transaction.giftgrantprovi.. 0.0000 0.0000 0.0000 6\ntransaction.transaction.n/a 1.0000 0.7500 0.8571 4\ntransaction.transaction.transfercontrol 1.0000 0.4286 0.6000 7\ntransaction.transfermoney.borrowlend 1.0000 0.5000 0.6667 4\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.3750 0.5455 8\ntransaction.transfermoney.n/a 1.0000 0.7647 0.8667 17\ntransaction.transfermoney.payforservice 1.0000 0.3077 0.4706 13\ntransaction.transfermoney.purchase 1.0000 0.9286 0.9630 14\ntransaction.transferownership.borrowlend 1.0000 0.7500 0.8571 8\ntransaction.transferownership.embargos.. 1.0000 0.6429 0.7826 14\ntransaction.transferownership.giftgran.. 1.0000 0.1429 0.2500 7\ntransaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntransaction.transferownership.purchase 1.0000 0.8462 0.9167 13\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.4721 0.6414 896\nmacro avg 0.8308 0.4472 0.5574 896", "eval_event_trigger_strict_micro_precision": 0.7274549098196392, "eval_event_trigger_strict_micro_recall": 0.40513392857142855, "eval_event_trigger_strict_micro_f1": 0.5204301075268817, "eval_event_trigger_strict_macro_precision": 0.6323815287276825, "eval_event_trigger_strict_macro_recall": 0.3867303013656419, "eval_event_trigger_strict_macro_f1": 0.45311037911388496, "eval_event_trigger_strict_support": 896, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7143 0.8333 7\nartifactexistence.damagedestroy.destroy 0.7500 0.2308 0.3529 13\nartifactexistence.damagedestroy.n/a 0.7500 0.3750 0.5000 8\nconflict.attack.airstrikemissilestrike 0.0000 0.0000 0.0000 4\nconflict.attack.biologicalchemicalpois.. 0.5000 0.3333 0.4000 3\nconflict.attack.bombing 1.0000 0.2857 0.4444 7\nconflict.attack.firearmattack 0.0000 0.0000 0.0000 2\nconflict.attack.invade 0.0000 0.0000 0.0000 1\nconflict.attack.n/a 0.7692 0.2857 0.4167 35\nconflict.attack.selfdirectedbattle 0.7000 0.1707 0.2745 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 0.0000 0.0000 0.0000 1\nconflict.attack.stealrobhijack 0.4000 0.4000 0.4000 5\nconflict.demonstrate.marchprotestpolit.. 0.0000 0.0000 0.0000 2\nconflict.yield.n/a 0.5000 0.1429 0.2222 7\nconflict.yield.retreat 0.5000 0.3333 0.4000 3\nconflict.yield.surrender 0.2500 0.2000 0.2222 5\ncontact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ncontact.collaborate.n/a 1.0000 0.2857 0.4444 7\ncontact.commandorder.broadcast 0.6667 0.3333 0.4444 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 0.3333 0.5000 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 0.2000 0.2857 5\ncontact.commitmentpromiseexpressintent.. 0.5000 0.1667 0.2500 6\ncontact.commitmentpromiseexpressintent.. 0.7000 0.5833 0.6364 12\ncontact.commitmentpromiseexpressintent.. 0.0000 0.0000 0.0000 2\ncontact.discussion.correspondence 1.0000 0.4545 0.6250 11\ncontact.discussion.meet 0.9000 0.5294 0.6667 17\ncontact.discussion.n/a 0.4000 0.5000 0.4444 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.5714 0.6667 0.6154 6\ncontact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.2500 0.4000 8\ncontact.negotiate.n/a 0.0000 0.0000 0.0000 1\ncontact.prevarication.broadcast 0.5833 0.8750 0.7000 8\ncontact.prevarication.correspondence 0.7000 0.7778 0.7368 9\ncontact.prevarication.meet 0.5455 0.6000 0.5714 10\ncontact.prevarication.n/a 1.0000 0.5000 0.6667 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.1667 0.2857 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 0.5000 0.2500 0.3333 12\ncontact.requestadvise.correspondence 0.5714 0.4000 0.4706 10\ncontact.requestadvise.meet 0.8571 0.8571 0.8571 7\ncontact.requestadvise.n/a 0.7500 0.5000 0.6000 6\ncontact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ncontact.threatencoerce.correspondence 0.2500 0.2000 0.2222 5\ncontact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ncontact.threatencoerce.n/a 0.7500 0.5000 0.6000 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.3333 0.5000 3\ndisaster.fireexplosion.fireexplosion 1.0000 0.3333 0.5000 3\ngovernment.agreements.acceptagreementc.. 0.0000 0.0000 0.0000 6\ngovernment.agreements.n/a 0.0000 0.0000 0.0000 3\ngovernment.agreements.violateagreement 0.0000 0.0000 0.0000 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.5714 0.7273 7\ngovernment.spy.spy 0.4000 0.1667 0.2353 12\ngovernment.vote.castvote 0.0000 0.0000 0.0000 3\ngovernment.vote.n/a 1.0000 0.2500 0.4000 4\ngovernment.vote.violationspreventvote 0.5000 0.5000 0.5000 2\ninspection.sensoryobserve.inspectpeopl.. 0.7500 0.5000 0.6000 6\ninspection.sensoryobserve.monitorelect.. 0.0000 0.0000 0.0000 3\ninspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ninspection.sensoryobserve.physicalinve.. 0.7500 0.7500 0.7500 4\njustice.arrestjaildetain.arrestjaildet.. 0.6667 0.2500 0.3636 8\njustice.initiatejudicialprocess.charge.. 0.5000 0.1667 0.2500 6\njustice.initiatejudicialprocess.n/a 0.6667 0.5000 0.5714 4\njustice.initiatejudicialprocess.trialh.. 0.7500 0.3750 0.5000 8\njustice.investigate.investigatecrime 0.5714 0.5000 0.5333 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 0.1250 0.2222 8\njustice.judicialconsequences.execute 1.0000 0.4000 0.5714 5\njustice.judicialconsequences.extradite 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\nlife.die.deathcausedbyviolentevents 0.6667 0.5581 0.6076 43\nlife.die.n/a 0.8333 0.5000 0.6250 20\nlife.die.nonviolentdeath 0.6667 0.6000 0.6316 10\nlife.injure.illnessdegradationhungerth.. 0.6667 0.5000 0.5714 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 0.3636 0.1538 0.2162 26\nlife.injure.n/a 0.7500 0.3600 0.4865 25\nmanufacture.artifact.build 1.0000 0.6667 0.8000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.0000 0.0000 0.0000 4\nmanufacture.artifact.n/a 0.5000 0.1667 0.2500 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 0.5000 0.6667 2\nmovement.transportartifact.n/a 1.0000 0.6250 0.7692 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 0.6667 0.8000 3\nmovement.transportartifact.preventexit 0.0000 0.0000 0.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.6000 0.7500 5\nmovement.transportartifact.smuggleextr.. 0.7500 1.0000 0.8571 3\nmovement.transportperson.dispersesepar.. 1.0000 0.3333 0.5000 3\nmovement.transportperson.evacuationres.. 0.5000 0.3333 0.4000 9\nmovement.transportperson.grantentryasy.. 1.0000 0.7500 0.8571 4\nmovement.transportperson.n/a 0.6667 0.2222 0.3333 9\nmovement.transportperson.prevententry 1.0000 0.4000 0.5714 5\nmovement.transportperson.preventexit 1.0000 0.3333 0.5000 9\nmovement.transportperson.selfmotion 0.7500 0.3750 0.5000 8\nmovement.transportperson.smuggleextract 1.0000 0.5000 0.6667 2\npersonnel.elect.n/a 0.0000 0.0000 0.0000 3\npersonnel.elect.winelection 0.0000 0.0000 0.0000 2\npersonnel.endposition.firinglayoff 0.8750 0.5833 0.7000 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.3333 0.5000 3\npersonnel.startposition.hiring 0.8000 0.4000 0.5333 10\npersonnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntransaction.transaction.embargosanction 1.0000 0.4375 0.6087 16\ntransaction.transaction.giftgrantprovi.. 0.0000 0.0000 0.0000 6\ntransaction.transaction.n/a 0.7500 0.7500 0.7500 4\ntransaction.transaction.transfercontrol 0.5000 0.2857 0.3636 7\ntransaction.transfermoney.borrowlend 1.0000 0.5000 0.6667 4\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 0.7500 0.3750 0.5000 8\ntransaction.transfermoney.n/a 0.7857 0.6471 0.7097 17\ntransaction.transfermoney.payforservice 0.7500 0.2308 0.3529 13\ntransaction.transfermoney.purchase 0.7333 0.7857 0.7586 14\ntransaction.transferownership.borrowlend 1.0000 0.7500 0.8571 8\ntransaction.transferownership.embargos.. 0.8182 0.6429 0.7200 14\ntransaction.transferownership.giftgran.. 1.0000 0.1429 0.2500 7\ntransaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntransaction.transferownership.purchase 0.7143 0.7692 0.7407 13\n----------------------------------------------------------------------------------\nmicro avg 0.7275 0.4051 0.5204 896\nmacro avg 0.6324 0.3867 0.4531 896", "eval_event_trigger_relaxed_micro_precision": 0.7374749498997996, "eval_event_trigger_relaxed_micro_recall": 0.4107142857142857, "eval_event_trigger_relaxed_micro_f1": 0.5275985663082438, "eval_event_trigger_relaxed_macro_precision": 0.6446192909654447, "eval_event_trigger_relaxed_macro_recall": 0.39556659327885685, "eval_event_trigger_relaxed_macro_f1": 0.4630636355377296, "eval_event_trigger_relaxed_support": 896, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7143 0.8333 7\nartifactexistence.damagedestroy.destroy 0.7500 0.2308 0.3529 13\nartifactexistence.damagedestroy.n/a 0.7500 0.3750 0.5000 8\nconflict.attack.airstrikemissilestrike 0.0000 0.0000 0.0000 4\nconflict.attack.biologicalchemicalpois.. 1.0000 0.6667 0.8000 3\nconflict.attack.bombing 1.0000 0.2857 0.4444 7\nconflict.attack.firearmattack 0.0000 0.0000 0.0000 2\nconflict.attack.invade 0.0000 0.0000 0.0000 1\nconflict.attack.n/a 0.7692 0.2857 0.4167 35\nconflict.attack.selfdirectedbattle 0.7000 0.1707 0.2745 41\nconflict.attack.setfire 0.2000 1.0000 0.3333 1\nconflict.attack.stabbing 0.0000 0.0000 0.0000 1\nconflict.attack.stealrobhijack 0.4000 0.4000 0.4000 5\nconflict.demonstrate.marchprotestpolit.. 0.0000 0.0000 0.0000 2\nconflict.yield.n/a 0.5000 0.1429 0.2222 7\nconflict.yield.retreat 0.5000 0.3333 0.4000 3\nconflict.yield.surrender 0.2500 0.2000 0.2222 5\ncontact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ncontact.collaborate.n/a 1.0000 0.2857 0.4444 7\ncontact.commandorder.broadcast 0.6667 0.3333 0.4444 6\ncontact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ncontact.commandorder.meet 1.0000 0.3333 0.5000 3\ncontact.commandorder.n/a 0.0000 0.0000 0.0000 4\ncontact.commitmentpromiseexpressintent.. 0.5000 0.2000 0.2857 5\ncontact.commitmentpromiseexpressintent.. 0.5000 0.1667 0.2500 6\ncontact.commitmentpromiseexpressintent.. 0.7000 0.5833 0.6364 12\ncontact.commitmentpromiseexpressintent.. 0.0000 0.0000 0.0000 2\ncontact.discussion.correspondence 1.0000 0.4545 0.6250 11\ncontact.discussion.meet 0.9000 0.5294 0.6667 17\ncontact.discussion.n/a 0.4000 0.5000 0.4444 4\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ncontact.mediastatement.broadcast 0.5714 0.6667 0.6154 6\ncontact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ncontact.negotiate.meet 1.0000 0.2500 0.4000 8\ncontact.negotiate.n/a 0.0000 0.0000 0.0000 1\ncontact.prevarication.broadcast 0.5833 0.8750 0.7000 8\ncontact.prevarication.correspondence 0.7000 0.7778 0.7368 9\ncontact.prevarication.meet 0.5455 0.6000 0.5714 10\ncontact.prevarication.n/a 1.0000 0.5000 0.6667 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.1667 0.2857 6\ncontact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ncontact.requestadvise.broadcast 0.5000 0.2500 0.3333 12\ncontact.requestadvise.correspondence 0.5714 0.4000 0.4706 10\ncontact.requestadvise.meet 0.8571 0.8571 0.8571 7\ncontact.requestadvise.n/a 0.7500 0.5000 0.6000 6\ncontact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ncontact.threatencoerce.correspondence 0.5000 0.4000 0.4444 5\ncontact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ncontact.threatencoerce.n/a 0.7500 0.5000 0.6000 6\ndisaster.accidentcrash.accidentcrash 1.0000 0.3333 0.5000 3\ndisaster.fireexplosion.fireexplosion 1.0000 0.3333 0.5000 3\ngovernment.agreements.acceptagreementc.. 0.0000 0.0000 0.0000 6\ngovernment.agreements.n/a 0.0000 0.0000 0.0000 3\ngovernment.agreements.violateagreement 0.0000 0.0000 0.0000 2\ngovernment.formation.n/a 0.0000 0.0000 0.0000 1\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 1\ngovernment.legislate.legislate 1.0000 0.5714 0.7273 7\ngovernment.spy.spy 0.4000 0.1667 0.2353 12\ngovernment.vote.castvote 0.0000 0.0000 0.0000 3\ngovernment.vote.n/a 1.0000 0.2500 0.4000 4\ngovernment.vote.violationspreventvote 1.0000 1.0000 1.0000 2\ninspection.sensoryobserve.inspectpeopl.. 0.7500 0.5000 0.6000 6\ninspection.sensoryobserve.monitorelect.. 0.0000 0.0000 0.0000 3\ninspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ninspection.sensoryobserve.physicalinve.. 0.7500 0.7500 0.7500 4\njustice.arrestjaildetain.arrestjaildet.. 0.6667 0.2500 0.3636 8\njustice.initiatejudicialprocess.charge.. 0.5000 0.1667 0.2500 6\njustice.initiatejudicialprocess.n/a 0.6667 0.5000 0.5714 4\njustice.initiatejudicialprocess.trialh.. 0.7500 0.3750 0.5000 8\njustice.investigate.investigatecrime 0.5714 0.5000 0.5333 8\njustice.investigate.n/a 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.convict 1.0000 0.1250 0.2222 8\njustice.judicialconsequences.execute 1.0000 0.4000 0.5714 5\njustice.judicialconsequences.extradite 0.0000 0.0000 0.0000 2\njustice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\nlife.die.deathcausedbyviolentevents 0.6667 0.5581 0.6076 43\nlife.die.n/a 0.8333 0.5000 0.6250 20\nlife.die.nonviolentdeath 0.6667 0.6000 0.6316 10\nlife.injure.illnessdegradationhungerth.. 0.6667 0.5000 0.5714 8\nlife.injure.illnessdegradationphysical 1.0000 0.6000 0.7500 5\nlife.injure.injurycausedbyviolentevents 0.4545 0.1923 0.2703 26\nlife.injure.n/a 0.7500 0.3600 0.4865 25\nmanufacture.artifact.build 1.0000 0.6667 0.8000 3\nmanufacture.artifact.createintellectua.. 0.0000 0.0000 0.0000 1\nmanufacture.artifact.createmanufacture 0.0000 0.0000 0.0000 4\nmanufacture.artifact.n/a 0.5000 0.1667 0.2500 6\nmovement.transportartifact.bringcarryu.. 1.0000 0.6667 0.8000 3\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 1\nmovement.transportartifact.fall 0.0000 0.0000 0.0000 1\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 0.5000 0.6667 2\nmovement.transportartifact.n/a 1.0000 0.6250 0.7692 8\nmovement.transportartifact.nonviolentt.. 0.0000 0.0000 0.0000 1\nmovement.transportartifact.prevententry 1.0000 0.6667 0.8000 3\nmovement.transportartifact.preventexit 0.0000 0.0000 0.0000 5\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 1\nmovement.transportartifact.sendsupplye.. 1.0000 0.6000 0.7500 5\nmovement.transportartifact.smuggleextr.. 0.7500 1.0000 0.8571 3\nmovement.transportperson.dispersesepar.. 1.0000 0.3333 0.5000 3\nmovement.transportperson.evacuationres.. 0.5000 0.3333 0.4000 9\nmovement.transportperson.grantentryasy.. 1.0000 0.7500 0.8571 4\nmovement.transportperson.n/a 0.6667 0.2222 0.3333 9\nmovement.transportperson.prevententry 1.0000 0.4000 0.5714 5\nmovement.transportperson.preventexit 1.0000 0.3333 0.5000 9\nmovement.transportperson.selfmotion 0.7500 0.3750 0.5000 8\nmovement.transportperson.smuggleextract 1.0000 0.5000 0.6667 2\npersonnel.elect.n/a 0.0000 0.0000 0.0000 3\npersonnel.elect.winelection 0.0000 0.0000 0.0000 2\npersonnel.endposition.firinglayoff 0.8750 0.5833 0.7000 12\npersonnel.endposition.n/a 1.0000 0.5000 0.6667 8\npersonnel.endposition.quitretire 1.0000 0.3333 0.5000 3\npersonnel.startposition.hiring 0.8000 0.4000 0.5333 10\npersonnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntransaction.transaction.embargosanction 1.0000 0.4375 0.6087 16\ntransaction.transaction.giftgrantprovi.. 0.0000 0.0000 0.0000 6\ntransaction.transaction.n/a 0.7500 0.7500 0.7500 4\ntransaction.transaction.transfercontrol 0.5000 0.2857 0.3636 7\ntransaction.transfermoney.borrowlend 1.0000 0.5000 0.6667 4\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 0.7500 0.3750 0.5000 8\ntransaction.transfermoney.n/a 0.7857 0.6471 0.7097 17\ntransaction.transfermoney.payforservice 1.0000 0.3077 0.4706 13\ntransaction.transfermoney.purchase 0.7333 0.7857 0.7586 14\ntransaction.transferownership.borrowlend 1.0000 0.7500 0.8571 8\ntransaction.transferownership.embargos.. 0.8182 0.6429 0.7200 14\ntransaction.transferownership.giftgran.. 1.0000 0.1429 0.2500 7\ntransaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntransaction.transferownership.purchase 0.7143 0.7692 0.7407 13\n----------------------------------------------------------------------------------\nmicro avg 0.7375 0.4107 0.5276 896\nmacro avg 0.6446 0.3956 0.4631 896", "eval_event_argument_strict_micro_precision": 0.1534090909090909, "eval_event_argument_strict_micro_recall": 0.01237396883593034, "eval_event_argument_strict_micro_f1": 0.02290076335877863, "eval_event_argument_strict_macro_precision": 0.04138621344561549, "eval_event_argument_strict_macro_recall": 0.0037263623951517845, "eval_event_argument_strict_macro_f1": 0.0066324100451255474, "eval_event_argument_strict_support": 2182, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0000 0.0000 0.0000 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.3333 0.0125 0.0241 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.1250 0.0120 0.0220 83\ncandidate 0.0000 0.0000 0.0000 9\ncommunicator 0.0513 0.0144 0.0225 139\ncrashobject 0.0000 0.0000 0.0000 2\ncrime 0.0000 0.0000 0.0000 39\ndamager 0.0000 0.0000 0.0000 7\ndamagerdestroyer 0.0000 0.0000 0.0000 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 0.0000 0.0000 0.0000 44\ndemonstrator 0.0000 0.0000 0.0000 2\ndestination 0.0000 0.0000 0.0000 43\ndestroyer 0.0000 0.0000 0.0000 11\ndetainee 0.0000 0.0000 0.0000 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.6667 0.0588 0.1081 34\nexecutioner 0.0000 0.0000 0.0000 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.2857 0.0172 0.0325 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0000 0.0000 0.0000 4\ninjurer 0.0000 0.0000 0.0000 41\ninspectedentity 0.0000 0.0000 0.0000 6\ninspector 0.0000 0.0000 0.0000 7\ninstrument 0.0000 0.0000 0.0000 81\ninvestigator 0.0000 0.0000 0.0000 10\njailer 0.0000 0.0000 0.0000 5\njudgecourt 0.0000 0.0000 0.0000 14\nkiller 0.1429 0.0370 0.0588 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0000 0.0000 0.0000 11\nmoney 0.0000 0.0000 0.0000 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0000 0.0000 0.0000 9\norigin 0.5000 0.0222 0.0426 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.0952 0.0167 0.0284 120\npassenger 0.0000 0.0000 0.0000 30\nplace 0.3659 0.0401 0.0723 374\nplaceofemployment 0.0000 0.0000 0.0000 27\npreventer 0.0000 0.0000 0.0000 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.0000 0.0000 0.0000 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0000 0.0000 0.0000 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.0000 0.0000 0.0000 75\nterritoryorfacility 0.0000 0.0000 0.0000 5\ntransporter 0.0000 0.0000 0.0000 49\nvehicle 0.0000 0.0000 0.0000 7\nvictim 0.0000 0.0000 0.0000 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.0000 0.0000 0.0000 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.1534 0.0124 0.0229 2182\nmacro avg 0.0414 0.0037 0.0066 2182", "eval_event_argument_relaxed_micro_precision": 0.3522727272727273, "eval_event_argument_relaxed_micro_recall": 0.02841429880843263, "eval_event_argument_relaxed_micro_f1": 0.052586938083121294, "eval_event_argument_relaxed_macro_precision": 0.1528701334071122, "eval_event_argument_relaxed_macro_recall": 0.013941896025645622, "eval_event_argument_relaxed_macro_f1": 0.024560161687714164, "eval_event_argument_relaxed_support": 2182, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.6000 0.0288 0.0550 104\nartifactmoney 0.0000 0.0000 0.0000 6\nattacker 0.6667 0.0250 0.0482 80\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.3750 0.0361 0.0659 83\ncandidate 0.0000 0.0000 0.0000 9\ncommunicator 0.1795 0.0504 0.0787 139\ncrashobject 0.0000 0.0000 0.0000 2\ncrime 0.0000 0.0000 0.0000 39\ndamager 0.0000 0.0000 0.0000 7\ndamagerdestroyer 0.0000 0.0000 0.0000 8\ndeceased 0.0000 0.0000 0.0000 2\ndefendant 1.0000 0.0455 0.0870 44\ndemonstrator 0.0000 0.0000 0.0000 2\ndestination 0.0000 0.0000 0.0000 43\ndestroyer 1.0000 0.0909 0.1667 11\ndetainee 0.0000 0.0000 0.0000 8\ndriverpassenger 0.0000 0.0000 0.0000 2\nemployee 0.6667 0.0588 0.1081 34\nexecutioner 0.0000 0.0000 0.0000 3\nextraditer 0.0000 0.0000 0.0000 2\nfireexplosionobject 0.0000 0.0000 0.0000 3\nfounder 0.0000 0.0000 0.0000 2\ngiver 0.2857 0.0172 0.0325 116\ngovernmentbody 0.0000 0.0000 0.0000 7\ngpe 0.0000 0.0000 0.0000 1\ngranter 0.0000 0.0000 0.0000 4\ninjurer 0.0000 0.0000 0.0000 41\ninspectedentity 0.0000 0.0000 0.0000 6\ninspector 1.0000 0.1429 0.2500 7\ninstrument 0.0000 0.0000 0.0000 81\ninvestigator 0.0000 0.0000 0.0000 10\njailer 0.0000 0.0000 0.0000 5\njudgecourt 0.0000 0.0000 0.0000 14\nkiller 0.7143 0.1852 0.2941 27\nlaw 0.0000 0.0000 0.0000 4\nmanufacturer 0.0000 0.0000 0.0000 11\nmoney 0.0000 0.0000 0.0000 29\nmonitor 0.0000 0.0000 0.0000 3\nmonitoredentity 0.0000 0.0000 0.0000 3\nobservedentity 0.0000 0.0000 0.0000 9\norigin 0.5000 0.0222 0.0426 45\notherparticipant 0.0000 0.0000 0.0000 2\nparticipant 0.2381 0.0417 0.0709 120\npassenger 1.0000 0.0333 0.0645 30\nplace 0.5854 0.0642 0.1157 374\nplaceofemployment 0.0000 0.0000 0.0000 27\npreventer 0.0000 0.0000 0.0000 52\nprosecutor 0.0000 0.0000 0.0000 9\nrecipient 0.3333 0.0088 0.0172 226\nresult 0.0000 0.0000 0.0000 2\nretreater 0.0000 0.0000 0.0000 3\nspy 0.0000 0.0000 0.0000 12\nsurrenderer 0.0000 0.0000 0.0000 5\ntarget 0.3333 0.0133 0.0256 75\nterritoryorfacility 0.0000 0.0000 0.0000 5\ntransporter 0.0000 0.0000 0.0000 49\nvehicle 0.0000 0.0000 0.0000 7\nvictim 0.0000 0.0000 0.0000 110\nviolator 0.0000 0.0000 0.0000 2\nvoter 0.0000 0.0000 0.0000 8\nyielder 0.0000 0.0000 0.0000 7\n----------------------------------------------------------------------------------\nmicro avg 0.3523 0.0284 0.0526 2182\nmacro avg 0.1529 0.0139 0.0246 2182", "eval_event_strict_micro_precision": 0.7404371584699454, "eval_event_strict_micro_recall": 0.20457976849521892, "eval_event_strict_micro_f1": 0.32058359621451105, "eval_event_strict_macro_precision": 0.598681813565922, "eval_event_strict_macro_recall": 0.3373833730667511, "eval_event_strict_macro_f1": 0.4092475641817833, "eval_event_strict_support": 3974, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0000 0.0000 0.0000 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.3333 0.0125 0.0241 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.1250 0.0120 0.0220 83\narg:candidate 0.0000 0.0000 0.0000 9\narg:communicator 0.0513 0.0144 0.0225 139\narg:crashobject 0.0000 0.0000 0.0000 2\narg:crime 0.0000 0.0000 0.0000 39\narg:damager 0.0000 0.0000 0.0000 7\narg:damagerdestroyer 0.0000 0.0000 0.0000 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 0.0000 0.0000 0.0000 44\narg:demonstrator 0.0000 0.0000 0.0000 2\narg:destination 0.0000 0.0000 0.0000 43\narg:destroyer 0.0000 0.0000 0.0000 11\narg:detainee 0.0000 0.0000 0.0000 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.6667 0.0588 0.1081 34\narg:executioner 0.0000 0.0000 0.0000 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.2857 0.0172 0.0325 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0000 0.0000 0.0000 4\narg:injurer 0.0000 0.0000 0.0000 41\narg:inspectedentity 0.0000 0.0000 0.0000 6\narg:inspector 0.0000 0.0000 0.0000 7\narg:instrument 0.0000 0.0000 0.0000 81\narg:investigator 0.0000 0.0000 0.0000 10\narg:jailer 0.0000 0.0000 0.0000 5\narg:judgecourt 0.0000 0.0000 0.0000 14\narg:killer 0.1429 0.0370 0.0588 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0000 0.0000 0.0000 11\narg:money 0.0000 0.0000 0.0000 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0000 0.0000 0.0000 9\narg:origin 0.5000 0.0222 0.0426 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.0952 0.0167 0.0284 120\narg:passenger 0.0000 0.0000 0.0000 30\narg:place 0.3659 0.0401 0.0723 374\narg:placeofemployment 0.0000 0.0000 0.0000 27\narg:preventer 0.0000 0.0000 0.0000 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.0000 0.0000 0.0000 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0000 0.0000 0.0000 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.0000 0.0000 0.0000 75\narg:territoryorfacility 0.0000 0.0000 0.0000 5\narg:transporter 0.0000 0.0000 0.0000 49\narg:vehicle 0.0000 0.0000 0.0000 7\narg:victim 0.0000 0.0000 0.0000 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.0000 0.0000 0.0000 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 1.0000 0.7143 0.8333 7\ntrigger:artifactexistence.damagedestro.. 0.7500 0.2308 0.3529 13\ntrigger:artifactexistence.damagedestro.. 0.7500 0.3750 0.5000 8\ntrigger:conflict.attack.airstrikemissi.. 0.0000 0.0000 0.0000 4\ntrigger:conflict.attack.biologicalchem.. 0.5000 0.3333 0.4000 3\ntrigger:conflict.attack.bombing 1.0000 0.2857 0.4444 7\ntrigger:conflict.attack.firearmattack 0.0000 0.0000 0.0000 2\ntrigger:conflict.attack.invade 0.0000 0.0000 0.0000 1\ntrigger:conflict.attack.n/a 0.7692 0.2857 0.4167 35\ntrigger:conflict.attack.selfdirectedba.. 0.7000 0.1707 0.2745 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 0.0000 0.0000 0.0000 1\ntrigger:conflict.attack.stealrobhijack 0.4000 0.4000 0.4000 5\ntrigger:conflict.demonstrate.marchprot.. 0.0000 0.0000 0.0000 2\ntrigger:conflict.yield.n/a 0.5000 0.1429 0.2222 7\ntrigger:conflict.yield.retreat 0.5000 0.3333 0.4000 3\ntrigger:conflict.yield.surrender 0.2500 0.2000 0.2222 5\ntrigger:contact.collaborate.correspond.. 1.0000 0.2857 0.4444 7\ntrigger:contact.collaborate.n/a 1.0000 0.2857 0.4444 7\ntrigger:contact.commandorder.broadcast 0.6667 0.3333 0.4444 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 1.0000 0.3333 0.5000 3\ntrigger:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.2000 0.2857 5\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.1667 0.2500 6\ntrigger:contact.commitmentpromiseexpre.. 0.7000 0.5833 0.6364 12\ntrigger:contact.commitmentpromiseexpre.. 0.0000 0.0000 0.0000 2\ntrigger:contact.discussion.corresponde.. 1.0000 0.4545 0.6250 11\ntrigger:contact.discussion.meet 0.9000 0.5294 0.6667 17\ntrigger:contact.discussion.n/a 0.4000 0.5000 0.4444 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.5714 0.6667 0.6154 6\ntrigger:contact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ntrigger:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntrigger:contact.negotiate.meet 1.0000 0.2500 0.4000 8\ntrigger:contact.negotiate.n/a 0.0000 0.0000 0.0000 1\ntrigger:contact.prevarication.broadcast 0.5833 0.8750 0.7000 8\ntrigger:contact.prevarication.correspo.. 0.7000 0.7778 0.7368 9\ntrigger:contact.prevarication.meet 0.5455 0.6000 0.5714 10\ntrigger:contact.prevarication.n/a 1.0000 0.5000 0.6667 4\ntrigger:contact.publicstatementinperso.. 1.0000 0.1667 0.2857 6\ntrigger:contact.publicstatementinperso.. 1.0000 0.6000 0.7500 5\ntrigger:contact.requestadvise.broadcast 0.5000 0.2500 0.3333 12\ntrigger:contact.requestadvise.correspo.. 0.5714 0.4000 0.4706 10\ntrigger:contact.requestadvise.meet 0.8571 0.8571 0.8571 7\ntrigger:contact.requestadvise.n/a 0.7500 0.5000 0.6000 6\ntrigger:contact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ntrigger:contact.threatencoerce.corresp.. 0.2500 0.2000 0.2222 5\ntrigger:contact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ntrigger:contact.threatencoerce.n/a 0.7500 0.5000 0.6000 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 0.3333 0.5000 3\ntrigger:disaster.fireexplosion.fireexp.. 1.0000 0.3333 0.5000 3\ntrigger:government.agreements.acceptag.. 0.0000 0.0000 0.0000 6\ntrigger:government.agreements.n/a 0.0000 0.0000 0.0000 3\ntrigger:government.agreements.violatea.. 0.0000 0.0000 0.0000 2\ntrigger:government.formation.n/a 0.0000 0.0000 0.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 1.0000 0.5714 0.7273 7\ntrigger:government.spy.spy 0.4000 0.1667 0.2353 12\ntrigger:government.vote.castvote 0.0000 0.0000 0.0000 3\ntrigger:government.vote.n/a 1.0000 0.2500 0.4000 4\ntrigger:government.vote.violationsprev.. 0.5000 0.5000 0.5000 2\ntrigger:inspection.sensoryobserve.insp.. 0.7500 0.5000 0.6000 6\ntrigger:inspection.sensoryobserve.moni.. 0.0000 0.0000 0.0000 3\ntrigger:inspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.7500 0.7500 0.7500 4\ntrigger:justice.arrestjaildetain.arres.. 0.6667 0.2500 0.3636 8\ntrigger:justice.initiatejudicialproces.. 0.5000 0.1667 0.2500 6\ntrigger:justice.initiatejudicialproces.. 0.6667 0.5000 0.5714 4\ntrigger:justice.initiatejudicialproces.. 0.7500 0.3750 0.5000 8\ntrigger:justice.investigate.investigat.. 0.5714 0.5000 0.5333 8\ntrigger:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.c.. 1.0000 0.1250 0.2222 8\ntrigger:justice.judicialconsequences.e.. 1.0000 0.4000 0.5714 5\ntrigger:justice.judicialconsequences.e.. 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\ntrigger:life.die.deathcausedbyviolente.. 0.6667 0.5581 0.6076 43\ntrigger:life.die.n/a 0.8333 0.5000 0.6250 20\ntrigger:life.die.nonviolentdeath 0.6667 0.6000 0.6316 10\ntrigger:life.injure.illnessdegradation.. 0.6667 0.5000 0.5714 8\ntrigger:life.injure.illnessdegradation.. 1.0000 0.6000 0.7500 5\ntrigger:life.injure.injurycausedbyviol.. 0.3636 0.1538 0.2162 26\ntrigger:life.injure.n/a 0.7500 0.3600 0.4865 25\ntrigger:manufacture.artifact.build 1.0000 0.6667 0.8000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.0000 0.0000 0.0000 4\ntrigger:manufacture.artifact.n/a 0.5000 0.1667 0.2500 6\ntrigger:movement.transportartifact.bri.. 1.0000 0.6667 0.8000 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 1.0000 0.5000 0.6667 2\ntrigger:movement.transportartifact.hide 1.0000 0.5000 0.6667 2\ntrigger:movement.transportartifact.n/a 1.0000 0.6250 0.7692 8\ntrigger:movement.transportartifact.non.. 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.pre.. 1.0000 0.6667 0.8000 3\ntrigger:movement.transportartifact.pre.. 0.0000 0.0000 0.0000 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 1.0000 0.6000 0.7500 5\ntrigger:movement.transportartifact.smu.. 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.dispe.. 1.0000 0.3333 0.5000 3\ntrigger:movement.transportperson.evacu.. 0.5000 0.3333 0.4000 9\ntrigger:movement.transportperson.grant.. 1.0000 0.7500 0.8571 4\ntrigger:movement.transportperson.n/a 0.6667 0.2222 0.3333 9\ntrigger:movement.transportperson.preve.. 1.0000 0.4000 0.5714 5\ntrigger:movement.transportperson.preve.. 1.0000 0.3333 0.5000 9\ntrigger:movement.transportperson.selfm.. 0.7500 0.3750 0.5000 8\ntrigger:movement.transportperson.smugg.. 1.0000 0.5000 0.6667 2\ntrigger:personnel.elect.n/a 0.0000 0.0000 0.0000 3\ntrigger:personnel.elect.winelection 0.0000 0.0000 0.0000 2\ntrigger:personnel.endposition.firingla.. 0.8750 0.5833 0.7000 12\ntrigger:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntrigger:personnel.endposition.quitretire 1.0000 0.3333 0.5000 3\ntrigger:personnel.startposition.hiring 0.8000 0.4000 0.5333 10\ntrigger:personnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntrigger:transaction.transaction.embarg.. 1.0000 0.4375 0.6087 16\ntrigger:transaction.transaction.giftgr.. 0.0000 0.0000 0.0000 6\ntrigger:transaction.transaction.n/a 0.7500 0.7500 0.7500 4\ntrigger:transaction.transaction.transf.. 0.5000 0.2857 0.3636 7\ntrigger:transaction.transfermoney.borr.. 1.0000 0.5000 0.6667 4\ntrigger:transaction.transfermoney.emba.. 1.0000 0.8889 0.9412 9\ntrigger:transaction.transfermoney.gift.. 0.7500 0.3750 0.5000 8\ntrigger:transaction.transfermoney.n/a 0.7857 0.6471 0.7097 17\ntrigger:transaction.transfermoney.payf.. 0.7500 0.2308 0.3529 13\ntrigger:transaction.transfermoney.purc.. 0.7333 0.7857 0.7586 14\ntrigger:transaction.transferownership... 1.0000 0.7500 0.8571 8\ntrigger:transaction.transferownership... 0.8182 0.6429 0.7200 14\ntrigger:transaction.transferownership... 1.0000 0.1429 0.2500 7\ntrigger:transaction.transferownership... 1.0000 0.5000 0.6667 14\ntrigger:transaction.transferownership... 0.7143 0.7692 0.7407 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.7143 0.8333 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.3077 0.4706 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.5000 0.6667 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 0.2500 0.4000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 0.6667 0.8000 3\ntype:conflict.attack.bombing 1.0000 0.2857 0.4444 7\ntype:conflict.attack.firearmattack 0.0000 0.0000 0.0000 2\ntype:conflict.attack.invade 0.0000 0.0000 0.0000 1\ntype:conflict.attack.n/a 1.0000 0.3429 0.5106 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.2439 0.3922 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 0.0000 0.0000 0.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 0.8000 0.8889 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 0.5000 0.6667 2\ntype:conflict.yield.n/a 1.0000 0.2857 0.4444 7\ntype:conflict.yield.retreat 1.0000 0.6667 0.8000 3\ntype:conflict.yield.surrender 1.0000 0.8000 0.8889 5\ntype:contact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ntype:contact.collaborate.n/a 1.0000 0.2857 0.4444 7\ntype:contact.commandorder.broadcast 1.0000 0.3333 0.5000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 0.3333 0.5000 3\ntype:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.2000 0.3333 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.3333 0.5000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.5833 0.7368 12\ntype:contact.commitmentpromiseexpressi.. 0.0000 0.0000 0.0000 2\ntype:contact.discussion.correspondence 1.0000 0.4545 0.6250 11\ntype:contact.discussion.meet 1.0000 0.5882 0.7407 17\ntype:contact.discussion.n/a 1.0000 0.7500 0.8571 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 0.8333 0.9091 6\ntype:contact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 0.2500 0.4000 8\ntype:contact.negotiate.n/a 0.0000 0.0000 0.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ntype:contact.prevarication.corresponde.. 1.0000 0.8889 0.9412 9\ntype:contact.prevarication.meet 1.0000 0.7000 0.8235 10\ntype:contact.prevarication.n/a 1.0000 0.5000 0.6667 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.1667 0.2857 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ntype:contact.requestadvise.broadcast 1.0000 0.4167 0.5882 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.6000 0.7500 10\ntype:contact.requestadvise.meet 1.0000 0.8571 0.9231 7\ntype:contact.requestadvise.n/a 1.0000 0.5000 0.6667 6\ntype:contact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ntype:contact.threatencoerce.correspond.. 1.0000 0.4000 0.5714 5\ntype:contact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ntype:contact.threatencoerce.n/a 1.0000 0.5000 0.6667 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.3333 0.5000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 0.3333 0.5000 3\ntype:government.agreements.acceptagree.. 0.0000 0.0000 0.0000 6\ntype:government.agreements.n/a 0.0000 0.0000 0.0000 3\ntype:government.agreements.violateagre.. 0.0000 0.0000 0.0000 2\ntype:government.formation.n/a 0.0000 0.0000 0.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.5714 0.7273 7\ntype:government.spy.spy 1.0000 0.2500 0.4000 12\ntype:government.vote.castvote 1.0000 0.3333 0.5000 3\ntype:government.vote.n/a 1.0000 0.2500 0.4000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.5000 0.6667 6\ntype:inspection.sensoryobserve.monitor.. 0.0000 0.0000 0.0000 3\ntype:inspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 0.7500 0.8571 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 0.3750 0.5455 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.3333 0.5000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 0.5000 0.6667 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 0.3750 0.5455 8\ntype:justice.investigate.investigatecr.. 1.0000 0.5000 0.6667 8\ntype:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 0.1250 0.2222 8\ntype:justice.judicialconsequences.exec.. 1.0000 0.4000 0.5714 5\ntype:justice.judicialconsequences.extr.. 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.6279 0.7714 43\ntype:life.die.n/a 1.0000 0.5000 0.6667 20\ntype:life.die.nonviolentdeath 1.0000 0.7000 0.8235 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.7500 0.8571 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.6000 0.7500 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.3462 0.5143 26\ntype:life.injure.n/a 1.0000 0.4800 0.6486 25\ntype:manufacture.artifact.build 1.0000 0.6667 0.8000 3\ntype:manufacture.artifact.createintell.. 0.0000 0.0000 0.0000 1\ntype:manufacture.artifact.createmanufa.. 0.0000 0.0000 0.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.3333 0.5000 6\ntype:movement.transportartifact.bringc.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.grante.. 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.hide 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.n/a 1.0000 0.6250 0.7692 8\ntype:movement.transportartifact.nonvio.. 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.preven.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.preven.. 1.0000 0.2000 0.3333 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.6000 0.7500 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 0.3333 0.5000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.4444 0.6154 9\ntype:movement.transportperson.grantent.. 1.0000 0.7500 0.8571 4\ntype:movement.transportperson.n/a 1.0000 0.3333 0.5000 9\ntype:movement.transportperson.prevente.. 1.0000 0.4000 0.5714 5\ntype:movement.transportperson.prevente.. 1.0000 0.3333 0.5000 9\ntype:movement.transportperson.selfmotion 1.0000 0.5000 0.6667 8\ntype:movement.transportperson.smugglee.. 1.0000 0.5000 0.6667 2\ntype:personnel.elect.n/a 1.0000 0.3333 0.5000 3\ntype:personnel.elect.winelection 0.0000 0.0000 0.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 0.5833 0.7368 12\ntype:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntype:personnel.endposition.quitretire 1.0000 0.3333 0.5000 3\ntype:personnel.startposition.hiring 1.0000 0.4000 0.5714 10\ntype:personnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 0.4375 0.6087 16\ntype:transaction.transaction.giftgrant.. 0.0000 0.0000 0.0000 6\ntype:transaction.transaction.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.transferc.. 1.0000 0.4286 0.6000 7\ntype:transaction.transfermoney.borrowl.. 1.0000 0.5000 0.6667 4\ntype:transaction.transfermoney.embargo.. 1.0000 0.8889 0.9412 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.3750 0.5455 8\ntype:transaction.transfermoney.n/a 1.0000 0.7647 0.8667 17\ntype:transaction.transfermoney.payfors.. 1.0000 0.3077 0.4706 13\ntype:transaction.transfermoney.purchase 1.0000 0.9286 0.9630 14\ntype:transaction.transferownership.bor.. 1.0000 0.7500 0.8571 8\ntype:transaction.transferownership.emb.. 1.0000 0.6429 0.7826 14\ntype:transaction.transferownership.gif.. 1.0000 0.1429 0.2500 7\ntype:transaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntype:transaction.transferownership.pur.. 1.0000 0.8462 0.9167 13\n----------------------------------------------------------------------------------\nmicro avg 0.7404 0.2046 0.3206 3974\nmacro avg 0.5987 0.3374 0.4092 3974", "eval_event_relaxed_micro_precision": 0.7768670309653917, "eval_event_relaxed_micro_recall": 0.21464519375943633, "eval_event_relaxed_micro_f1": 0.33635646687697157, "eval_event_relaxed_macro_precision": 0.6250883729712694, "eval_event_relaxed_macro_recall": 0.3429177862152249, "eval_event_relaxed_macro_f1": 0.4167178869673122, "eval_event_relaxed_support": 3974, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.6000 0.0288 0.0550 104\narg:artifactmoney 0.0000 0.0000 0.0000 6\narg:attacker 0.6667 0.0250 0.0482 80\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.3750 0.0361 0.0659 83\narg:candidate 0.0000 0.0000 0.0000 9\narg:communicator 0.1795 0.0504 0.0787 139\narg:crashobject 0.0000 0.0000 0.0000 2\narg:crime 0.0000 0.0000 0.0000 39\narg:damager 0.0000 0.0000 0.0000 7\narg:damagerdestroyer 0.0000 0.0000 0.0000 8\narg:deceased 0.0000 0.0000 0.0000 2\narg:defendant 1.0000 0.0455 0.0870 44\narg:demonstrator 0.0000 0.0000 0.0000 2\narg:destination 0.0000 0.0000 0.0000 43\narg:destroyer 1.0000 0.0909 0.1667 11\narg:detainee 0.0000 0.0000 0.0000 8\narg:driverpassenger 0.0000 0.0000 0.0000 2\narg:employee 0.6667 0.0588 0.1081 34\narg:executioner 0.0000 0.0000 0.0000 3\narg:extraditer 0.0000 0.0000 0.0000 2\narg:fireexplosionobject 0.0000 0.0000 0.0000 3\narg:founder 0.0000 0.0000 0.0000 2\narg:giver 0.2857 0.0172 0.0325 116\narg:governmentbody 0.0000 0.0000 0.0000 7\narg:gpe 0.0000 0.0000 0.0000 1\narg:granter 0.0000 0.0000 0.0000 4\narg:injurer 0.0000 0.0000 0.0000 41\narg:inspectedentity 0.0000 0.0000 0.0000 6\narg:inspector 1.0000 0.1429 0.2500 7\narg:instrument 0.0000 0.0000 0.0000 81\narg:investigator 0.0000 0.0000 0.0000 10\narg:jailer 0.0000 0.0000 0.0000 5\narg:judgecourt 0.0000 0.0000 0.0000 14\narg:killer 0.7143 0.1852 0.2941 27\narg:law 0.0000 0.0000 0.0000 4\narg:manufacturer 0.0000 0.0000 0.0000 11\narg:money 0.0000 0.0000 0.0000 29\narg:monitor 0.0000 0.0000 0.0000 3\narg:monitoredentity 0.0000 0.0000 0.0000 3\narg:observedentity 0.0000 0.0000 0.0000 9\narg:origin 0.5000 0.0222 0.0426 45\narg:otherparticipant 0.0000 0.0000 0.0000 2\narg:participant 0.2381 0.0417 0.0709 120\narg:passenger 1.0000 0.0333 0.0645 30\narg:place 0.5854 0.0642 0.1157 374\narg:placeofemployment 0.0000 0.0000 0.0000 27\narg:preventer 0.0000 0.0000 0.0000 52\narg:prosecutor 0.0000 0.0000 0.0000 9\narg:recipient 0.3333 0.0088 0.0172 226\narg:result 0.0000 0.0000 0.0000 2\narg:retreater 0.0000 0.0000 0.0000 3\narg:spy 0.0000 0.0000 0.0000 12\narg:surrenderer 0.0000 0.0000 0.0000 5\narg:target 0.3333 0.0133 0.0256 75\narg:territoryorfacility 0.0000 0.0000 0.0000 5\narg:transporter 0.0000 0.0000 0.0000 49\narg:vehicle 0.0000 0.0000 0.0000 7\narg:victim 0.0000 0.0000 0.0000 110\narg:violator 0.0000 0.0000 0.0000 2\narg:voter 0.0000 0.0000 0.0000 8\narg:yielder 0.0000 0.0000 0.0000 7\ntrigger:artifactexistence.damagedestro.. 1.0000 0.7143 0.8333 7\ntrigger:artifactexistence.damagedestro.. 0.7500 0.2308 0.3529 13\ntrigger:artifactexistence.damagedestro.. 0.7500 0.3750 0.5000 8\ntrigger:conflict.attack.airstrikemissi.. 0.0000 0.0000 0.0000 4\ntrigger:conflict.attack.biologicalchem.. 1.0000 0.6667 0.8000 3\ntrigger:conflict.attack.bombing 1.0000 0.2857 0.4444 7\ntrigger:conflict.attack.firearmattack 0.0000 0.0000 0.0000 2\ntrigger:conflict.attack.invade 0.0000 0.0000 0.0000 1\ntrigger:conflict.attack.n/a 0.7692 0.2857 0.4167 35\ntrigger:conflict.attack.selfdirectedba.. 0.7000 0.1707 0.2745 41\ntrigger:conflict.attack.setfire 0.2000 1.0000 0.3333 1\ntrigger:conflict.attack.stabbing 0.0000 0.0000 0.0000 1\ntrigger:conflict.attack.stealrobhijack 0.4000 0.4000 0.4000 5\ntrigger:conflict.demonstrate.marchprot.. 0.0000 0.0000 0.0000 2\ntrigger:conflict.yield.n/a 0.5000 0.1429 0.2222 7\ntrigger:conflict.yield.retreat 0.5000 0.3333 0.4000 3\ntrigger:conflict.yield.surrender 0.2500 0.2000 0.2222 5\ntrigger:contact.collaborate.correspond.. 1.0000 0.2857 0.4444 7\ntrigger:contact.collaborate.n/a 1.0000 0.2857 0.4444 7\ntrigger:contact.commandorder.broadcast 0.6667 0.3333 0.4444 6\ntrigger:contact.commandorder.correspon.. 0.0000 0.0000 0.0000 1\ntrigger:contact.commandorder.meet 1.0000 0.3333 0.5000 3\ntrigger:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.2000 0.2857 5\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.1667 0.2500 6\ntrigger:contact.commitmentpromiseexpre.. 0.7000 0.5833 0.6364 12\ntrigger:contact.commitmentpromiseexpre.. 0.0000 0.0000 0.0000 2\ntrigger:contact.discussion.corresponde.. 1.0000 0.4545 0.6250 11\ntrigger:contact.discussion.meet 0.9000 0.5294 0.6667 17\ntrigger:contact.discussion.n/a 0.4000 0.5000 0.4444 4\ntrigger:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntrigger:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.mediastatement.broadcast 0.5714 0.6667 0.6154 6\ntrigger:contact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ntrigger:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntrigger:contact.negotiate.meet 1.0000 0.2500 0.4000 8\ntrigger:contact.negotiate.n/a 0.0000 0.0000 0.0000 1\ntrigger:contact.prevarication.broadcast 0.5833 0.8750 0.7000 8\ntrigger:contact.prevarication.correspo.. 0.7000 0.7778 0.7368 9\ntrigger:contact.prevarication.meet 0.5455 0.6000 0.5714 10\ntrigger:contact.prevarication.n/a 1.0000 0.5000 0.6667 4\ntrigger:contact.publicstatementinperso.. 1.0000 0.1667 0.2857 6\ntrigger:contact.publicstatementinperso.. 1.0000 0.6000 0.7500 5\ntrigger:contact.requestadvise.broadcast 0.5000 0.2500 0.3333 12\ntrigger:contact.requestadvise.correspo.. 0.5714 0.4000 0.4706 10\ntrigger:contact.requestadvise.meet 0.8571 0.8571 0.8571 7\ntrigger:contact.requestadvise.n/a 0.7500 0.5000 0.6000 6\ntrigger:contact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ntrigger:contact.threatencoerce.corresp.. 0.5000 0.4000 0.4444 5\ntrigger:contact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ntrigger:contact.threatencoerce.n/a 0.7500 0.5000 0.6000 6\ntrigger:disaster.accidentcrash.acciden.. 1.0000 0.3333 0.5000 3\ntrigger:disaster.fireexplosion.fireexp.. 1.0000 0.3333 0.5000 3\ntrigger:government.agreements.acceptag.. 0.0000 0.0000 0.0000 6\ntrigger:government.agreements.n/a 0.0000 0.0000 0.0000 3\ntrigger:government.agreements.violatea.. 0.0000 0.0000 0.0000 2\ntrigger:government.formation.n/a 0.0000 0.0000 0.0000 1\ntrigger:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntrigger:government.legislate.legislate 1.0000 0.5714 0.7273 7\ntrigger:government.spy.spy 0.4000 0.1667 0.2353 12\ntrigger:government.vote.castvote 0.0000 0.0000 0.0000 3\ntrigger:government.vote.n/a 1.0000 0.2500 0.4000 4\ntrigger:government.vote.violationsprev.. 1.0000 1.0000 1.0000 2\ntrigger:inspection.sensoryobserve.insp.. 0.7500 0.5000 0.6000 6\ntrigger:inspection.sensoryobserve.moni.. 0.0000 0.0000 0.0000 3\ntrigger:inspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ntrigger:inspection.sensoryobserve.phys.. 0.7500 0.7500 0.7500 4\ntrigger:justice.arrestjaildetain.arres.. 0.6667 0.2500 0.3636 8\ntrigger:justice.initiatejudicialproces.. 0.5000 0.1667 0.2500 6\ntrigger:justice.initiatejudicialproces.. 0.6667 0.5000 0.5714 4\ntrigger:justice.initiatejudicialproces.. 0.7500 0.3750 0.5000 8\ntrigger:justice.investigate.investigat.. 0.5714 0.5000 0.5333 8\ntrigger:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.c.. 1.0000 0.1250 0.2222 8\ntrigger:justice.judicialconsequences.e.. 1.0000 0.4000 0.5714 5\ntrigger:justice.judicialconsequences.e.. 0.0000 0.0000 0.0000 2\ntrigger:justice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\ntrigger:life.die.deathcausedbyviolente.. 0.6667 0.5581 0.6076 43\ntrigger:life.die.n/a 0.8333 0.5000 0.6250 20\ntrigger:life.die.nonviolentdeath 0.6667 0.6000 0.6316 10\ntrigger:life.injure.illnessdegradation.. 0.6667 0.5000 0.5714 8\ntrigger:life.injure.illnessdegradation.. 1.0000 0.6000 0.7500 5\ntrigger:life.injure.injurycausedbyviol.. 0.4545 0.1923 0.2703 26\ntrigger:life.injure.n/a 0.7500 0.3600 0.4865 25\ntrigger:manufacture.artifact.build 1.0000 0.6667 0.8000 3\ntrigger:manufacture.artifact.createint.. 0.0000 0.0000 0.0000 1\ntrigger:manufacture.artifact.createman.. 0.0000 0.0000 0.0000 4\ntrigger:manufacture.artifact.n/a 0.5000 0.1667 0.2500 6\ntrigger:movement.transportartifact.bri.. 1.0000 0.6667 0.8000 3\ntrigger:movement.transportartifact.dis.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.gra.. 1.0000 0.5000 0.6667 2\ntrigger:movement.transportartifact.hide 1.0000 0.5000 0.6667 2\ntrigger:movement.transportartifact.n/a 1.0000 0.6250 0.7692 8\ntrigger:movement.transportartifact.non.. 0.0000 0.0000 0.0000 1\ntrigger:movement.transportartifact.pre.. 1.0000 0.6667 0.8000 3\ntrigger:movement.transportartifact.pre.. 0.0000 0.0000 0.0000 5\ntrigger:movement.transportartifact.rec.. 1.0000 1.0000 1.0000 1\ntrigger:movement.transportartifact.sen.. 1.0000 0.6000 0.7500 5\ntrigger:movement.transportartifact.smu.. 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.dispe.. 1.0000 0.3333 0.5000 3\ntrigger:movement.transportperson.evacu.. 0.5000 0.3333 0.4000 9\ntrigger:movement.transportperson.grant.. 1.0000 0.7500 0.8571 4\ntrigger:movement.transportperson.n/a 0.6667 0.2222 0.3333 9\ntrigger:movement.transportperson.preve.. 1.0000 0.4000 0.5714 5\ntrigger:movement.transportperson.preve.. 1.0000 0.3333 0.5000 9\ntrigger:movement.transportperson.selfm.. 0.7500 0.3750 0.5000 8\ntrigger:movement.transportperson.smugg.. 1.0000 0.5000 0.6667 2\ntrigger:personnel.elect.n/a 0.0000 0.0000 0.0000 3\ntrigger:personnel.elect.winelection 0.0000 0.0000 0.0000 2\ntrigger:personnel.endposition.firingla.. 0.8750 0.5833 0.7000 12\ntrigger:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntrigger:personnel.endposition.quitretire 1.0000 0.3333 0.5000 3\ntrigger:personnel.startposition.hiring 0.8000 0.4000 0.5333 10\ntrigger:personnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntrigger:transaction.transaction.embarg.. 1.0000 0.4375 0.6087 16\ntrigger:transaction.transaction.giftgr.. 0.0000 0.0000 0.0000 6\ntrigger:transaction.transaction.n/a 0.7500 0.7500 0.7500 4\ntrigger:transaction.transaction.transf.. 0.5000 0.2857 0.3636 7\ntrigger:transaction.transfermoney.borr.. 1.0000 0.5000 0.6667 4\ntrigger:transaction.transfermoney.emba.. 1.0000 0.8889 0.9412 9\ntrigger:transaction.transfermoney.gift.. 0.7500 0.3750 0.5000 8\ntrigger:transaction.transfermoney.n/a 0.7857 0.6471 0.7097 17\ntrigger:transaction.transfermoney.payf.. 1.0000 0.3077 0.4706 13\ntrigger:transaction.transfermoney.purc.. 0.7333 0.7857 0.7586 14\ntrigger:transaction.transferownership... 1.0000 0.7500 0.8571 8\ntrigger:transaction.transferownership... 0.8182 0.6429 0.7200 14\ntrigger:transaction.transferownership... 1.0000 0.1429 0.2500 7\ntrigger:transaction.transferownership... 1.0000 0.5000 0.6667 14\ntrigger:transaction.transferownership... 0.7143 0.7692 0.7407 13\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.7143 0.8333 7\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.3077 0.4706 13\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.5000 0.6667 8\ntype:conflict.attack.airstrikemissiles.. 1.0000 0.2500 0.4000 4\ntype:conflict.attack.biologicalchemica.. 1.0000 0.6667 0.8000 3\ntype:conflict.attack.bombing 1.0000 0.2857 0.4444 7\ntype:conflict.attack.firearmattack 0.0000 0.0000 0.0000 2\ntype:conflict.attack.invade 0.0000 0.0000 0.0000 1\ntype:conflict.attack.n/a 1.0000 0.3429 0.5106 35\ntype:conflict.attack.selfdirectedbattle 1.0000 0.2439 0.3922 41\ntype:conflict.attack.setfire 1.0000 1.0000 1.0000 1\ntype:conflict.attack.stabbing 0.0000 0.0000 0.0000 1\ntype:conflict.attack.stealrobhijack 1.0000 0.8000 0.8889 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 0.5000 0.6667 2\ntype:conflict.yield.n/a 1.0000 0.2857 0.4444 7\ntype:conflict.yield.retreat 1.0000 0.6667 0.8000 3\ntype:conflict.yield.surrender 1.0000 0.8000 0.8889 5\ntype:contact.collaborate.correspondence 1.0000 0.2857 0.4444 7\ntype:contact.collaborate.n/a 1.0000 0.2857 0.4444 7\ntype:contact.commandorder.broadcast 1.0000 0.3333 0.5000 6\ntype:contact.commandorder.correspondence 0.0000 0.0000 0.0000 1\ntype:contact.commandorder.meet 1.0000 0.3333 0.5000 3\ntype:contact.commandorder.n/a 0.0000 0.0000 0.0000 4\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.2000 0.3333 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.3333 0.5000 6\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.5833 0.7368 12\ntype:contact.commitmentpromiseexpressi.. 0.0000 0.0000 0.0000 2\ntype:contact.discussion.correspondence 1.0000 0.4545 0.6250 11\ntype:contact.discussion.meet 1.0000 0.5882 0.7407 17\ntype:contact.discussion.n/a 1.0000 0.7500 0.8571 4\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 1\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 1\ntype:contact.mediastatement.broadcast 1.0000 0.8333 0.9091 6\ntype:contact.mediastatement.n/a 1.0000 0.3333 0.5000 3\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 2\ntype:contact.negotiate.meet 1.0000 0.2500 0.4000 8\ntype:contact.negotiate.n/a 0.0000 0.0000 0.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.8750 0.9333 8\ntype:contact.prevarication.corresponde.. 1.0000 0.8889 0.9412 9\ntype:contact.prevarication.meet 1.0000 0.7000 0.8235 10\ntype:contact.prevarication.n/a 1.0000 0.5000 0.6667 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.1667 0.2857 6\ntype:contact.publicstatementinperson.n/a 1.0000 0.6000 0.7500 5\ntype:contact.requestadvise.broadcast 1.0000 0.4167 0.5882 12\ntype:contact.requestadvise.corresponde.. 1.0000 0.6000 0.7500 10\ntype:contact.requestadvise.meet 1.0000 0.8571 0.9231 7\ntype:contact.requestadvise.n/a 1.0000 0.5000 0.6667 6\ntype:contact.threatencoerce.broadcast 1.0000 0.5000 0.6667 4\ntype:contact.threatencoerce.correspond.. 1.0000 0.4000 0.5714 5\ntype:contact.threatencoerce.meet 1.0000 0.6667 0.8000 3\ntype:contact.threatencoerce.n/a 1.0000 0.5000 0.6667 6\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.3333 0.5000 3\ntype:disaster.fireexplosion.fireexplos.. 1.0000 0.3333 0.5000 3\ntype:government.agreements.acceptagree.. 0.0000 0.0000 0.0000 6\ntype:government.agreements.n/a 0.0000 0.0000 0.0000 3\ntype:government.agreements.violateagre.. 0.0000 0.0000 0.0000 2\ntype:government.formation.n/a 0.0000 0.0000 0.0000 1\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 1\ntype:government.legislate.legislate 1.0000 0.5714 0.7273 7\ntype:government.spy.spy 1.0000 0.2500 0.4000 12\ntype:government.vote.castvote 1.0000 0.3333 0.5000 3\ntype:government.vote.n/a 1.0000 0.2500 0.4000 4\ntype:government.vote.violationsprevent.. 1.0000 1.0000 1.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 0.5000 0.6667 6\ntype:inspection.sensoryobserve.monitor.. 0.0000 0.0000 0.0000 3\ntype:inspection.sensoryobserve.n/a 0.0000 0.0000 0.0000 1\ntype:inspection.sensoryobserve.physica.. 1.0000 0.7500 0.8571 4\ntype:justice.arrestjaildetain.arrestja.. 1.0000 0.3750 0.5455 8\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.3333 0.5000 6\ntype:justice.initiatejudicialprocess.n/a 1.0000 0.5000 0.6667 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 0.3750 0.5455 8\ntype:justice.investigate.investigatecr.. 1.0000 0.5000 0.6667 8\ntype:justice.investigate.n/a 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.conv.. 1.0000 0.1250 0.2222 8\ntype:justice.judicialconsequences.exec.. 1.0000 0.4000 0.5714 5\ntype:justice.judicialconsequences.extr.. 0.0000 0.0000 0.0000 2\ntype:justice.judicialconsequences.n/a 1.0000 0.3333 0.5000 6\ntype:life.die.deathcausedbyviolentevents 1.0000 0.6279 0.7714 43\ntype:life.die.n/a 1.0000 0.5000 0.6667 20\ntype:life.die.nonviolentdeath 1.0000 0.7000 0.8235 10\ntype:life.injure.illnessdegradationhun.. 1.0000 0.7500 0.8571 8\ntype:life.injure.illnessdegradationphy.. 1.0000 0.6000 0.7500 5\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.3462 0.5143 26\ntype:life.injure.n/a 1.0000 0.4800 0.6486 25\ntype:manufacture.artifact.build 1.0000 0.6667 0.8000 3\ntype:manufacture.artifact.createintell.. 0.0000 0.0000 0.0000 1\ntype:manufacture.artifact.createmanufa.. 0.0000 0.0000 0.0000 4\ntype:manufacture.artifact.n/a 1.0000 0.3333 0.5000 6\ntype:movement.transportartifact.bringc.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.fall 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.grante.. 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.hide 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.n/a 1.0000 0.6250 0.7692 8\ntype:movement.transportartifact.nonvio.. 0.0000 0.0000 0.0000 1\ntype:movement.transportartifact.preven.. 1.0000 0.6667 0.8000 3\ntype:movement.transportartifact.preven.. 1.0000 0.2000 0.3333 5\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 1\ntype:movement.transportartifact.sendsu.. 1.0000 0.6000 0.7500 5\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 0.3333 0.5000 3\ntype:movement.transportperson.evacuati.. 1.0000 0.4444 0.6154 9\ntype:movement.transportperson.grantent.. 1.0000 0.7500 0.8571 4\ntype:movement.transportperson.n/a 1.0000 0.3333 0.5000 9\ntype:movement.transportperson.prevente.. 1.0000 0.4000 0.5714 5\ntype:movement.transportperson.prevente.. 1.0000 0.3333 0.5000 9\ntype:movement.transportperson.selfmotion 1.0000 0.5000 0.6667 8\ntype:movement.transportperson.smugglee.. 1.0000 0.5000 0.6667 2\ntype:personnel.elect.n/a 1.0000 0.3333 0.5000 3\ntype:personnel.elect.winelection 0.0000 0.0000 0.0000 2\ntype:personnel.endposition.firinglayoff 1.0000 0.5833 0.7368 12\ntype:personnel.endposition.n/a 1.0000 0.5000 0.6667 8\ntype:personnel.endposition.quitretire 1.0000 0.3333 0.5000 3\ntype:personnel.startposition.hiring 1.0000 0.4000 0.5714 10\ntype:personnel.startposition.n/a 0.0000 0.0000 0.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 0.4375 0.6087 16\ntype:transaction.transaction.giftgrant.. 0.0000 0.0000 0.0000 6\ntype:transaction.transaction.n/a 1.0000 0.7500 0.8571 4\ntype:transaction.transaction.transferc.. 1.0000 0.4286 0.6000 7\ntype:transaction.transfermoney.borrowl.. 1.0000 0.5000 0.6667 4\ntype:transaction.transfermoney.embargo.. 1.0000 0.8889 0.9412 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.3750 0.5455 8\ntype:transaction.transfermoney.n/a 1.0000 0.7647 0.8667 17\ntype:transaction.transfermoney.payfors.. 1.0000 0.3077 0.4706 13\ntype:transaction.transfermoney.purchase 1.0000 0.9286 0.9630 14\ntype:transaction.transferownership.bor.. 1.0000 0.7500 0.8571 8\ntype:transaction.transferownership.emb.. 1.0000 0.6429 0.7826 14\ntype:transaction.transferownership.gif.. 1.0000 0.1429 0.2500 7\ntype:transaction.transferownership.n/a 1.0000 0.5000 0.6667 14\ntype:transaction.transferownership.pur.. 1.0000 0.8462 0.9167 13\n----------------------------------------------------------------------------------\nmicro avg 0.7769 0.2146 0.3364 3974\nmacro avg 0.6251 0.3429 0.4167 3974", "eval_event_trigger_error_COR": 363, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 1, "eval_event_trigger_error_BEL": 4, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 131, "eval_event_trigger_error_FN": 528, "eval_event_trigger_fair_micro_precision": 0.7311178247734139, "eval_event_trigger_fair_micro_recall": 0.4062674874090655, "eval_event_trigger_fair_micro_f1": 0.5223021582733812, "eval_event_trigger_fair_support": 896, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 363\nLE 0\nBES 1\nBEL 4\nBEO 0\nLBE 0\nFP 131\nFN 528\n-----------------\nfair P / R / F1: 0.7311 / 0.4063 / 0.5223", "eval_event_argument_error_COR": 42, "eval_event_argument_error_LE": 0, "eval_event_argument_error_BES": 12, "eval_event_argument_error_BEL": 8, "eval_event_argument_error_BEO": 0, "eval_event_argument_error_LBE": 4, "eval_event_argument_error_FP": 110, "eval_event_argument_error_FN": 2116, "eval_event_argument_fair_micro_precision": 0.25609756097560976, "eval_event_argument_fair_micro_recall": 0.01935483870967742, "eval_event_argument_fair_micro_f1": 0.03598971722365039, "eval_event_argument_fair_support": 2182, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 42\nLE 0\nBES 12\nBEL 8\nBEO 0\nLBE 4\nFP 110\nFN 2116\n-----------------\nfair P / R / F1: 0.2561 / 0.0194 / 0.0360\n\nlabel confusions (gold -> pred):\n instrument -> artifact: 1\n place -> beneficiary: 1\n place -> participant: 1\n place -> victim: 1" } } }