{ "eval_event_type_strict_micro_precision": 1.0, "eval_event_type_strict_micro_recall": 0.9304245283018868, "eval_event_type_strict_micro_f1": 0.9639584605986561, "eval_event_type_strict_macro_precision": 0.9922480620155039, "eval_event_type_strict_macro_recall": 0.9339937424800743, "eval_event_type_strict_macro_f1": 0.9579353132577021, "eval_event_type_strict_support": 848, "eval_event_type_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7778 0.8750 9\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 5\nartifactexistence.damagedestroy.n/a 1.0000 0.8889 0.9412 9\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 3\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 4\nconflict.attack.bombing 1.0000 1.0000 1.0000 5\nconflict.attack.hanging 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 2\nconflict.attack.n/a 1.0000 0.9630 0.9811 27\nconflict.attack.selfdirectedbattle 1.0000 0.9048 0.9500 21\nconflict.attack.stabbing 1.0000 1.0000 1.0000 4\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 5\nconflict.demonstrate.n/a 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 4\nconflict.yield.retreat 1.0000 1.0000 1.0000 2\nconflict.yield.surrender 1.0000 1.0000 1.0000 2\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.meet 1.0000 1.0000 1.0000 1\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 3\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 3\ncontact.commandorder.correspondence 1.0000 0.8000 0.8889 5\ncontact.commandorder.meet 1.0000 0.7500 0.8571 4\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 1\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8750 0.9333 8\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 4\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 6\ncontact.discussion.meet 1.0000 0.9375 0.9677 16\ncontact.discussion.n/a 1.0000 1.0000 1.0000 10\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 7\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 7\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 4\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 5\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 4\ncontact.negotiate.meet 1.0000 0.8571 0.9231 7\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 0.9091 0.9524 11\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 4\ncontact.prevarication.meet 1.0000 1.0000 1.0000 6\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.6000 0.7500 5\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 10\ncontact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 8\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 10\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 7\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 3\ndisaster.accidentcrash.accidentcrash 1.0000 0.8750 0.9333 8\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 1\ngovernment.agreements.acceptagreementc.. 1.0000 0.8750 0.9333 8\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.rejectnullifyagr.. 1.0000 1.0000 1.0000 2\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 1\ngovernment.formation.mergegpe 1.0000 1.0000 1.0000 7\ngovernment.formation.n/a 1.0000 1.0000 1.0000 3\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 2\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 10\ngovernment.spy.spy 1.0000 1.0000 1.0000 9\ngovernment.vote.castvote 1.0000 1.0000 1.0000 1\ngovernment.vote.n/a 0.0000 0.0000 0.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 5\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 8\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 16\njustice.initiatejudicialprocess.charge.. 1.0000 0.8889 0.9412 9\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 5\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 7\njustice.investigate.n/a 1.0000 1.0000 1.0000 1\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 9\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.n/a 1.0000 0.7778 0.8750 9\nlife.die.deathcausedbyviolentevents 1.0000 0.9429 0.9706 35\nlife.die.n/a 1.0000 0.9375 0.9677 16\nlife.die.nonviolentdeath 1.0000 0.5000 0.6667 2\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 5\nlife.injure.illnessdegradationphysical 1.0000 0.8333 0.9091 6\nlife.injure.injurycausedbyviolentevents 1.0000 0.7895 0.8824 19\nlife.injure.n/a 1.0000 0.9444 0.9714 18\nmanufacture.artifact.build 1.0000 1.0000 1.0000 4\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 1\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 9\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 4\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 2\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 7\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 12\nmovement.transportartifact.preventexit 1.0000 0.8333 0.9091 12\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 3\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 7\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 7\nmovement.transportperson.bringcarryunl.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 5\nmovement.transportperson.fall 1.0000 1.0000 1.0000 1\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.hide 1.0000 1.0000 1.0000 3\nmovement.transportperson.n/a 1.0000 0.8571 0.9231 14\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 16\nmovement.transportperson.selfmotion 1.0000 0.7500 0.8571 4\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 6\npersonnel.elect.n/a 1.0000 1.0000 1.0000 2\npersonnel.elect.winelection 1.0000 1.0000 1.0000 4\npersonnel.endposition.firinglayoff 1.0000 0.7778 0.8750 9\npersonnel.endposition.n/a 1.0000 0.6667 0.8000 6\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 5\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 5\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 5\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8000 0.8889 5\ntransaction.transaction.n/a 1.0000 0.8571 0.9231 7\ntransaction.transaction.transfercontrol 1.0000 0.8182 0.9000 11\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 7\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.8000 0.8889 5\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 14\ntransaction.transfermoney.payforservice 1.0000 0.9091 0.9524 11\ntransaction.transfermoney.purchase 1.0000 0.7857 0.8800 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 12\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.9091 0.9524 11\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 9\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9304 0.9640 848\nmacro avg 0.9922 0.9340 0.9579 848", "eval_event_type_relaxed_micro_precision": 1.0, "eval_event_type_relaxed_micro_recall": 0.9304245283018868, "eval_event_type_relaxed_micro_f1": 0.9639584605986561, "eval_event_type_relaxed_macro_precision": 0.9922480620155039, "eval_event_type_relaxed_macro_recall": 0.9339937424800743, "eval_event_type_relaxed_macro_f1": 0.9579353132577021, "eval_event_type_relaxed_support": 848, "eval_event_type_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 1.0000 0.7778 0.8750 9\nartifactexistence.damagedestroy.destroy 1.0000 1.0000 1.0000 5\nartifactexistence.damagedestroy.n/a 1.0000 0.8889 0.9412 9\nconflict.attack.airstrikemissilestrike 1.0000 1.0000 1.0000 3\nconflict.attack.biologicalchemicalpois.. 1.0000 1.0000 1.0000 4\nconflict.attack.bombing 1.0000 1.0000 1.0000 5\nconflict.attack.hanging 1.0000 1.0000 1.0000 2\nconflict.attack.invade 1.0000 1.0000 1.0000 2\nconflict.attack.n/a 1.0000 0.9630 0.9811 27\nconflict.attack.selfdirectedbattle 1.0000 0.9048 0.9500 21\nconflict.attack.stabbing 1.0000 1.0000 1.0000 4\nconflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\nconflict.demonstrate.marchprotestpolit.. 1.0000 1.0000 1.0000 5\nconflict.demonstrate.n/a 1.0000 1.0000 1.0000 2\nconflict.yield.n/a 1.0000 1.0000 1.0000 4\nconflict.yield.retreat 1.0000 1.0000 1.0000 2\nconflict.yield.surrender 1.0000 1.0000 1.0000 2\ncontact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ncontact.collaborate.meet 1.0000 1.0000 1.0000 1\ncontact.collaborate.n/a 1.0000 1.0000 1.0000 3\ncontact.commandorder.broadcast 1.0000 1.0000 1.0000 3\ncontact.commandorder.correspondence 1.0000 0.8000 0.8889 5\ncontact.commandorder.meet 1.0000 0.7500 0.8571 4\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 1\ncontact.commitmentpromiseexpressintent.. 1.0000 0.8750 0.9333 8\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 2\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 5\ncontact.commitmentpromiseexpressintent.. 1.0000 1.0000 1.0000 4\ncontact.discussion.correspondence 1.0000 1.0000 1.0000 6\ncontact.discussion.meet 1.0000 0.9375 0.9677 16\ncontact.discussion.n/a 1.0000 1.0000 1.0000 10\ncontact.funeralvigil.meet 1.0000 1.0000 1.0000 7\ncontact.funeralvigil.n/a 1.0000 1.0000 1.0000 7\ncontact.mediastatement.broadcast 1.0000 1.0000 1.0000 4\ncontact.mediastatement.n/a 1.0000 1.0000 1.0000 5\ncontact.negotiate.correspondence 1.0000 1.0000 1.0000 4\ncontact.negotiate.meet 1.0000 0.8571 0.9231 7\ncontact.negotiate.n/a 1.0000 1.0000 1.0000 1\ncontact.prevarication.broadcast 1.0000 0.9091 0.9524 11\ncontact.prevarication.correspondence 1.0000 1.0000 1.0000 4\ncontact.prevarication.meet 1.0000 1.0000 1.0000 6\ncontact.prevarication.n/a 1.0000 1.0000 1.0000 4\ncontact.publicstatementinperson.broadc.. 1.0000 0.6000 0.7500 5\ncontact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 10\ncontact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ncontact.requestadvise.correspondence 1.0000 1.0000 1.0000 8\ncontact.requestadvise.meet 1.0000 1.0000 1.0000 10\ncontact.requestadvise.n/a 1.0000 1.0000 1.0000 7\ncontact.threatencoerce.broadcast 1.0000 1.0000 1.0000 5\ncontact.threatencoerce.correspondence 1.0000 1.0000 1.0000 6\ncontact.threatencoerce.meet 1.0000 1.0000 1.0000 4\ncontact.threatencoerce.n/a 1.0000 1.0000 1.0000 3\ndisaster.accidentcrash.accidentcrash 1.0000 0.8750 0.9333 8\ndisaster.fireexplosion.fireexplosion 1.0000 1.0000 1.0000 1\ngovernment.agreements.acceptagreementc.. 1.0000 0.8750 0.9333 8\ngovernment.agreements.n/a 1.0000 1.0000 1.0000 3\ngovernment.agreements.rejectnullifyagr.. 1.0000 1.0000 1.0000 2\ngovernment.agreements.violateagreement 1.0000 1.0000 1.0000 1\ngovernment.formation.mergegpe 1.0000 1.0000 1.0000 7\ngovernment.formation.n/a 1.0000 1.0000 1.0000 3\ngovernment.formation.startgpe 1.0000 1.0000 1.0000 2\ngovernment.legislate.legislate 1.0000 1.0000 1.0000 10\ngovernment.spy.spy 1.0000 1.0000 1.0000 9\ngovernment.vote.castvote 1.0000 1.0000 1.0000 1\ngovernment.vote.n/a 0.0000 0.0000 0.0000 2\ninspection.sensoryobserve.inspectpeopl.. 1.0000 1.0000 1.0000 6\ninspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 5\ninspection.sensoryobserve.physicalinve.. 1.0000 1.0000 1.0000 8\njustice.arrestjaildetain.arrestjaildet.. 1.0000 1.0000 1.0000 16\njustice.initiatejudicialprocess.charge.. 1.0000 0.8889 0.9412 9\njustice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\njustice.initiatejudicialprocess.trialh.. 1.0000 1.0000 1.0000 5\njustice.investigate.investigatecrime 1.0000 1.0000 1.0000 7\njustice.investigate.n/a 1.0000 1.0000 1.0000 1\njustice.judicialconsequences.execute 1.0000 1.0000 1.0000 9\njustice.judicialconsequences.extradite 1.0000 1.0000 1.0000 5\njustice.judicialconsequences.n/a 1.0000 0.7778 0.8750 9\nlife.die.deathcausedbyviolentevents 1.0000 0.9429 0.9706 35\nlife.die.n/a 1.0000 0.9375 0.9677 16\nlife.die.nonviolentdeath 1.0000 0.5000 0.6667 2\nlife.injure.illnessdegradationhungerth.. 1.0000 1.0000 1.0000 5\nlife.injure.illnessdegradationphysical 1.0000 0.8333 0.9091 6\nlife.injure.injurycausedbyviolentevents 1.0000 0.7895 0.8824 19\nlife.injure.n/a 1.0000 0.9444 0.9714 18\nmanufacture.artifact.build 1.0000 1.0000 1.0000 4\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 1\nmanufacture.artifact.n/a 1.0000 1.0000 1.0000 9\nmovement.transportartifact.bringcarryu.. 1.0000 1.0000 1.0000 4\nmovement.transportartifact.dispersesep.. 1.0000 1.0000 1.0000 5\nmovement.transportartifact.fall 1.0000 1.0000 1.0000 2\nmovement.transportartifact.grantentry 1.0000 0.5000 0.6667 2\nmovement.transportartifact.hide 1.0000 1.0000 1.0000 7\nmovement.transportartifact.n/a 1.0000 1.0000 1.0000 12\nmovement.transportartifact.preventexit 1.0000 0.8333 0.9091 12\nmovement.transportartifact.receiveimport 1.0000 1.0000 1.0000 3\nmovement.transportartifact.sendsupplye.. 1.0000 1.0000 1.0000 7\nmovement.transportartifact.smuggleextr.. 1.0000 1.0000 1.0000 7\nmovement.transportperson.bringcarryunl.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.dispersesepar.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.evacuationres.. 1.0000 1.0000 1.0000 5\nmovement.transportperson.fall 1.0000 1.0000 1.0000 1\nmovement.transportperson.grantentryasy.. 1.0000 1.0000 1.0000 3\nmovement.transportperson.hide 1.0000 1.0000 1.0000 3\nmovement.transportperson.n/a 1.0000 0.8571 0.9231 14\nmovement.transportperson.preventexit 1.0000 1.0000 1.0000 16\nmovement.transportperson.selfmotion 1.0000 0.7500 0.8571 4\nmovement.transportperson.smuggleextract 1.0000 1.0000 1.0000 6\npersonnel.elect.n/a 1.0000 1.0000 1.0000 2\npersonnel.elect.winelection 1.0000 1.0000 1.0000 4\npersonnel.endposition.firinglayoff 1.0000 0.7778 0.8750 9\npersonnel.endposition.n/a 1.0000 0.6667 0.8000 6\npersonnel.endposition.quitretire 1.0000 1.0000 1.0000 5\npersonnel.startposition.hiring 1.0000 1.0000 1.0000 5\npersonnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntransaction.transaction.embargosanction 1.0000 1.0000 1.0000 5\ntransaction.transaction.giftgrantprovi.. 1.0000 0.8000 0.8889 5\ntransaction.transaction.n/a 1.0000 0.8571 0.9231 7\ntransaction.transaction.transfercontrol 1.0000 0.8182 0.9000 11\ntransaction.transfermoney.borrowlend 1.0000 1.0000 1.0000 7\ntransaction.transfermoney.embargosanct.. 1.0000 0.8889 0.9412 9\ntransaction.transfermoney.giftgrantpro.. 1.0000 0.8000 0.8889 5\ntransaction.transfermoney.n/a 1.0000 1.0000 1.0000 14\ntransaction.transfermoney.payforservice 1.0000 0.9091 0.9524 11\ntransaction.transfermoney.purchase 1.0000 0.7857 0.8800 14\ntransaction.transferownership.borrowlend 1.0000 1.0000 1.0000 4\ntransaction.transferownership.embargos.. 1.0000 1.0000 1.0000 12\ntransaction.transferownership.giftgran.. 1.0000 0.8571 0.9231 7\ntransaction.transferownership.n/a 1.0000 0.9091 0.9524 11\ntransaction.transferownership.purchase 1.0000 1.0000 1.0000 9\n----------------------------------------------------------------------------------\nmicro avg 1.0000 0.9304 0.9640 848\nmacro avg 0.9922 0.9340 0.9579 848", "eval_event_trigger_strict_micro_precision": 0.4816076294277929, "eval_event_trigger_strict_micro_recall": 0.8337264150943396, "eval_event_trigger_strict_micro_f1": 0.6105354058721933, "eval_event_trigger_strict_macro_precision": 0.5175045049417714, "eval_event_trigger_strict_macro_recall": 0.844028254411771, "eval_event_trigger_strict_macro_f1": 0.6251255582141785, "eval_event_trigger_strict_support": 848, "eval_event_trigger_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.5385 0.7778 0.6364 9\nartifactexistence.damagedestroy.destroy 0.5000 1.0000 0.6667 5\nartifactexistence.damagedestroy.n/a 0.4000 0.6667 0.5000 9\nconflict.attack.airstrikemissilestrike 0.6000 1.0000 0.7500 3\nconflict.attack.biologicalchemicalpois.. 0.5714 1.0000 0.7273 4\nconflict.attack.bombing 0.6250 1.0000 0.7692 5\nconflict.attack.hanging 0.3333 1.0000 0.5000 2\nconflict.attack.invade 0.1667 0.5000 0.2500 2\nconflict.attack.n/a 0.4510 0.8519 0.5897 27\nconflict.attack.selfdirectedbattle 0.3590 0.6667 0.4667 21\nconflict.attack.stabbing 0.5714 1.0000 0.7273 4\nconflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\nconflict.demonstrate.marchprotestpolit.. 0.3000 0.6000 0.4000 5\nconflict.demonstrate.n/a 0.5000 1.0000 0.6667 2\nconflict.yield.n/a 0.4444 1.0000 0.6154 4\nconflict.yield.retreat 0.5000 1.0000 0.6667 2\nconflict.yield.surrender 0.5000 0.5000 0.5000 2\ncontact.collaborate.correspondence 0.2727 0.4286 0.3333 7\ncontact.collaborate.meet 0.0000 0.0000 0.0000 1\ncontact.collaborate.n/a 0.3000 1.0000 0.4615 3\ncontact.commandorder.broadcast 0.7500 1.0000 0.8571 3\ncontact.commandorder.correspondence 0.3750 0.6000 0.4615 5\ncontact.commandorder.meet 0.3333 0.7500 0.4615 4\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 1\ncontact.commitmentpromiseexpressintent.. 0.5000 0.8750 0.6364 8\ncontact.commitmentpromiseexpressintent.. 0.3333 1.0000 0.5000 2\ncontact.commitmentpromiseexpressintent.. 0.7143 1.0000 0.8333 5\ncontact.commitmentpromiseexpressintent.. 0.4444 1.0000 0.6154 4\ncontact.discussion.correspondence 0.4615 1.0000 0.6316 6\ncontact.discussion.meet 0.3250 0.8125 0.4643 16\ncontact.discussion.n/a 0.4737 0.9000 0.6207 10\ncontact.funeralvigil.meet 0.4545 0.7143 0.5556 7\ncontact.funeralvigil.n/a 0.5833 1.0000 0.7368 7\ncontact.mediastatement.broadcast 0.8000 1.0000 0.8889 4\ncontact.mediastatement.n/a 0.5000 1.0000 0.6667 5\ncontact.negotiate.correspondence 0.3333 1.0000 0.5000 4\ncontact.negotiate.meet 0.4167 0.7143 0.5263 7\ncontact.negotiate.n/a 0.3333 1.0000 0.5000 1\ncontact.prevarication.broadcast 0.5294 0.8182 0.6429 11\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 4\ncontact.prevarication.meet 0.4615 1.0000 0.6316 6\ncontact.prevarication.n/a 0.3636 1.0000 0.5333 4\ncontact.publicstatementinperson.broadc.. 0.5000 0.4000 0.4444 5\ncontact.publicstatementinperson.n/a 0.4615 0.6000 0.5217 10\ncontact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ncontact.requestadvise.correspondence 0.5714 1.0000 0.7273 8\ncontact.requestadvise.meet 0.4706 0.8000 0.5926 10\ncontact.requestadvise.n/a 0.7500 0.8571 0.8000 7\ncontact.threatencoerce.broadcast 0.5000 0.8000 0.6154 5\ncontact.threatencoerce.correspondence 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.meet 0.8000 1.0000 0.8889 4\ncontact.threatencoerce.n/a 0.4286 1.0000 0.6000 3\ndisaster.accidentcrash.accidentcrash 0.3125 0.6250 0.4167 8\ndisaster.fireexplosion.fireexplosion 0.3333 1.0000 0.5000 1\ngovernment.agreements.acceptagreementc.. 0.6364 0.8750 0.7368 8\ngovernment.agreements.n/a 0.6000 1.0000 0.7500 3\ngovernment.agreements.rejectnullifyagr.. 0.3333 1.0000 0.5000 2\ngovernment.agreements.violateagreement 0.2500 1.0000 0.4000 1\ngovernment.formation.mergegpe 0.5000 0.8571 0.6316 7\ngovernment.formation.n/a 1.0000 1.0000 1.0000 3\ngovernment.formation.startgpe 0.0000 0.0000 0.0000 2\ngovernment.legislate.legislate 0.3462 0.9000 0.5000 10\ngovernment.spy.spy 0.5714 0.8889 0.6957 9\ngovernment.vote.castvote 0.5000 1.0000 0.6667 1\ngovernment.vote.n/a 0.0000 0.0000 0.0000 2\ninspection.sensoryobserve.inspectpeopl.. 0.7500 1.0000 0.8571 6\ninspection.sensoryobserve.n/a 0.5556 1.0000 0.7143 5\ninspection.sensoryobserve.physicalinve.. 0.6667 1.0000 0.8000 8\njustice.arrestjaildetain.arrestjaildet.. 0.6957 1.0000 0.8205 16\njustice.initiatejudicialprocess.charge.. 0.3077 0.4444 0.3636 9\njustice.initiatejudicialprocess.n/a 0.7500 0.7500 0.7500 4\njustice.initiatejudicialprocess.trialh.. 0.3333 0.8000 0.4706 5\njustice.investigate.investigatecrime 0.2500 0.5714 0.3478 7\njustice.investigate.n/a 0.5000 1.0000 0.6667 1\njustice.judicialconsequences.execute 0.4286 1.0000 0.6000 9\njustice.judicialconsequences.extradite 0.5556 1.0000 0.7143 5\njustice.judicialconsequences.n/a 0.4375 0.7778 0.5600 9\nlife.die.deathcausedbyviolentevents 0.4143 0.8286 0.5524 35\nlife.die.n/a 0.6818 0.9375 0.7895 16\nlife.die.nonviolentdeath 1.0000 0.5000 0.6667 2\nlife.injure.illnessdegradationhungerth.. 0.4545 1.0000 0.6250 5\nlife.injure.illnessdegradationphysical 0.5000 0.8333 0.6250 6\nlife.injure.injurycausedbyviolentevents 0.3793 0.5789 0.4583 19\nlife.injure.n/a 0.4103 0.8889 0.5614 18\nmanufacture.artifact.build 0.4444 1.0000 0.6154 4\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 1\nmanufacture.artifact.n/a 0.4167 0.5556 0.4762 9\nmovement.transportartifact.bringcarryu.. 0.6667 1.0000 0.8000 4\nmovement.transportartifact.dispersesep.. 0.6250 1.0000 0.7692 5\nmovement.transportartifact.fall 0.6667 1.0000 0.8000 2\nmovement.transportartifact.grantentry 0.3333 0.5000 0.4000 2\nmovement.transportartifact.hide 0.5833 1.0000 0.7368 7\nmovement.transportartifact.n/a 0.5238 0.9167 0.6667 12\nmovement.transportartifact.preventexit 0.3913 0.7500 0.5143 12\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 3\nmovement.transportartifact.sendsupplye.. 0.6000 0.8571 0.7059 7\nmovement.transportartifact.smuggleextr.. 0.5833 1.0000 0.7368 7\nmovement.transportperson.bringcarryunl.. 0.5000 0.6667 0.5714 3\nmovement.transportperson.dispersesepar.. 0.7500 1.0000 0.8571 3\nmovement.transportperson.evacuationres.. 0.5556 1.0000 0.7143 5\nmovement.transportperson.fall 1.0000 1.0000 1.0000 1\nmovement.transportperson.grantentryasy.. 0.4286 1.0000 0.6000 3\nmovement.transportperson.hide 0.7500 1.0000 0.8571 3\nmovement.transportperson.n/a 0.5000 0.7143 0.5882 14\nmovement.transportperson.preventexit 0.4828 0.8750 0.6222 16\nmovement.transportperson.selfmotion 0.6000 0.7500 0.6667 4\nmovement.transportperson.smuggleextract 0.4167 0.8333 0.5556 6\npersonnel.elect.n/a 1.0000 1.0000 1.0000 2\npersonnel.elect.winelection 0.5000 1.0000 0.6667 4\npersonnel.endposition.firinglayoff 0.3889 0.7778 0.5185 9\npersonnel.endposition.n/a 0.5714 0.6667 0.6154 6\npersonnel.endposition.quitretire 0.6667 0.8000 0.7273 5\npersonnel.startposition.hiring 0.6250 1.0000 0.7692 5\npersonnel.startposition.n/a 0.5714 1.0000 0.7273 4\ntransaction.transaction.embargosanction 0.7143 1.0000 0.8333 5\ntransaction.transaction.giftgrantprovi.. 0.5000 0.6000 0.5455 5\ntransaction.transaction.n/a 0.5455 0.8571 0.6667 7\ntransaction.transaction.transfercontrol 0.7273 0.7273 0.7273 11\ntransaction.transfermoney.borrowlend 0.4667 1.0000 0.6364 7\ntransaction.transfermoney.embargosanct.. 0.5000 0.8889 0.6400 9\ntransaction.transfermoney.giftgrantpro.. 0.6667 0.8000 0.7273 5\ntransaction.transfermoney.n/a 0.6364 1.0000 0.7778 14\ntransaction.transfermoney.payforservice 0.3684 0.6364 0.4667 11\ntransaction.transfermoney.purchase 0.4762 0.7143 0.5714 14\ntransaction.transferownership.borrowlend 0.4444 1.0000 0.6154 4\ntransaction.transferownership.embargos.. 0.6316 1.0000 0.7742 12\ntransaction.transferownership.giftgran.. 0.4000 0.5714 0.4706 7\ntransaction.transferownership.n/a 0.5263 0.9091 0.6667 11\ntransaction.transferownership.purchase 0.6154 0.8889 0.7273 9\n----------------------------------------------------------------------------------\nmicro avg 0.4816 0.8337 0.6105 848\nmacro avg 0.5175 0.8440 0.6251 848", "eval_event_trigger_relaxed_micro_precision": 0.48365122615803813, "eval_event_trigger_relaxed_micro_recall": 0.8372641509433962, "eval_event_trigger_relaxed_micro_f1": 0.613126079447323, "eval_event_trigger_relaxed_macro_precision": 0.5195532314091025, "eval_event_trigger_relaxed_macro_recall": 0.849417697010516, "eval_event_trigger_relaxed_macro_f1": 0.6280725251146339, "eval_event_trigger_relaxed_support": 848, "eval_event_trigger_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifactexistence.damagedestroy.damage 0.5385 0.7778 0.6364 9\nartifactexistence.damagedestroy.destroy 0.5000 1.0000 0.6667 5\nartifactexistence.damagedestroy.n/a 0.4000 0.6667 0.5000 9\nconflict.attack.airstrikemissilestrike 0.6000 1.0000 0.7500 3\nconflict.attack.biologicalchemicalpois.. 0.5714 1.0000 0.7273 4\nconflict.attack.bombing 0.6250 1.0000 0.7692 5\nconflict.attack.hanging 0.3333 1.0000 0.5000 2\nconflict.attack.invade 0.3333 1.0000 0.5000 2\nconflict.attack.n/a 0.4510 0.8519 0.5897 27\nconflict.attack.selfdirectedbattle 0.3590 0.6667 0.4667 21\nconflict.attack.stabbing 0.5714 1.0000 0.7273 4\nconflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\nconflict.demonstrate.marchprotestpolit.. 0.3000 0.6000 0.4000 5\nconflict.demonstrate.n/a 0.5000 1.0000 0.6667 2\nconflict.yield.n/a 0.4444 1.0000 0.6154 4\nconflict.yield.retreat 0.5000 1.0000 0.6667 2\nconflict.yield.surrender 0.5000 0.5000 0.5000 2\ncontact.collaborate.correspondence 0.2727 0.4286 0.3333 7\ncontact.collaborate.meet 0.0000 0.0000 0.0000 1\ncontact.collaborate.n/a 0.3000 1.0000 0.4615 3\ncontact.commandorder.broadcast 0.7500 1.0000 0.8571 3\ncontact.commandorder.correspondence 0.3750 0.6000 0.4615 5\ncontact.commandorder.meet 0.3333 0.7500 0.4615 4\ncontact.commandorder.n/a 1.0000 1.0000 1.0000 1\ncontact.commitmentpromiseexpressintent.. 0.5000 0.8750 0.6364 8\ncontact.commitmentpromiseexpressintent.. 0.3333 1.0000 0.5000 2\ncontact.commitmentpromiseexpressintent.. 0.7143 1.0000 0.8333 5\ncontact.commitmentpromiseexpressintent.. 0.4444 1.0000 0.6154 4\ncontact.discussion.correspondence 0.4615 1.0000 0.6316 6\ncontact.discussion.meet 0.3250 0.8125 0.4643 16\ncontact.discussion.n/a 0.4737 0.9000 0.6207 10\ncontact.funeralvigil.meet 0.4545 0.7143 0.5556 7\ncontact.funeralvigil.n/a 0.5833 1.0000 0.7368 7\ncontact.mediastatement.broadcast 0.8000 1.0000 0.8889 4\ncontact.mediastatement.n/a 0.5000 1.0000 0.6667 5\ncontact.negotiate.correspondence 0.3333 1.0000 0.5000 4\ncontact.negotiate.meet 0.4167 0.7143 0.5263 7\ncontact.negotiate.n/a 0.3333 1.0000 0.5000 1\ncontact.prevarication.broadcast 0.5294 0.8182 0.6429 11\ncontact.prevarication.correspondence 0.5000 1.0000 0.6667 4\ncontact.prevarication.meet 0.4615 1.0000 0.6316 6\ncontact.prevarication.n/a 0.3636 1.0000 0.5333 4\ncontact.publicstatementinperson.broadc.. 0.5000 0.4000 0.4444 5\ncontact.publicstatementinperson.n/a 0.4615 0.6000 0.5217 10\ncontact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ncontact.requestadvise.correspondence 0.5714 1.0000 0.7273 8\ncontact.requestadvise.meet 0.4706 0.8000 0.5926 10\ncontact.requestadvise.n/a 0.7500 0.8571 0.8000 7\ncontact.threatencoerce.broadcast 0.5000 0.8000 0.6154 5\ncontact.threatencoerce.correspondence 0.6667 1.0000 0.8000 6\ncontact.threatencoerce.meet 0.8000 1.0000 0.8889 4\ncontact.threatencoerce.n/a 0.4286 1.0000 0.6000 3\ndisaster.accidentcrash.accidentcrash 0.3125 0.6250 0.4167 8\ndisaster.fireexplosion.fireexplosion 0.3333 1.0000 0.5000 1\ngovernment.agreements.acceptagreementc.. 0.6364 0.8750 0.7368 8\ngovernment.agreements.n/a 0.6000 1.0000 0.7500 3\ngovernment.agreements.rejectnullifyagr.. 0.3333 1.0000 0.5000 2\ngovernment.agreements.violateagreement 0.2500 1.0000 0.4000 1\ngovernment.formation.mergegpe 0.5000 0.8571 0.6316 7\ngovernment.formation.n/a 1.0000 1.0000 1.0000 3\ngovernment.formation.startgpe 0.0000 0.0000 0.0000 2\ngovernment.legislate.legislate 0.3462 0.9000 0.5000 10\ngovernment.spy.spy 0.5714 0.8889 0.6957 9\ngovernment.vote.castvote 0.5000 1.0000 0.6667 1\ngovernment.vote.n/a 0.0000 0.0000 0.0000 2\ninspection.sensoryobserve.inspectpeopl.. 0.7500 1.0000 0.8571 6\ninspection.sensoryobserve.n/a 0.5556 1.0000 0.7143 5\ninspection.sensoryobserve.physicalinve.. 0.6667 1.0000 0.8000 8\njustice.arrestjaildetain.arrestjaildet.. 0.6957 1.0000 0.8205 16\njustice.initiatejudicialprocess.charge.. 0.3077 0.4444 0.3636 9\njustice.initiatejudicialprocess.n/a 0.7500 0.7500 0.7500 4\njustice.initiatejudicialprocess.trialh.. 0.3333 0.8000 0.4706 5\njustice.investigate.investigatecrime 0.2500 0.5714 0.3478 7\njustice.investigate.n/a 0.5000 1.0000 0.6667 1\njustice.judicialconsequences.execute 0.4286 1.0000 0.6000 9\njustice.judicialconsequences.extradite 0.5556 1.0000 0.7143 5\njustice.judicialconsequences.n/a 0.4375 0.7778 0.5600 9\nlife.die.deathcausedbyviolentevents 0.4286 0.8571 0.5714 35\nlife.die.n/a 0.6818 0.9375 0.7895 16\nlife.die.nonviolentdeath 1.0000 0.5000 0.6667 2\nlife.injure.illnessdegradationhungerth.. 0.4545 1.0000 0.6250 5\nlife.injure.illnessdegradationphysical 0.5000 0.8333 0.6250 6\nlife.injure.injurycausedbyviolentevents 0.3793 0.5789 0.4583 19\nlife.injure.n/a 0.4103 0.8889 0.5614 18\nmanufacture.artifact.build 0.4444 1.0000 0.6154 4\nmanufacture.artifact.createmanufacture 1.0000 1.0000 1.0000 1\nmanufacture.artifact.n/a 0.4167 0.5556 0.4762 9\nmovement.transportartifact.bringcarryu.. 0.6667 1.0000 0.8000 4\nmovement.transportartifact.dispersesep.. 0.6250 1.0000 0.7692 5\nmovement.transportartifact.fall 0.6667 1.0000 0.8000 2\nmovement.transportartifact.grantentry 0.3333 0.5000 0.4000 2\nmovement.transportartifact.hide 0.5833 1.0000 0.7368 7\nmovement.transportartifact.n/a 0.5238 0.9167 0.6667 12\nmovement.transportartifact.preventexit 0.3913 0.7500 0.5143 12\nmovement.transportartifact.receiveimport 0.5000 1.0000 0.6667 3\nmovement.transportartifact.sendsupplye.. 0.6000 0.8571 0.7059 7\nmovement.transportartifact.smuggleextr.. 0.5833 1.0000 0.7368 7\nmovement.transportperson.bringcarryunl.. 0.5000 0.6667 0.5714 3\nmovement.transportperson.dispersesepar.. 0.7500 1.0000 0.8571 3\nmovement.transportperson.evacuationres.. 0.5556 1.0000 0.7143 5\nmovement.transportperson.fall 1.0000 1.0000 1.0000 1\nmovement.transportperson.grantentryasy.. 0.4286 1.0000 0.6000 3\nmovement.transportperson.hide 0.7500 1.0000 0.8571 3\nmovement.transportperson.n/a 0.5000 0.7143 0.5882 14\nmovement.transportperson.preventexit 0.4828 0.8750 0.6222 16\nmovement.transportperson.selfmotion 0.6000 0.7500 0.6667 4\nmovement.transportperson.smuggleextract 0.5000 1.0000 0.6667 6\npersonnel.elect.n/a 1.0000 1.0000 1.0000 2\npersonnel.elect.winelection 0.5000 1.0000 0.6667 4\npersonnel.endposition.firinglayoff 0.3889 0.7778 0.5185 9\npersonnel.endposition.n/a 0.5714 0.6667 0.6154 6\npersonnel.endposition.quitretire 0.6667 0.8000 0.7273 5\npersonnel.startposition.hiring 0.6250 1.0000 0.7692 5\npersonnel.startposition.n/a 0.5714 1.0000 0.7273 4\ntransaction.transaction.embargosanction 0.7143 1.0000 0.8333 5\ntransaction.transaction.giftgrantprovi.. 0.5000 0.6000 0.5455 5\ntransaction.transaction.n/a 0.5455 0.8571 0.6667 7\ntransaction.transaction.transfercontrol 0.7273 0.7273 0.7273 11\ntransaction.transfermoney.borrowlend 0.4667 1.0000 0.6364 7\ntransaction.transfermoney.embargosanct.. 0.5000 0.8889 0.6400 9\ntransaction.transfermoney.giftgrantpro.. 0.6667 0.8000 0.7273 5\ntransaction.transfermoney.n/a 0.6364 1.0000 0.7778 14\ntransaction.transfermoney.payforservice 0.3684 0.6364 0.4667 11\ntransaction.transfermoney.purchase 0.4762 0.7143 0.5714 14\ntransaction.transferownership.borrowlend 0.4444 1.0000 0.6154 4\ntransaction.transferownership.embargos.. 0.6316 1.0000 0.7742 12\ntransaction.transferownership.giftgran.. 0.4000 0.5714 0.4706 7\ntransaction.transferownership.n/a 0.5263 0.9091 0.6667 11\ntransaction.transferownership.purchase 0.6154 0.8889 0.7273 9\n----------------------------------------------------------------------------------\nmicro avg 0.4837 0.8373 0.6131 848\nmacro avg 0.5196 0.8494 0.6281 848", "eval_event_argument_strict_micro_precision": 0.030853658536585366, "eval_event_argument_strict_micro_recall": 0.12549603174603174, "eval_event_argument_strict_micro_f1": 0.0495301487862177, "eval_event_argument_strict_macro_precision": 0.027612906859354597, "eval_event_argument_strict_macro_recall": 0.12061940497673622, "eval_event_argument_strict_macro_f1": 0.04436084699594964, "eval_event_argument_strict_support": 2016, "eval_event_argument_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.0372 0.1610 0.0604 118\nartifactmoney 0.0588 0.3333 0.1000 3\nattacker 0.0410 0.1786 0.0667 56\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0189 0.0882 0.0311 68\ncandidate 0.0833 0.2857 0.1290 7\ncommunicator 0.0299 0.1855 0.0515 124\ncrashobject 0.0000 0.0000 0.0000 3\ncrime 0.0612 0.0938 0.0741 32\ndamager 0.0606 0.2500 0.0976 8\ndamagerdestroyer 0.0435 0.1667 0.0690 6\ndeceased 0.0333 0.1111 0.0513 9\ndefendant 0.0156 0.1000 0.0269 40\ndemonstrator 0.0000 0.0000 0.0000 5\ndestination 0.0563 0.1379 0.0800 58\ndestroyer 0.0000 0.0000 0.0000 4\ndetainee 0.0588 0.3125 0.0990 16\ndriverpassenger 0.0000 0.0000 0.0000 4\nemployee 0.0588 0.3077 0.0988 26\nexecutioner 0.0000 0.0000 0.0000 5\nextraditer 0.0588 0.2000 0.0909 5\nfireexplosionobject 0.0000 0.0000 0.0000 1\nfounder 0.0909 0.4000 0.1481 5\ngiver 0.0231 0.0870 0.0364 92\ngovernmentbody 0.0244 0.1111 0.0400 9\ngpe 0.0000 0.0000 0.0000 5\ngranter 0.0000 0.0000 0.0000 3\nhidingplace 0.0000 0.0000 0.0000 3\ninjurer 0.0164 0.0645 0.0261 31\ninspectedentity 0.0317 0.1429 0.0519 14\ninspector 0.0488 0.2000 0.0784 10\ninstrument 0.0000 0.0000 0.0000 51\ninvestigator 0.0278 0.1429 0.0465 7\njailer 0.0488 0.2500 0.0816 8\njudgecourt 0.0167 0.1111 0.0290 9\nkiller 0.0163 0.0952 0.0278 21\nlaw 0.0000 0.0000 0.0000 10\nmanufacturer 0.0536 0.2727 0.0896 11\nmoney 0.0000 0.0000 0.0000 21\nobservedentity 0.0000 0.0000 0.0000 9\nobserver 0.0588 0.2500 0.0952 4\norigin 0.0394 0.1212 0.0595 66\notherparticipant 0.0000 0.0000 0.0000 1\nparticipant 0.0157 0.0709 0.0258 141\npassenger 0.0208 0.0930 0.0340 43\nplace 0.0532 0.1546 0.0792 317\nplaceofemployment 0.0222 0.0476 0.0303 21\npreventer 0.0360 0.1250 0.0559 40\nprosecutor 0.0441 0.2500 0.0750 12\nrecipient 0.0295 0.1271 0.0479 181\nrejecternullifier 0.0000 0.0000 0.0000 2\nresult 0.0000 0.0000 0.0000 1\nretreater 0.0000 0.0000 0.0000 2\nspy 0.0000 0.0000 0.0000 9\nsurrenderer 0.1000 0.5000 0.1667 2\ntarget 0.0071 0.0308 0.0116 65\nterritoryorfacility 0.0625 0.3333 0.1053 3\ntransporter 0.0290 0.1282 0.0473 78\nvehicle 0.0244 0.1000 0.0392 20\nvictim 0.0297 0.1446 0.0493 83\nviolator 0.0000 0.0000 0.0000 1\nvoter 0.0000 0.0000 0.0000 3\nyielder 0.0526 0.3333 0.0909 3\n----------------------------------------------------------------------------------\nmicro avg 0.0309 0.1255 0.0495 2016\nmacro avg 0.0276 0.1206 0.0444 2016", "eval_event_argument_relaxed_micro_precision": 0.1326829268292683, "eval_event_argument_relaxed_micro_recall": 0.5396825396825397, "eval_event_argument_relaxed_micro_f1": 0.2129992169146437, "eval_event_argument_relaxed_macro_precision": 0.11988096655809263, "eval_event_argument_relaxed_macro_recall": 0.5076642609127299, "eval_event_argument_relaxed_macro_f1": 0.19063993382189792, "eval_event_argument_relaxed_support": 2016, "eval_event_argument_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\nartifact 0.1037 0.4492 0.1685 118\nartifactmoney 0.1765 1.0000 0.3000 3\nattacker 0.1270 0.5536 0.2067 56\nballot 0.0000 0.0000 0.0000 1\nbeneficiary 0.0943 0.4412 0.1554 68\ncandidate 0.0833 0.2857 0.1290 7\ncommunicator 0.1053 0.6532 0.1814 124\ncrashobject 0.1000 0.3333 0.1538 3\ncrime 0.2041 0.3125 0.2469 32\ndamager 0.0909 0.3750 0.1463 8\ndamagerdestroyer 0.0870 0.3333 0.1379 6\ndeceased 0.1000 0.3333 0.1538 9\ndefendant 0.0739 0.4750 0.1279 40\ndemonstrator 0.1429 0.4000 0.2105 5\ndestination 0.2817 0.6897 0.4000 58\ndestroyer 0.2500 1.0000 0.4000 4\ndetainee 0.1294 0.6875 0.2178 16\ndriverpassenger 0.2143 0.7500 0.3333 4\nemployee 0.1324 0.6923 0.2222 26\nexecutioner 0.1111 0.4000 0.1739 5\nextraditer 0.1765 0.6000 0.2727 5\nfireexplosionobject 0.0000 0.0000 0.0000 1\nfounder 0.1364 0.6000 0.2222 5\ngiver 0.0951 0.3587 0.1503 92\ngovernmentbody 0.0976 0.4444 0.1600 9\ngpe 0.0455 0.2000 0.0741 5\ngranter 0.0588 0.3333 0.1000 3\nhidingplace 0.0000 0.0000 0.0000 3\ninjurer 0.1230 0.4839 0.1961 31\ninspectedentity 0.0794 0.3571 0.1299 14\ninspector 0.1220 0.5000 0.1961 10\ninstrument 0.2254 0.3137 0.2623 51\ninvestigator 0.1389 0.7143 0.2326 7\njailer 0.1463 0.7500 0.2449 8\njudgecourt 0.1333 0.8889 0.2319 9\nkiller 0.1138 0.6667 0.1944 21\nlaw 0.0625 0.3000 0.1034 10\nmanufacturer 0.0714 0.3636 0.1194 11\nmoney 0.0274 0.0952 0.0426 21\nobservedentity 0.1282 0.5556 0.2083 9\nobserver 0.1765 0.7500 0.2857 4\norigin 0.2217 0.6818 0.3346 66\notherparticipant 0.2000 1.0000 0.3333 1\nparticipant 0.1543 0.6950 0.2526 141\npassenger 0.1250 0.5581 0.2043 43\nplace 0.2128 0.6183 0.3166 317\nplaceofemployment 0.0667 0.1429 0.0909 21\npreventer 0.1295 0.4500 0.2011 40\nprosecutor 0.1471 0.8333 0.2500 12\nrecipient 0.1179 0.5083 0.1915 181\nrejecternullifier 0.0000 0.0000 0.0000 2\nresult 0.0000 0.0000 0.0000 1\nretreater 0.0769 0.5000 0.1333 2\nspy 0.1000 0.4444 0.1633 9\nsurrenderer 0.2000 1.0000 0.3333 2\ntarget 0.1036 0.4462 0.1681 65\nterritoryorfacility 0.1875 1.0000 0.3158 3\ntransporter 0.1188 0.5256 0.1939 78\nvehicle 0.1220 0.5000 0.1961 20\nvictim 0.1312 0.6386 0.2177 83\nviolator 0.1667 1.0000 0.2857 1\nvoter 0.1000 0.3333 0.1538 3\nyielder 0.1053 0.6667 0.1818 3\n----------------------------------------------------------------------------------\nmicro avg 0.1327 0.5397 0.2130 2016\nmacro avg 0.1199 0.5077 0.1906 2016", "eval_event_strict_micro_precision": 0.16725638328392464, "eval_event_strict_micro_recall": 0.47117456896551724, "eval_event_strict_micro_f1": 0.24687698496718188, "eval_event_strict_macro_precision": 0.6121423497496195, "eval_event_strict_macro_recall": 0.7382051716902882, "eval_event_strict_macro_f1": 0.6448896753290264, "eval_event_strict_support": 3712, "eval_event_strict_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.0372 0.1610 0.0604 118\narg:artifactmoney 0.0588 0.3333 0.1000 3\narg:attacker 0.0410 0.1786 0.0667 56\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0189 0.0882 0.0311 68\narg:candidate 0.0833 0.2857 0.1290 7\narg:communicator 0.0299 0.1855 0.0515 124\narg:crashobject 0.0000 0.0000 0.0000 3\narg:crime 0.0612 0.0938 0.0741 32\narg:damager 0.0606 0.2500 0.0976 8\narg:damagerdestroyer 0.0435 0.1667 0.0690 6\narg:deceased 0.0333 0.1111 0.0513 9\narg:defendant 0.0156 0.1000 0.0269 40\narg:demonstrator 0.0000 0.0000 0.0000 5\narg:destination 0.0563 0.1379 0.0800 58\narg:destroyer 0.0000 0.0000 0.0000 4\narg:detainee 0.0588 0.3125 0.0990 16\narg:driverpassenger 0.0000 0.0000 0.0000 4\narg:employee 0.0588 0.3077 0.0988 26\narg:executioner 0.0000 0.0000 0.0000 5\narg:extraditer 0.0588 0.2000 0.0909 5\narg:fireexplosionobject 0.0000 0.0000 0.0000 1\narg:founder 0.0909 0.4000 0.1481 5\narg:giver 0.0231 0.0870 0.0364 92\narg:governmentbody 0.0244 0.1111 0.0400 9\narg:gpe 0.0000 0.0000 0.0000 5\narg:granter 0.0000 0.0000 0.0000 3\narg:hidingplace 0.0000 0.0000 0.0000 3\narg:injurer 0.0164 0.0645 0.0261 31\narg:inspectedentity 0.0317 0.1429 0.0519 14\narg:inspector 0.0488 0.2000 0.0784 10\narg:instrument 0.0000 0.0000 0.0000 51\narg:investigator 0.0278 0.1429 0.0465 7\narg:jailer 0.0488 0.2500 0.0816 8\narg:judgecourt 0.0167 0.1111 0.0290 9\narg:killer 0.0163 0.0952 0.0278 21\narg:law 0.0000 0.0000 0.0000 10\narg:manufacturer 0.0536 0.2727 0.0896 11\narg:money 0.0000 0.0000 0.0000 21\narg:observedentity 0.0000 0.0000 0.0000 9\narg:observer 0.0588 0.2500 0.0952 4\narg:origin 0.0394 0.1212 0.0595 66\narg:otherparticipant 0.0000 0.0000 0.0000 1\narg:participant 0.0157 0.0709 0.0258 141\narg:passenger 0.0208 0.0930 0.0340 43\narg:place 0.0532 0.1546 0.0792 317\narg:placeofemployment 0.0222 0.0476 0.0303 21\narg:preventer 0.0360 0.1250 0.0559 40\narg:prosecutor 0.0441 0.2500 0.0750 12\narg:recipient 0.0295 0.1271 0.0479 181\narg:rejecternullifier 0.0000 0.0000 0.0000 2\narg:result 0.0000 0.0000 0.0000 1\narg:retreater 0.0000 0.0000 0.0000 2\narg:spy 0.0000 0.0000 0.0000 9\narg:surrenderer 0.1000 0.5000 0.1667 2\narg:target 0.0071 0.0308 0.0116 65\narg:territoryorfacility 0.0625 0.3333 0.1053 3\narg:transporter 0.0290 0.1282 0.0473 78\narg:vehicle 0.0244 0.1000 0.0392 20\narg:victim 0.0297 0.1446 0.0493 83\narg:violator 0.0000 0.0000 0.0000 1\narg:voter 0.0000 0.0000 0.0000 3\narg:yielder 0.0526 0.3333 0.0909 3\ntrigger:artifactexistence.damagedestro.. 0.5385 0.7778 0.6364 9\ntrigger:artifactexistence.damagedestro.. 0.5000 1.0000 0.6667 5\ntrigger:artifactexistence.damagedestro.. 0.4000 0.6667 0.5000 9\ntrigger:conflict.attack.airstrikemissi.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.biologicalchem.. 0.5714 1.0000 0.7273 4\ntrigger:conflict.attack.bombing 0.6250 1.0000 0.7692 5\ntrigger:conflict.attack.hanging 0.3333 1.0000 0.5000 2\ntrigger:conflict.attack.invade 0.1667 0.5000 0.2500 2\ntrigger:conflict.attack.n/a 0.4510 0.8519 0.5897 27\ntrigger:conflict.attack.selfdirectedba.. 0.3590 0.6667 0.4667 21\ntrigger:conflict.attack.stabbing 0.5714 1.0000 0.7273 4\ntrigger:conflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\ntrigger:conflict.demonstrate.marchprot.. 0.3000 0.6000 0.4000 5\ntrigger:conflict.demonstrate.n/a 0.5000 1.0000 0.6667 2\ntrigger:conflict.yield.n/a 0.4444 1.0000 0.6154 4\ntrigger:conflict.yield.retreat 0.5000 1.0000 0.6667 2\ntrigger:conflict.yield.surrender 0.5000 0.5000 0.5000 2\ntrigger:contact.collaborate.correspond.. 0.2727 0.4286 0.3333 7\ntrigger:contact.collaborate.meet 0.0000 0.0000 0.0000 1\ntrigger:contact.collaborate.n/a 0.3000 1.0000 0.4615 3\ntrigger:contact.commandorder.broadcast 0.7500 1.0000 0.8571 3\ntrigger:contact.commandorder.correspon.. 0.3750 0.6000 0.4615 5\ntrigger:contact.commandorder.meet 0.3333 0.7500 0.4615 4\ntrigger:contact.commandorder.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.8750 0.6364 8\ntrigger:contact.commitmentpromiseexpre.. 0.3333 1.0000 0.5000 2\ntrigger:contact.commitmentpromiseexpre.. 0.7143 1.0000 0.8333 5\ntrigger:contact.commitmentpromiseexpre.. 0.4444 1.0000 0.6154 4\ntrigger:contact.discussion.corresponde.. 0.4615 1.0000 0.6316 6\ntrigger:contact.discussion.meet 0.3250 0.8125 0.4643 16\ntrigger:contact.discussion.n/a 0.4737 0.9000 0.6207 10\ntrigger:contact.funeralvigil.meet 0.4545 0.7143 0.5556 7\ntrigger:contact.funeralvigil.n/a 0.5833 1.0000 0.7368 7\ntrigger:contact.mediastatement.broadcast 0.8000 1.0000 0.8889 4\ntrigger:contact.mediastatement.n/a 0.5000 1.0000 0.6667 5\ntrigger:contact.negotiate.correspondence 0.3333 1.0000 0.5000 4\ntrigger:contact.negotiate.meet 0.4167 0.7143 0.5263 7\ntrigger:contact.negotiate.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.prevarication.broadcast 0.5294 0.8182 0.6429 11\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 4\ntrigger:contact.prevarication.meet 0.4615 1.0000 0.6316 6\ntrigger:contact.prevarication.n/a 0.3636 1.0000 0.5333 4\ntrigger:contact.publicstatementinperso.. 0.5000 0.4000 0.4444 5\ntrigger:contact.publicstatementinperso.. 0.4615 0.6000 0.5217 10\ntrigger:contact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ntrigger:contact.requestadvise.correspo.. 0.5714 1.0000 0.7273 8\ntrigger:contact.requestadvise.meet 0.4706 0.8000 0.5926 10\ntrigger:contact.requestadvise.n/a 0.7500 0.8571 0.8000 7\ntrigger:contact.threatencoerce.broadcast 0.5000 0.8000 0.6154 5\ntrigger:contact.threatencoerce.corresp.. 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.meet 0.8000 1.0000 0.8889 4\ntrigger:contact.threatencoerce.n/a 0.4286 1.0000 0.6000 3\ntrigger:disaster.accidentcrash.acciden.. 0.3125 0.6250 0.4167 8\ntrigger:disaster.fireexplosion.fireexp.. 0.3333 1.0000 0.5000 1\ntrigger:government.agreements.acceptag.. 0.6364 0.8750 0.7368 8\ntrigger:government.agreements.n/a 0.6000 1.0000 0.7500 3\ntrigger:government.agreements.rejectnu.. 0.3333 1.0000 0.5000 2\ntrigger:government.agreements.violatea.. 0.2500 1.0000 0.4000 1\ntrigger:government.formation.mergegpe 0.5000 0.8571 0.6316 7\ntrigger:government.formation.n/a 1.0000 1.0000 1.0000 3\ntrigger:government.formation.startgpe 0.0000 0.0000 0.0000 2\ntrigger:government.legislate.legislate 0.3462 0.9000 0.5000 10\ntrigger:government.spy.spy 0.5714 0.8889 0.6957 9\ntrigger:government.vote.castvote 0.5000 1.0000 0.6667 1\ntrigger:government.vote.n/a 0.0000 0.0000 0.0000 2\ntrigger:inspection.sensoryobserve.insp.. 0.7500 1.0000 0.8571 6\ntrigger:inspection.sensoryobserve.n/a 0.5556 1.0000 0.7143 5\ntrigger:inspection.sensoryobserve.phys.. 0.6667 1.0000 0.8000 8\ntrigger:justice.arrestjaildetain.arres.. 0.6957 1.0000 0.8205 16\ntrigger:justice.initiatejudicialproces.. 0.3077 0.4444 0.3636 9\ntrigger:justice.initiatejudicialproces.. 0.7500 0.7500 0.7500 4\ntrigger:justice.initiatejudicialproces.. 0.3333 0.8000 0.4706 5\ntrigger:justice.investigate.investigat.. 0.2500 0.5714 0.3478 7\ntrigger:justice.investigate.n/a 0.5000 1.0000 0.6667 1\ntrigger:justice.judicialconsequences.e.. 0.4286 1.0000 0.6000 9\ntrigger:justice.judicialconsequences.e.. 0.5556 1.0000 0.7143 5\ntrigger:justice.judicialconsequences.n/a 0.4375 0.7778 0.5600 9\ntrigger:life.die.deathcausedbyviolente.. 0.4143 0.8286 0.5524 35\ntrigger:life.die.n/a 0.6818 0.9375 0.7895 16\ntrigger:life.die.nonviolentdeath 1.0000 0.5000 0.6667 2\ntrigger:life.injure.illnessdegradation.. 0.4545 1.0000 0.6250 5\ntrigger:life.injure.illnessdegradation.. 0.5000 0.8333 0.6250 6\ntrigger:life.injure.injurycausedbyviol.. 0.3793 0.5789 0.4583 19\ntrigger:life.injure.n/a 0.4103 0.8889 0.5614 18\ntrigger:manufacture.artifact.build 0.4444 1.0000 0.6154 4\ntrigger:manufacture.artifact.createman.. 1.0000 1.0000 1.0000 1\ntrigger:manufacture.artifact.n/a 0.4167 0.5556 0.4762 9\ntrigger:movement.transportartifact.bri.. 0.6667 1.0000 0.8000 4\ntrigger:movement.transportartifact.dis.. 0.6250 1.0000 0.7692 5\ntrigger:movement.transportartifact.fall 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.gra.. 0.3333 0.5000 0.4000 2\ntrigger:movement.transportartifact.hide 0.5833 1.0000 0.7368 7\ntrigger:movement.transportartifact.n/a 0.5238 0.9167 0.6667 12\ntrigger:movement.transportartifact.pre.. 0.3913 0.7500 0.5143 12\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportartifact.sen.. 0.6000 0.8571 0.7059 7\ntrigger:movement.transportartifact.smu.. 0.5833 1.0000 0.7368 7\ntrigger:movement.transportperson.bring.. 0.5000 0.6667 0.5714 3\ntrigger:movement.transportperson.dispe.. 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.evacu.. 0.5556 1.0000 0.7143 5\ntrigger:movement.transportperson.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportperson.grant.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportperson.hide 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.n/a 0.5000 0.7143 0.5882 14\ntrigger:movement.transportperson.preve.. 0.4828 0.8750 0.6222 16\ntrigger:movement.transportperson.selfm.. 0.6000 0.7500 0.6667 4\ntrigger:movement.transportperson.smugg.. 0.4167 0.8333 0.5556 6\ntrigger:personnel.elect.n/a 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.winelection 0.5000 1.0000 0.6667 4\ntrigger:personnel.endposition.firingla.. 0.3889 0.7778 0.5185 9\ntrigger:personnel.endposition.n/a 0.5714 0.6667 0.6154 6\ntrigger:personnel.endposition.quitretire 0.6667 0.8000 0.7273 5\ntrigger:personnel.startposition.hiring 0.6250 1.0000 0.7692 5\ntrigger:personnel.startposition.n/a 0.5714 1.0000 0.7273 4\ntrigger:transaction.transaction.embarg.. 0.7143 1.0000 0.8333 5\ntrigger:transaction.transaction.giftgr.. 0.5000 0.6000 0.5455 5\ntrigger:transaction.transaction.n/a 0.5455 0.8571 0.6667 7\ntrigger:transaction.transaction.transf.. 0.7273 0.7273 0.7273 11\ntrigger:transaction.transfermoney.borr.. 0.4667 1.0000 0.6364 7\ntrigger:transaction.transfermoney.emba.. 0.5000 0.8889 0.6400 9\ntrigger:transaction.transfermoney.gift.. 0.6667 0.8000 0.7273 5\ntrigger:transaction.transfermoney.n/a 0.6364 1.0000 0.7778 14\ntrigger:transaction.transfermoney.payf.. 0.3684 0.6364 0.4667 11\ntrigger:transaction.transfermoney.purc.. 0.4762 0.7143 0.5714 14\ntrigger:transaction.transferownership... 0.4444 1.0000 0.6154 4\ntrigger:transaction.transferownership... 0.6316 1.0000 0.7742 12\ntrigger:transaction.transferownership... 0.4000 0.5714 0.4706 7\ntrigger:transaction.transferownership... 0.5263 0.9091 0.6667 11\ntrigger:transaction.transferownership... 0.6154 0.8889 0.7273 9\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.7778 0.8750 9\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 5\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8889 0.9412 9\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 5\ntype:conflict.attack.hanging 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 2\ntype:conflict.attack.n/a 1.0000 0.9630 0.9811 27\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9048 0.9500 21\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 4\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.n/a 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 4\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 2\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 2\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.meet 1.0000 1.0000 1.0000 1\ntype:contact.collaborate.n/a 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.correspondence 1.0000 0.8000 0.8889 5\ntype:contact.commandorder.meet 1.0000 0.7500 0.8571 4\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 1\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8750 0.9333 8\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 4\ntype:contact.discussion.correspondence 1.0000 1.0000 1.0000 6\ntype:contact.discussion.meet 1.0000 0.9375 0.9677 16\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 10\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 7\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 7\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 5\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 4\ntype:contact.negotiate.meet 1.0000 0.8571 0.9231 7\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.9091 0.9524 11\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 4\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 6\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.6000 0.7500 5\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 10\ntype:contact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 8\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 7\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 3\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.8750 0.9333 8\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 1\ntype:government.agreements.acceptagree.. 1.0000 0.8750 0.9333 8\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.rejectnulli.. 1.0000 1.0000 1.0000 2\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 1\ntype:government.formation.mergegpe 1.0000 1.0000 1.0000 7\ntype:government.formation.n/a 1.0000 1.0000 1.0000 3\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 2\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 10\ntype:government.spy.spy 1.0000 1.0000 1.0000 9\ntype:government.vote.castvote 1.0000 1.0000 1.0000 1\ntype:government.vote.n/a 0.0000 0.0000 0.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 5\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 8\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 16\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.8889 0.9412 9\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 5\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 7\ntype:justice.investigate.n/a 1.0000 1.0000 1.0000 1\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 9\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.n/a 1.0000 0.7778 0.8750 9\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9429 0.9706 35\ntype:life.die.n/a 1.0000 0.9375 0.9677 16\ntype:life.die.nonviolentdeath 1.0000 0.5000 0.6667 2\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 5\ntype:life.injure.illnessdegradationphy.. 1.0000 0.8333 0.9091 6\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.7895 0.8824 19\ntype:life.injure.n/a 1.0000 0.9444 0.9714 18\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 4\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.grante.. 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 7\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 12\ntype:movement.transportartifact.preven.. 1.0000 0.8333 0.9091 12\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 7\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 7\ntype:movement.transportperson.bringcar.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.hide 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.n/a 1.0000 0.8571 0.9231 14\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 16\ntype:movement.transportperson.selfmotion 1.0000 0.7500 0.8571 4\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 6\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 2\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 4\ntype:personnel.endposition.firinglayoff 1.0000 0.7778 0.8750 9\ntype:personnel.endposition.n/a 1.0000 0.6667 0.8000 6\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 5\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 5\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 5\ntype:transaction.transaction.giftgrant.. 1.0000 0.8000 0.8889 5\ntype:transaction.transaction.n/a 1.0000 0.8571 0.9231 7\ntype:transaction.transaction.transferc.. 1.0000 0.8182 0.9000 11\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 7\ntype:transaction.transfermoney.embargo.. 1.0000 0.8889 0.9412 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.8000 0.8889 5\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transfermoney.payfors.. 1.0000 0.9091 0.9524 11\ntype:transaction.transfermoney.purchase 1.0000 0.7857 0.8800 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 4\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 12\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.9091 0.9524 11\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 9\n----------------------------------------------------------------------------------\nmicro avg 0.1673 0.4712 0.2469 3712\nmacro avg 0.6121 0.7382 0.6449 3712", "eval_event_relaxed_micro_precision": 0.24739409008319785, "eval_event_relaxed_micro_recall": 0.6969288793103449, "eval_event_relaxed_micro_f1": 0.3651633848542593, "eval_event_relaxed_macro_precision": 0.631074354345589, "eval_event_relaxed_macro_recall": 0.816333096983764, "eval_event_relaxed_macro_f1": 0.6747829500959844, "eval_event_relaxed_support": 3712, "eval_event_relaxed_classification_report": "label precision recall f1 support\n----------------------------------------------------------------------------------\narg:artifact 0.1037 0.4492 0.1685 118\narg:artifactmoney 0.1765 1.0000 0.3000 3\narg:attacker 0.1270 0.5536 0.2067 56\narg:ballot 0.0000 0.0000 0.0000 1\narg:beneficiary 0.0943 0.4412 0.1554 68\narg:candidate 0.0833 0.2857 0.1290 7\narg:communicator 0.1053 0.6532 0.1814 124\narg:crashobject 0.1000 0.3333 0.1538 3\narg:crime 0.2041 0.3125 0.2469 32\narg:damager 0.0909 0.3750 0.1463 8\narg:damagerdestroyer 0.0870 0.3333 0.1379 6\narg:deceased 0.1000 0.3333 0.1538 9\narg:defendant 0.0739 0.4750 0.1279 40\narg:demonstrator 0.1429 0.4000 0.2105 5\narg:destination 0.2817 0.6897 0.4000 58\narg:destroyer 0.2500 1.0000 0.4000 4\narg:detainee 0.1294 0.6875 0.2178 16\narg:driverpassenger 0.2143 0.7500 0.3333 4\narg:employee 0.1324 0.6923 0.2222 26\narg:executioner 0.1111 0.4000 0.1739 5\narg:extraditer 0.1765 0.6000 0.2727 5\narg:fireexplosionobject 0.0000 0.0000 0.0000 1\narg:founder 0.1364 0.6000 0.2222 5\narg:giver 0.0951 0.3587 0.1503 92\narg:governmentbody 0.0976 0.4444 0.1600 9\narg:gpe 0.0455 0.2000 0.0741 5\narg:granter 0.0588 0.3333 0.1000 3\narg:hidingplace 0.0000 0.0000 0.0000 3\narg:injurer 0.1230 0.4839 0.1961 31\narg:inspectedentity 0.0794 0.3571 0.1299 14\narg:inspector 0.1220 0.5000 0.1961 10\narg:instrument 0.2254 0.3137 0.2623 51\narg:investigator 0.1389 0.7143 0.2326 7\narg:jailer 0.1463 0.7500 0.2449 8\narg:judgecourt 0.1333 0.8889 0.2319 9\narg:killer 0.1138 0.6667 0.1944 21\narg:law 0.0625 0.3000 0.1034 10\narg:manufacturer 0.0714 0.3636 0.1194 11\narg:money 0.0274 0.0952 0.0426 21\narg:observedentity 0.1282 0.5556 0.2083 9\narg:observer 0.1765 0.7500 0.2857 4\narg:origin 0.2217 0.6818 0.3346 66\narg:otherparticipant 0.2000 1.0000 0.3333 1\narg:participant 0.1543 0.6950 0.2526 141\narg:passenger 0.1250 0.5581 0.2043 43\narg:place 0.2128 0.6183 0.3166 317\narg:placeofemployment 0.0667 0.1429 0.0909 21\narg:preventer 0.1295 0.4500 0.2011 40\narg:prosecutor 0.1471 0.8333 0.2500 12\narg:recipient 0.1179 0.5083 0.1915 181\narg:rejecternullifier 0.0000 0.0000 0.0000 2\narg:result 0.0000 0.0000 0.0000 1\narg:retreater 0.0769 0.5000 0.1333 2\narg:spy 0.1000 0.4444 0.1633 9\narg:surrenderer 0.2000 1.0000 0.3333 2\narg:target 0.1036 0.4462 0.1681 65\narg:territoryorfacility 0.1875 1.0000 0.3158 3\narg:transporter 0.1188 0.5256 0.1939 78\narg:vehicle 0.1220 0.5000 0.1961 20\narg:victim 0.1312 0.6386 0.2177 83\narg:violator 0.1667 1.0000 0.2857 1\narg:voter 0.1000 0.3333 0.1538 3\narg:yielder 0.1053 0.6667 0.1818 3\ntrigger:artifactexistence.damagedestro.. 0.5385 0.7778 0.6364 9\ntrigger:artifactexistence.damagedestro.. 0.5000 1.0000 0.6667 5\ntrigger:artifactexistence.damagedestro.. 0.4000 0.6667 0.5000 9\ntrigger:conflict.attack.airstrikemissi.. 0.6000 1.0000 0.7500 3\ntrigger:conflict.attack.biologicalchem.. 0.5714 1.0000 0.7273 4\ntrigger:conflict.attack.bombing 0.6250 1.0000 0.7692 5\ntrigger:conflict.attack.hanging 0.3333 1.0000 0.5000 2\ntrigger:conflict.attack.invade 0.3333 1.0000 0.5000 2\ntrigger:conflict.attack.n/a 0.4510 0.8519 0.5897 27\ntrigger:conflict.attack.selfdirectedba.. 0.3590 0.6667 0.4667 21\ntrigger:conflict.attack.stabbing 0.5714 1.0000 0.7273 4\ntrigger:conflict.attack.stealrobhijack 0.3750 0.6000 0.4615 5\ntrigger:conflict.demonstrate.marchprot.. 0.3000 0.6000 0.4000 5\ntrigger:conflict.demonstrate.n/a 0.5000 1.0000 0.6667 2\ntrigger:conflict.yield.n/a 0.4444 1.0000 0.6154 4\ntrigger:conflict.yield.retreat 0.5000 1.0000 0.6667 2\ntrigger:conflict.yield.surrender 0.5000 0.5000 0.5000 2\ntrigger:contact.collaborate.correspond.. 0.2727 0.4286 0.3333 7\ntrigger:contact.collaborate.meet 0.0000 0.0000 0.0000 1\ntrigger:contact.collaborate.n/a 0.3000 1.0000 0.4615 3\ntrigger:contact.commandorder.broadcast 0.7500 1.0000 0.8571 3\ntrigger:contact.commandorder.correspon.. 0.3750 0.6000 0.4615 5\ntrigger:contact.commandorder.meet 0.3333 0.7500 0.4615 4\ntrigger:contact.commandorder.n/a 1.0000 1.0000 1.0000 1\ntrigger:contact.commitmentpromiseexpre.. 0.5000 0.8750 0.6364 8\ntrigger:contact.commitmentpromiseexpre.. 0.3333 1.0000 0.5000 2\ntrigger:contact.commitmentpromiseexpre.. 0.7143 1.0000 0.8333 5\ntrigger:contact.commitmentpromiseexpre.. 0.4444 1.0000 0.6154 4\ntrigger:contact.discussion.corresponde.. 0.4615 1.0000 0.6316 6\ntrigger:contact.discussion.meet 0.3250 0.8125 0.4643 16\ntrigger:contact.discussion.n/a 0.4737 0.9000 0.6207 10\ntrigger:contact.funeralvigil.meet 0.4545 0.7143 0.5556 7\ntrigger:contact.funeralvigil.n/a 0.5833 1.0000 0.7368 7\ntrigger:contact.mediastatement.broadcast 0.8000 1.0000 0.8889 4\ntrigger:contact.mediastatement.n/a 0.5000 1.0000 0.6667 5\ntrigger:contact.negotiate.correspondence 0.3333 1.0000 0.5000 4\ntrigger:contact.negotiate.meet 0.4167 0.7143 0.5263 7\ntrigger:contact.negotiate.n/a 0.3333 1.0000 0.5000 1\ntrigger:contact.prevarication.broadcast 0.5294 0.8182 0.6429 11\ntrigger:contact.prevarication.correspo.. 0.5000 1.0000 0.6667 4\ntrigger:contact.prevarication.meet 0.4615 1.0000 0.6316 6\ntrigger:contact.prevarication.n/a 0.3636 1.0000 0.5333 4\ntrigger:contact.publicstatementinperso.. 0.5000 0.4000 0.4444 5\ntrigger:contact.publicstatementinperso.. 0.4615 0.6000 0.5217 10\ntrigger:contact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ntrigger:contact.requestadvise.correspo.. 0.5714 1.0000 0.7273 8\ntrigger:contact.requestadvise.meet 0.4706 0.8000 0.5926 10\ntrigger:contact.requestadvise.n/a 0.7500 0.8571 0.8000 7\ntrigger:contact.threatencoerce.broadcast 0.5000 0.8000 0.6154 5\ntrigger:contact.threatencoerce.corresp.. 0.6667 1.0000 0.8000 6\ntrigger:contact.threatencoerce.meet 0.8000 1.0000 0.8889 4\ntrigger:contact.threatencoerce.n/a 0.4286 1.0000 0.6000 3\ntrigger:disaster.accidentcrash.acciden.. 0.3125 0.6250 0.4167 8\ntrigger:disaster.fireexplosion.fireexp.. 0.3333 1.0000 0.5000 1\ntrigger:government.agreements.acceptag.. 0.6364 0.8750 0.7368 8\ntrigger:government.agreements.n/a 0.6000 1.0000 0.7500 3\ntrigger:government.agreements.rejectnu.. 0.3333 1.0000 0.5000 2\ntrigger:government.agreements.violatea.. 0.2500 1.0000 0.4000 1\ntrigger:government.formation.mergegpe 0.5000 0.8571 0.6316 7\ntrigger:government.formation.n/a 1.0000 1.0000 1.0000 3\ntrigger:government.formation.startgpe 0.0000 0.0000 0.0000 2\ntrigger:government.legislate.legislate 0.3462 0.9000 0.5000 10\ntrigger:government.spy.spy 0.5714 0.8889 0.6957 9\ntrigger:government.vote.castvote 0.5000 1.0000 0.6667 1\ntrigger:government.vote.n/a 0.0000 0.0000 0.0000 2\ntrigger:inspection.sensoryobserve.insp.. 0.7500 1.0000 0.8571 6\ntrigger:inspection.sensoryobserve.n/a 0.5556 1.0000 0.7143 5\ntrigger:inspection.sensoryobserve.phys.. 0.6667 1.0000 0.8000 8\ntrigger:justice.arrestjaildetain.arres.. 0.6957 1.0000 0.8205 16\ntrigger:justice.initiatejudicialproces.. 0.3077 0.4444 0.3636 9\ntrigger:justice.initiatejudicialproces.. 0.7500 0.7500 0.7500 4\ntrigger:justice.initiatejudicialproces.. 0.3333 0.8000 0.4706 5\ntrigger:justice.investigate.investigat.. 0.2500 0.5714 0.3478 7\ntrigger:justice.investigate.n/a 0.5000 1.0000 0.6667 1\ntrigger:justice.judicialconsequences.e.. 0.4286 1.0000 0.6000 9\ntrigger:justice.judicialconsequences.e.. 0.5556 1.0000 0.7143 5\ntrigger:justice.judicialconsequences.n/a 0.4375 0.7778 0.5600 9\ntrigger:life.die.deathcausedbyviolente.. 0.4286 0.8571 0.5714 35\ntrigger:life.die.n/a 0.6818 0.9375 0.7895 16\ntrigger:life.die.nonviolentdeath 1.0000 0.5000 0.6667 2\ntrigger:life.injure.illnessdegradation.. 0.4545 1.0000 0.6250 5\ntrigger:life.injure.illnessdegradation.. 0.5000 0.8333 0.6250 6\ntrigger:life.injure.injurycausedbyviol.. 0.3793 0.5789 0.4583 19\ntrigger:life.injure.n/a 0.4103 0.8889 0.5614 18\ntrigger:manufacture.artifact.build 0.4444 1.0000 0.6154 4\ntrigger:manufacture.artifact.createman.. 1.0000 1.0000 1.0000 1\ntrigger:manufacture.artifact.n/a 0.4167 0.5556 0.4762 9\ntrigger:movement.transportartifact.bri.. 0.6667 1.0000 0.8000 4\ntrigger:movement.transportartifact.dis.. 0.6250 1.0000 0.7692 5\ntrigger:movement.transportartifact.fall 0.6667 1.0000 0.8000 2\ntrigger:movement.transportartifact.gra.. 0.3333 0.5000 0.4000 2\ntrigger:movement.transportartifact.hide 0.5833 1.0000 0.7368 7\ntrigger:movement.transportartifact.n/a 0.5238 0.9167 0.6667 12\ntrigger:movement.transportartifact.pre.. 0.3913 0.7500 0.5143 12\ntrigger:movement.transportartifact.rec.. 0.5000 1.0000 0.6667 3\ntrigger:movement.transportartifact.sen.. 0.6000 0.8571 0.7059 7\ntrigger:movement.transportartifact.smu.. 0.5833 1.0000 0.7368 7\ntrigger:movement.transportperson.bring.. 0.5000 0.6667 0.5714 3\ntrigger:movement.transportperson.dispe.. 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.evacu.. 0.5556 1.0000 0.7143 5\ntrigger:movement.transportperson.fall 1.0000 1.0000 1.0000 1\ntrigger:movement.transportperson.grant.. 0.4286 1.0000 0.6000 3\ntrigger:movement.transportperson.hide 0.7500 1.0000 0.8571 3\ntrigger:movement.transportperson.n/a 0.5000 0.7143 0.5882 14\ntrigger:movement.transportperson.preve.. 0.4828 0.8750 0.6222 16\ntrigger:movement.transportperson.selfm.. 0.6000 0.7500 0.6667 4\ntrigger:movement.transportperson.smugg.. 0.5000 1.0000 0.6667 6\ntrigger:personnel.elect.n/a 1.0000 1.0000 1.0000 2\ntrigger:personnel.elect.winelection 0.5000 1.0000 0.6667 4\ntrigger:personnel.endposition.firingla.. 0.3889 0.7778 0.5185 9\ntrigger:personnel.endposition.n/a 0.5714 0.6667 0.6154 6\ntrigger:personnel.endposition.quitretire 0.6667 0.8000 0.7273 5\ntrigger:personnel.startposition.hiring 0.6250 1.0000 0.7692 5\ntrigger:personnel.startposition.n/a 0.5714 1.0000 0.7273 4\ntrigger:transaction.transaction.embarg.. 0.7143 1.0000 0.8333 5\ntrigger:transaction.transaction.giftgr.. 0.5000 0.6000 0.5455 5\ntrigger:transaction.transaction.n/a 0.5455 0.8571 0.6667 7\ntrigger:transaction.transaction.transf.. 0.7273 0.7273 0.7273 11\ntrigger:transaction.transfermoney.borr.. 0.4667 1.0000 0.6364 7\ntrigger:transaction.transfermoney.emba.. 0.5000 0.8889 0.6400 9\ntrigger:transaction.transfermoney.gift.. 0.6667 0.8000 0.7273 5\ntrigger:transaction.transfermoney.n/a 0.6364 1.0000 0.7778 14\ntrigger:transaction.transfermoney.payf.. 0.3684 0.6364 0.4667 11\ntrigger:transaction.transfermoney.purc.. 0.4762 0.7143 0.5714 14\ntrigger:transaction.transferownership... 0.4444 1.0000 0.6154 4\ntrigger:transaction.transferownership... 0.6316 1.0000 0.7742 12\ntrigger:transaction.transferownership... 0.4000 0.5714 0.4706 7\ntrigger:transaction.transferownership... 0.5263 0.9091 0.6667 11\ntrigger:transaction.transferownership... 0.6154 0.8889 0.7273 9\ntype:artifactexistence.damagedestroy.d.. 1.0000 0.7778 0.8750 9\ntype:artifactexistence.damagedestroy.d.. 1.0000 1.0000 1.0000 5\ntype:artifactexistence.damagedestroy.n/a 1.0000 0.8889 0.9412 9\ntype:conflict.attack.airstrikemissiles.. 1.0000 1.0000 1.0000 3\ntype:conflict.attack.biologicalchemica.. 1.0000 1.0000 1.0000 4\ntype:conflict.attack.bombing 1.0000 1.0000 1.0000 5\ntype:conflict.attack.hanging 1.0000 1.0000 1.0000 2\ntype:conflict.attack.invade 1.0000 1.0000 1.0000 2\ntype:conflict.attack.n/a 1.0000 0.9630 0.9811 27\ntype:conflict.attack.selfdirectedbattle 1.0000 0.9048 0.9500 21\ntype:conflict.attack.stabbing 1.0000 1.0000 1.0000 4\ntype:conflict.attack.stealrobhijack 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.marchprotest.. 1.0000 1.0000 1.0000 5\ntype:conflict.demonstrate.n/a 1.0000 1.0000 1.0000 2\ntype:conflict.yield.n/a 1.0000 1.0000 1.0000 4\ntype:conflict.yield.retreat 1.0000 1.0000 1.0000 2\ntype:conflict.yield.surrender 1.0000 1.0000 1.0000 2\ntype:contact.collaborate.correspondence 1.0000 0.7143 0.8333 7\ntype:contact.collaborate.meet 1.0000 1.0000 1.0000 1\ntype:contact.collaborate.n/a 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.broadcast 1.0000 1.0000 1.0000 3\ntype:contact.commandorder.correspondence 1.0000 0.8000 0.8889 5\ntype:contact.commandorder.meet 1.0000 0.7500 0.8571 4\ntype:contact.commandorder.n/a 1.0000 1.0000 1.0000 1\ntype:contact.commitmentpromiseexpressi.. 1.0000 0.8750 0.9333 8\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 2\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 5\ntype:contact.commitmentpromiseexpressi.. 1.0000 1.0000 1.0000 4\ntype:contact.discussion.correspondence 1.0000 1.0000 1.0000 6\ntype:contact.discussion.meet 1.0000 0.9375 0.9677 16\ntype:contact.discussion.n/a 1.0000 1.0000 1.0000 10\ntype:contact.funeralvigil.meet 1.0000 1.0000 1.0000 7\ntype:contact.funeralvigil.n/a 1.0000 1.0000 1.0000 7\ntype:contact.mediastatement.broadcast 1.0000 1.0000 1.0000 4\ntype:contact.mediastatement.n/a 1.0000 1.0000 1.0000 5\ntype:contact.negotiate.correspondence 1.0000 1.0000 1.0000 4\ntype:contact.negotiate.meet 1.0000 0.8571 0.9231 7\ntype:contact.negotiate.n/a 1.0000 1.0000 1.0000 1\ntype:contact.prevarication.broadcast 1.0000 0.9091 0.9524 11\ntype:contact.prevarication.corresponde.. 1.0000 1.0000 1.0000 4\ntype:contact.prevarication.meet 1.0000 1.0000 1.0000 6\ntype:contact.prevarication.n/a 1.0000 1.0000 1.0000 4\ntype:contact.publicstatementinperson.b.. 1.0000 0.6000 0.7500 5\ntype:contact.publicstatementinperson.n/a 1.0000 0.8000 0.8889 10\ntype:contact.requestadvise.broadcast 1.0000 0.3333 0.5000 3\ntype:contact.requestadvise.corresponde.. 1.0000 1.0000 1.0000 8\ntype:contact.requestadvise.meet 1.0000 1.0000 1.0000 10\ntype:contact.requestadvise.n/a 1.0000 1.0000 1.0000 7\ntype:contact.threatencoerce.broadcast 1.0000 1.0000 1.0000 5\ntype:contact.threatencoerce.correspond.. 1.0000 1.0000 1.0000 6\ntype:contact.threatencoerce.meet 1.0000 1.0000 1.0000 4\ntype:contact.threatencoerce.n/a 1.0000 1.0000 1.0000 3\ntype:disaster.accidentcrash.accidentcr.. 1.0000 0.8750 0.9333 8\ntype:disaster.fireexplosion.fireexplos.. 1.0000 1.0000 1.0000 1\ntype:government.agreements.acceptagree.. 1.0000 0.8750 0.9333 8\ntype:government.agreements.n/a 1.0000 1.0000 1.0000 3\ntype:government.agreements.rejectnulli.. 1.0000 1.0000 1.0000 2\ntype:government.agreements.violateagre.. 1.0000 1.0000 1.0000 1\ntype:government.formation.mergegpe 1.0000 1.0000 1.0000 7\ntype:government.formation.n/a 1.0000 1.0000 1.0000 3\ntype:government.formation.startgpe 1.0000 1.0000 1.0000 2\ntype:government.legislate.legislate 1.0000 1.0000 1.0000 10\ntype:government.spy.spy 1.0000 1.0000 1.0000 9\ntype:government.vote.castvote 1.0000 1.0000 1.0000 1\ntype:government.vote.n/a 0.0000 0.0000 0.0000 2\ntype:inspection.sensoryobserve.inspect.. 1.0000 1.0000 1.0000 6\ntype:inspection.sensoryobserve.n/a 1.0000 1.0000 1.0000 5\ntype:inspection.sensoryobserve.physica.. 1.0000 1.0000 1.0000 8\ntype:justice.arrestjaildetain.arrestja.. 1.0000 1.0000 1.0000 16\ntype:justice.initiatejudicialprocess.c.. 1.0000 0.8889 0.9412 9\ntype:justice.initiatejudicialprocess.n/a 1.0000 1.0000 1.0000 4\ntype:justice.initiatejudicialprocess.t.. 1.0000 1.0000 1.0000 5\ntype:justice.investigate.investigatecr.. 1.0000 1.0000 1.0000 7\ntype:justice.investigate.n/a 1.0000 1.0000 1.0000 1\ntype:justice.judicialconsequences.exec.. 1.0000 1.0000 1.0000 9\ntype:justice.judicialconsequences.extr.. 1.0000 1.0000 1.0000 5\ntype:justice.judicialconsequences.n/a 1.0000 0.7778 0.8750 9\ntype:life.die.deathcausedbyviolentevents 1.0000 0.9429 0.9706 35\ntype:life.die.n/a 1.0000 0.9375 0.9677 16\ntype:life.die.nonviolentdeath 1.0000 0.5000 0.6667 2\ntype:life.injure.illnessdegradationhun.. 1.0000 1.0000 1.0000 5\ntype:life.injure.illnessdegradationphy.. 1.0000 0.8333 0.9091 6\ntype:life.injure.injurycausedbyviolent.. 1.0000 0.7895 0.8824 19\ntype:life.injure.n/a 1.0000 0.9444 0.9714 18\ntype:manufacture.artifact.build 1.0000 1.0000 1.0000 4\ntype:manufacture.artifact.createmanufa.. 1.0000 1.0000 1.0000 1\ntype:manufacture.artifact.n/a 1.0000 1.0000 1.0000 9\ntype:movement.transportartifact.bringc.. 1.0000 1.0000 1.0000 4\ntype:movement.transportartifact.disper.. 1.0000 1.0000 1.0000 5\ntype:movement.transportartifact.fall 1.0000 1.0000 1.0000 2\ntype:movement.transportartifact.grante.. 1.0000 0.5000 0.6667 2\ntype:movement.transportartifact.hide 1.0000 1.0000 1.0000 7\ntype:movement.transportartifact.n/a 1.0000 1.0000 1.0000 12\ntype:movement.transportartifact.preven.. 1.0000 0.8333 0.9091 12\ntype:movement.transportartifact.receiv.. 1.0000 1.0000 1.0000 3\ntype:movement.transportartifact.sendsu.. 1.0000 1.0000 1.0000 7\ntype:movement.transportartifact.smuggl.. 1.0000 1.0000 1.0000 7\ntype:movement.transportperson.bringcar.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.disperse.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.evacuati.. 1.0000 1.0000 1.0000 5\ntype:movement.transportperson.fall 1.0000 1.0000 1.0000 1\ntype:movement.transportperson.grantent.. 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.hide 1.0000 1.0000 1.0000 3\ntype:movement.transportperson.n/a 1.0000 0.8571 0.9231 14\ntype:movement.transportperson.prevente.. 1.0000 1.0000 1.0000 16\ntype:movement.transportperson.selfmotion 1.0000 0.7500 0.8571 4\ntype:movement.transportperson.smugglee.. 1.0000 1.0000 1.0000 6\ntype:personnel.elect.n/a 1.0000 1.0000 1.0000 2\ntype:personnel.elect.winelection 1.0000 1.0000 1.0000 4\ntype:personnel.endposition.firinglayoff 1.0000 0.7778 0.8750 9\ntype:personnel.endposition.n/a 1.0000 0.6667 0.8000 6\ntype:personnel.endposition.quitretire 1.0000 1.0000 1.0000 5\ntype:personnel.startposition.hiring 1.0000 1.0000 1.0000 5\ntype:personnel.startposition.n/a 1.0000 1.0000 1.0000 4\ntype:transaction.transaction.embargosa.. 1.0000 1.0000 1.0000 5\ntype:transaction.transaction.giftgrant.. 1.0000 0.8000 0.8889 5\ntype:transaction.transaction.n/a 1.0000 0.8571 0.9231 7\ntype:transaction.transaction.transferc.. 1.0000 0.8182 0.9000 11\ntype:transaction.transfermoney.borrowl.. 1.0000 1.0000 1.0000 7\ntype:transaction.transfermoney.embargo.. 1.0000 0.8889 0.9412 9\ntype:transaction.transfermoney.giftgra.. 1.0000 0.8000 0.8889 5\ntype:transaction.transfermoney.n/a 1.0000 1.0000 1.0000 14\ntype:transaction.transfermoney.payfors.. 1.0000 0.9091 0.9524 11\ntype:transaction.transfermoney.purchase 1.0000 0.7857 0.8800 14\ntype:transaction.transferownership.bor.. 1.0000 1.0000 1.0000 4\ntype:transaction.transferownership.emb.. 1.0000 1.0000 1.0000 12\ntype:transaction.transferownership.gif.. 1.0000 0.8571 0.9231 7\ntype:transaction.transferownership.n/a 1.0000 0.9091 0.9524 11\ntype:transaction.transferownership.pur.. 1.0000 1.0000 1.0000 9\n----------------------------------------------------------------------------------\nmicro avg 0.2474 0.6969 0.3652 3712\nmacro avg 0.6311 0.8163 0.6748 3712", "eval_event_trigger_error_COR": 708, "eval_event_trigger_error_LE": 0, "eval_event_trigger_error_BES": 1, "eval_event_trigger_error_BEL": 1, "eval_event_trigger_error_BEO": 0, "eval_event_trigger_error_LBE": 0, "eval_event_trigger_error_FP": 758, "eval_event_trigger_error_FN": 138, "eval_event_trigger_fair_micro_precision": 0.48261758691206547, "eval_event_trigger_fair_micro_recall": 0.8358913813459268, "eval_event_trigger_fair_micro_f1": 0.6119273984442524, "eval_event_trigger_fair_support": 848, "eval_event_trigger_error_report": "event_trigger error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 708\nLE 0\nBES 1\nBEL 1\nBEO 0\nLBE 0\nFP 758\nFN 138\n-----------------\nfair P / R / F1: 0.4826 / 0.8359 / 0.6119", "eval_event_argument_error_COR": 738, "eval_event_argument_error_LE": 37, "eval_event_argument_error_BES": 255, "eval_event_argument_error_BEL": 59, "eval_event_argument_error_BEO": 28, "eval_event_argument_error_LBE": 59, "eval_event_argument_error_FP": 7024, "eval_event_argument_error_FN": 840, "eval_event_argument_fair_micro_precision": 0.092469615336424, "eval_event_argument_fair_micro_recall": 0.41068447412353926, "eval_event_argument_fair_micro_f1": 0.1509511147473921, "eval_event_argument_fair_support": 2016, "eval_event_argument_error_report": "event_argument error analysis (Ortmann 2022, fair evaluation)\ntype count\n-----------------\nCOR 738\nLE 37\nBES 255\nBEL 59\nBEO 28\nLBE 59\nFP 7024\nFN 840\n-----------------\nfair P / R / F1: 0.0925 / 0.4107 / 0.1510\n\nlabel confusions (gold -> pred):\n recipient -> communicator: 10\n giver -> beneficiary: 5\n attacker -> place: 4\n placeofemployment -> employee: 4\n target -> attacker: 4\n transporter -> origin: 4\n crime -> defendant: 3\n giver -> place: 3\n injurer -> place: 3\n place -> attacker: 3\n place -> communicator: 3\n beneficiary -> place: 2\n communicator -> recipient: 2\n instrument -> artifact: 2\n participant -> place: 2\n place -> killer: 2\n recipient -> place: 2\n target -> place: 2\n transporter -> destination: 2\n artifact -> origin: 1\n artifact -> transporter: 1\n attacker -> instrument: 1\n communicator -> place: 1\n crime -> detainee: 1\n crime -> judgecourt: 1\n damager -> place: 1\n demonstrator -> place: 1\n employee -> place: 1\n extraditer -> defendant: 1\n giver -> artifact: 1\n giver -> recipient: 1\n instrument -> injurer: 1\n instrument -> place: 1\n law -> place: 1\n manufacturer -> artifact: 1\n money -> beneficiary: 1\n origin -> artifact: 1\n place -> beneficiary: 1\n place -> candidate: 1\n place -> deceased: 1\n place -> detainee: 1\n place -> employee: 1\n place -> instrument: 1\n place -> otherparticipant: 1\n place -> participant: 1\n place -> target: 1\n preventer -> place: 1\n prosecutor -> defendant: 1\n recipient -> artifact: 1\n recipient -> beneficiary: 1\n recipient -> preventer: 1\n victim -> injurer: 1\n victim -> place: 1" }