| INFO: 2024-07-13 13:06:42,477: llmtf.base.evaluator: Starting eval on ['darumeru/multiq', 'darumeru/parus', 'darumeru/rcb', 'darumeru/ruopenbookqa', 'darumeru/rutie', 'darumeru/ruworldtree', 'darumeru/rwsd', 'darumeru/use', 'russiannlp/rucola_custom'] |
| INFO: 2024-07-13 13:06:42,478: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:42,478: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:44,033: llmtf.base.evaluator: Starting eval on ['darumeru/rummlu'] |
| INFO: 2024-07-13 13:06:44,033: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:44,034: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:46,123: llmtf.base.darumeru/MultiQ: Loading Dataset: 3.64s |
| INFO: 2024-07-13 13:06:46,972: llmtf.base.evaluator: Starting eval on ['nlpcoreteam/rummlu'] |
| INFO: 2024-07-13 13:06:46,973: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:46,973: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:48,288: llmtf.base.evaluator: Starting eval on ['nlpcoreteam/enmmlu'] |
| INFO: 2024-07-13 13:06:48,289: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:48,289: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:49,477: llmtf.base.evaluator: Starting eval on ['daru/treewayabstractive'] |
| INFO: 2024-07-13 13:06:49,477: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:49,477: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:51,901: llmtf.base.evaluator: Starting eval on ['daru/treewayextractive'] |
| INFO: 2024-07-13 13:06:51,902: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:51,902: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:52,530: llmtf.base.darumeru/ruMMLU: Loading Dataset: 8.50s |
| INFO: 2024-07-13 13:06:54,037: llmtf.base.evaluator: Starting eval on ['darumeru/cp_sent_ru', 'darumeru/cp_sent_en', 'darumeru/cp_para_ru', 'darumeru/cp_para_en'] |
| INFO: 2024-07-13 13:06:54,038: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:06:54,038: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:06:54,152: llmtf.base.daru/treewayabstractive: Loading Dataset: 4.67s |
| INFO: 2024-07-13 13:06:57,042: llmtf.base.darumeru/cp_sent_ru: Loading Dataset: 3.00s |
| INFO: 2024-07-13 13:07:04,330: llmtf.base.daru/treewayextractive: Loading Dataset: 12.43s |
| INFO: 2024-07-13 13:08:59,119: llmtf.base.nlpcoreteam/enMMLU: Loading Dataset: 130.83s |
| INFO: 2024-07-13 13:09:01,308: llmtf.base.nlpcoreteam/ruMMLU: Loading Dataset: 134.34s |
| INFO: 2024-07-13 13:12:26,549: llmtf.base.darumeru/ruMMLU: Processing Dataset: 334.02s |
| INFO: 2024-07-13 13:12:26,569: llmtf.base.darumeru/ruMMLU: Results for darumeru/ruMMLU: |
| INFO: 2024-07-13 13:12:26,605: llmtf.base.darumeru/ruMMLU: {'acc': 0.5042402474309089} |
| INFO: 2024-07-13 13:12:26,639: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:12:26,644: llmtf.base.evaluator: |
| mean darumeru/ruMMLU |
| 0.504 0.504 |
| INFO: 2024-07-13 13:12:35,964: llmtf.base.darumeru/cp_sent_ru: Processing Dataset: 338.92s |
| INFO: 2024-07-13 13:12:35,966: llmtf.base.darumeru/cp_sent_ru: Results for darumeru/cp_sent_ru: |
| INFO: 2024-07-13 13:12:35,983: llmtf.base.darumeru/cp_sent_ru: {'symbol_per_token': 2.8293102506953463, 'len': 0.9929886396176525, 'lcs': 0.953477206492652} |
| INFO: 2024-07-13 13:12:35,984: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:12:35,984: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:12:38,582: llmtf.base.darumeru/cp_sent_en: Loading Dataset: 2.60s |
| INFO: 2024-07-13 13:13:35,377: llmtf.base.daru/treewayextractive: Processing Dataset: 391.05s |
| INFO: 2024-07-13 13:13:35,379: llmtf.base.daru/treewayextractive: Results for daru/treewayextractive: |
| INFO: 2024-07-13 13:13:35,639: llmtf.base.daru/treewayextractive: {'r-prec': 0.39700050505050505} |
| INFO: 2024-07-13 13:13:35,689: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:13:35,694: llmtf.base.evaluator: |
| mean daru/treewayextractive darumeru/cp_sent_ru darumeru/ruMMLU |
| 0.631 0.397 0.993 0.504 |
| INFO: 2024-07-13 13:13:51,410: llmtf.base.nlpcoreteam/enMMLU: Processing Dataset: 292.29s |
| INFO: 2024-07-13 13:13:51,411: llmtf.base.nlpcoreteam/enMMLU: Results for nlpcoreteam/enMMLU: |
| INFO: 2024-07-13 13:13:51,455: llmtf.base.nlpcoreteam/enMMLU: metric |
| subject |
| abstract_algebra 0.350000 |
| anatomy 0.718519 |
| astronomy 0.750000 |
| business_ethics 0.710000 |
| clinical_knowledge 0.735849 |
| college_biology 0.791667 |
| college_chemistry 0.470000 |
| college_computer_science 0.600000 |
| college_mathematics 0.300000 |
| college_medicine 0.647399 |
| college_physics 0.480392 |
| computer_security 0.760000 |
| conceptual_physics 0.561702 |
| econometrics 0.517544 |
| electrical_engineering 0.613793 |
| elementary_mathematics 0.481481 |
| formal_logic 0.523810 |
| global_facts 0.400000 |
| high_school_biology 0.803226 |
| high_school_chemistry 0.536946 |
| high_school_computer_science 0.720000 |
| high_school_european_history 0.739394 |
| high_school_geography 0.823232 |
| high_school_government_and_politics 0.865285 |
| high_school_macroeconomics 0.628205 |
| high_school_mathematics 0.370370 |
| high_school_microeconomics 0.752101 |
| high_school_physics 0.423841 |
| high_school_psychology 0.851376 |
| high_school_statistics 0.537037 |
| high_school_us_history 0.818627 |
| high_school_world_history 0.843882 |
| human_aging 0.721973 |
| human_sexuality 0.778626 |
| international_law 0.760331 |
| jurisprudence 0.796296 |
| logical_fallacies 0.785276 |
| machine_learning 0.464286 |
| management 0.805825 |
| marketing 0.893162 |
| medical_genetics 0.780000 |
| miscellaneous 0.840358 |
| moral_disputes 0.690751 |
| moral_scenarios 0.290503 |
| nutrition 0.764706 |
| philosophy 0.713826 |
| prehistory 0.697531 |
| professional_accounting 0.539007 |
| professional_law 0.479791 |
| professional_medicine 0.731618 |
| professional_psychology 0.674837 |
| public_relations 0.663636 |
| security_studies 0.718367 |
| sociology 0.825871 |
| us_foreign_policy 0.890000 |
| virology 0.487952 |
| world_religions 0.824561 |
| INFO: 2024-07-13 13:13:51,463: llmtf.base.nlpcoreteam/enMMLU: metric |
| subject |
| STEM 0.556375 |
| humanities 0.689583 |
| other (business, health, misc.) 0.698312 |
| social sciences 0.749090 |
| INFO: 2024-07-13 13:13:51,503: llmtf.base.nlpcoreteam/enMMLU: {'acc': 0.6733398878133504} |
| INFO: 2024-07-13 13:13:51,533: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:13:51,542: llmtf.base.evaluator: |
| mean daru/treewayextractive darumeru/cp_sent_ru darumeru/ruMMLU nlpcoreteam/enMMLU |
| 0.642 0.397 0.993 0.504 0.673 |
| INFO: 2024-07-13 13:15:18,855: llmtf.base.nlpcoreteam/ruMMLU: Processing Dataset: 377.54s |
| INFO: 2024-07-13 13:15:18,874: llmtf.base.nlpcoreteam/ruMMLU: Results for nlpcoreteam/ruMMLU: |
| INFO: 2024-07-13 13:15:18,919: llmtf.base.nlpcoreteam/ruMMLU: metric |
| subject |
| abstract_algebra 0.290000 |
| anatomy 0.451852 |
| astronomy 0.657895 |
| business_ethics 0.600000 |
| clinical_knowledge 0.569811 |
| college_biology 0.541667 |
| college_chemistry 0.400000 |
| college_computer_science 0.460000 |
| college_mathematics 0.320000 |
| college_medicine 0.508671 |
| college_physics 0.352941 |
| computer_security 0.570000 |
| conceptual_physics 0.489362 |
| econometrics 0.350877 |
| electrical_engineering 0.544828 |
| elementary_mathematics 0.415344 |
| formal_logic 0.396825 |
| global_facts 0.350000 |
| high_school_biology 0.641935 |
| high_school_chemistry 0.423645 |
| high_school_computer_science 0.610000 |
| high_school_european_history 0.715152 |
| high_school_geography 0.656566 |
| high_school_government_and_politics 0.595855 |
| high_school_macroeconomics 0.515385 |
| high_school_mathematics 0.340741 |
| high_school_microeconomics 0.500000 |
| high_school_physics 0.357616 |
| high_school_psychology 0.669725 |
| high_school_statistics 0.467593 |
| high_school_us_history 0.656863 |
| high_school_world_history 0.717300 |
| human_aging 0.551570 |
| human_sexuality 0.664122 |
| international_law 0.702479 |
| jurisprudence 0.592593 |
| logical_fallacies 0.527607 |
| machine_learning 0.348214 |
| management 0.660194 |
| marketing 0.700855 |
| medical_genetics 0.560000 |
| miscellaneous 0.644955 |
| moral_disputes 0.566474 |
| moral_scenarios 0.249162 |
| nutrition 0.594771 |
| philosophy 0.569132 |
| prehistory 0.555556 |
| professional_accounting 0.393617 |
| professional_law 0.354628 |
| professional_medicine 0.518382 |
| professional_psychology 0.485294 |
| public_relations 0.572727 |
| security_studies 0.620408 |
| sociology 0.706468 |
| us_foreign_policy 0.750000 |
| virology 0.421687 |
| world_religions 0.695906 |
| INFO: 2024-07-13 13:15:18,927: llmtf.base.nlpcoreteam/ruMMLU: metric |
| subject |
| STEM 0.457321 |
| humanities 0.561514 |
| other (business, health, misc.) 0.537597 |
| social sciences 0.590619 |
| INFO: 2024-07-13 13:15:18,951: llmtf.base.nlpcoreteam/ruMMLU: {'acc': 0.5367627679313186} |
| INFO: 2024-07-13 13:15:18,984: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:15:18,998: llmtf.base.evaluator: |
| mean daru/treewayextractive darumeru/cp_sent_ru darumeru/ruMMLU nlpcoreteam/enMMLU nlpcoreteam/ruMMLU |
| 0.621 0.397 0.993 0.504 0.673 0.537 |
| INFO: 2024-07-13 13:15:48,358: llmtf.base.darumeru/MultiQ: Processing Dataset: 542.23s |
| INFO: 2024-07-13 13:15:48,361: llmtf.base.darumeru/MultiQ: Results for darumeru/MultiQ: |
| INFO: 2024-07-13 13:15:48,379: llmtf.base.darumeru/MultiQ: {'f1': 0.33915052106075755, 'em': 0.20936902485659656} |
| INFO: 2024-07-13 13:15:48,384: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:15:48,384: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:15:50,766: llmtf.base.darumeru/PARus: Loading Dataset: 2.38s |
| INFO: 2024-07-13 13:15:54,325: llmtf.base.darumeru/PARus: Processing Dataset: 3.56s |
| INFO: 2024-07-13 13:15:54,326: llmtf.base.darumeru/PARus: Results for darumeru/PARus: |
| INFO: 2024-07-13 13:15:54,338: llmtf.base.darumeru/PARus: {'acc': 0.65} |
| INFO: 2024-07-13 13:15:54,339: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:15:54,339: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:15:56,401: llmtf.base.darumeru/RCB: Loading Dataset: 2.06s |
| INFO: 2024-07-13 13:16:02,241: llmtf.base.darumeru/RCB: Processing Dataset: 5.84s |
| INFO: 2024-07-13 13:16:02,243: llmtf.base.darumeru/RCB: Results for darumeru/RCB: |
| INFO: 2024-07-13 13:16:02,295: llmtf.base.darumeru/RCB: {'acc': 0.4954545454545455, 'f1_macro': 0.42697840772670775} |
| INFO: 2024-07-13 13:16:02,296: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:16:02,296: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:16:04,916: llmtf.base.darumeru/ruOpenBookQA: Loading Dataset: 2.62s |
| INFO: 2024-07-13 13:16:47,543: llmtf.base.darumeru/ruOpenBookQA: Processing Dataset: 42.62s |
| INFO: 2024-07-13 13:16:47,544: llmtf.base.darumeru/ruOpenBookQA: Results for darumeru/ruOpenBookQA: |
| INFO: 2024-07-13 13:16:47,557: llmtf.base.darumeru/ruOpenBookQA: {'acc': 0.6907216494845361, 'f1_macro': 0.6910980854343433} |
| INFO: 2024-07-13 13:16:47,563: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:16:47,564: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:16:54,322: llmtf.base.darumeru/cp_sent_en: Processing Dataset: 255.74s |
| INFO: 2024-07-13 13:16:54,324: llmtf.base.darumeru/cp_sent_en: Results for darumeru/cp_sent_en: |
| INFO: 2024-07-13 13:16:54,342: llmtf.base.darumeru/cp_sent_en: {'symbol_per_token': 4.424907714143083, 'len': 0.9996416196590585, 'lcs': 0.995460815828734} |
| INFO: 2024-07-13 13:16:54,344: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:16:54,344: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:16:55,127: llmtf.base.darumeru/ruTiE: Loading Dataset: 7.56s |
| INFO: 2024-07-13 13:16:56,721: llmtf.base.darumeru/cp_para_ru: Loading Dataset: 2.38s |
| INFO: 2024-07-13 13:21:22,963: llmtf.base.darumeru/ruTiE: Processing Dataset: 267.83s |
| INFO: 2024-07-13 13:21:22,978: llmtf.base.darumeru/ruTiE: Results for darumeru/ruTiE: |
| INFO: 2024-07-13 13:21:23,054: llmtf.base.darumeru/ruTiE: {'acc': 0.34186046511627904} |
| INFO: 2024-07-13 13:21:23,057: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:21:23,057: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:21:24,849: llmtf.base.darumeru/ruWorldTree: Loading Dataset: 1.79s |
| INFO: 2024-07-13 13:21:27,002: llmtf.base.darumeru/ruWorldTree: Processing Dataset: 2.15s |
| INFO: 2024-07-13 13:21:27,004: llmtf.base.darumeru/ruWorldTree: Results for darumeru/ruWorldTree: |
| INFO: 2024-07-13 13:21:27,027: llmtf.base.darumeru/ruWorldTree: {'acc': 0.8476190476190476, 'f1_macro': 0.8445201637796824} |
| INFO: 2024-07-13 13:21:27,028: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:21:27,028: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:21:29,323: llmtf.base.darumeru/RWSD: Loading Dataset: 2.29s |
| INFO: 2024-07-13 13:21:35,055: llmtf.base.darumeru/RWSD: Processing Dataset: 5.73s |
| INFO: 2024-07-13 13:21:35,057: llmtf.base.darumeru/RWSD: Results for darumeru/RWSD: |
| INFO: 2024-07-13 13:21:35,091: llmtf.base.darumeru/RWSD: {'acc': 0.553921568627451} |
| INFO: 2024-07-13 13:21:35,092: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:21:35,092: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:21:37,982: llmtf.base.darumeru/USE: Loading Dataset: 2.89s |
| INFO: 2024-07-13 13:21:53,199: llmtf.base.daru/treewayabstractive: Processing Dataset: 899.05s |
| INFO: 2024-07-13 13:21:53,201: llmtf.base.daru/treewayabstractive: Results for daru/treewayabstractive: |
| INFO: 2024-07-13 13:21:53,219: llmtf.base.daru/treewayabstractive: {'rouge1': 0.35674467491487294, 'rouge2': 0.12769113616404126} |
| INFO: 2024-07-13 13:21:53,221: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:21:53,266: llmtf.base.evaluator: |
| mean daru/treewayabstractive daru/treewayextractive darumeru/MultiQ darumeru/PARus darumeru/RCB darumeru/RWSD darumeru/cp_sent_en darumeru/cp_sent_ru darumeru/ruMMLU darumeru/ruOpenBookQA darumeru/ruTiE darumeru/ruWorldTree nlpcoreteam/enMMLU nlpcoreteam/ruMMLU |
| 0.583 0.242 0.397 0.274 0.650 0.461 0.554 1.000 0.993 0.504 0.691 0.342 0.846 0.673 0.537 |
| INFO: 2024-07-13 13:24:49,689: llmtf.base.darumeru/cp_para_ru: Processing Dataset: 472.97s |
| INFO: 2024-07-13 13:24:49,693: llmtf.base.darumeru/cp_para_ru: Results for darumeru/cp_para_ru: |
| INFO: 2024-07-13 13:24:49,698: llmtf.base.darumeru/cp_para_ru: {'symbol_per_token': 2.9656304047043975, 'len': 0.9936794435466832, 'lcs': 0.901150773678293} |
| INFO: 2024-07-13 13:24:49,699: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:24:49,699: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:24:51,784: llmtf.base.darumeru/cp_para_en: Loading Dataset: 2.08s |
| INFO: 2024-07-13 13:29:37,864: llmtf.base.darumeru/USE: Processing Dataset: 479.88s |
| INFO: 2024-07-13 13:29:37,867: llmtf.base.darumeru/USE: Results for darumeru/USE: |
| INFO: 2024-07-13 13:29:37,886: llmtf.base.darumeru/USE: {'grade_norm': 0.07647058823529411} |
| INFO: 2024-07-13 13:29:37,889: llmtf.base.hfmodel: Updated generation_config.eos_token_id: [128001, 128009] |
| INFO: 2024-07-13 13:29:37,889: llmtf.base.hfmodel: Updated generation_config.stop_strings: [] |
| INFO: 2024-07-13 13:29:42,224: llmtf.base.russiannlp/rucola_custom: Loading Dataset: 4.33s |
| INFO: 2024-07-13 13:30:32,690: llmtf.base.russiannlp/rucola_custom: Processing Dataset: 50.47s |
| INFO: 2024-07-13 13:30:32,694: llmtf.base.russiannlp/rucola_custom: Results for russiannlp/rucola_custom: |
| INFO: 2024-07-13 13:30:32,706: llmtf.base.russiannlp/rucola_custom: {'acc': 0.7064944384642985, 'mcc': 0.26116373189147757} |
| INFO: 2024-07-13 13:30:32,710: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:30:32,733: llmtf.base.evaluator: |
| mean daru/treewayabstractive daru/treewayextractive darumeru/MultiQ darumeru/PARus darumeru/RCB darumeru/RWSD darumeru/USE darumeru/cp_para_ru darumeru/cp_sent_en darumeru/cp_sent_ru darumeru/ruMMLU darumeru/ruOpenBookQA darumeru/ruTiE darumeru/ruWorldTree nlpcoreteam/enMMLU nlpcoreteam/ruMMLU russiannlp/rucola_custom |
| 0.566 0.242 0.397 0.274 0.650 0.461 0.554 0.076 0.901 1.000 0.993 0.504 0.691 0.342 0.846 0.673 0.537 0.484 |
| INFO: 2024-07-13 13:30:46,511: llmtf.base.darumeru/cp_para_en: Processing Dataset: 354.73s |
| INFO: 2024-07-13 13:30:46,513: llmtf.base.darumeru/cp_para_en: Results for darumeru/cp_para_en: |
| INFO: 2024-07-13 13:30:46,533: llmtf.base.darumeru/cp_para_en: {'symbol_per_token': 4.463140535341514, 'len': 0.9941296296409974, 'lcs': 0.955732821155511} |
| INFO: 2024-07-13 13:30:46,534: llmtf.base.evaluator: Ended eval |
| INFO: 2024-07-13 13:30:46,543: llmtf.base.evaluator: |
| mean daru/treewayabstractive daru/treewayextractive darumeru/MultiQ darumeru/PARus darumeru/RCB darumeru/RWSD darumeru/USE darumeru/cp_para_en darumeru/cp_para_ru darumeru/cp_sent_en darumeru/cp_sent_ru darumeru/ruMMLU darumeru/ruOpenBookQA darumeru/ruTiE darumeru/ruWorldTree nlpcoreteam/enMMLU nlpcoreteam/ruMMLU russiannlp/rucola_custom |
| 0.588 0.242 0.397 0.274 0.650 0.461 0.554 0.076 0.956 0.901 1.000 0.993 0.504 0.691 0.342 0.846 0.673 0.537 0.484 |
|
|
