CalibratedAwesomeModel-AuditRepo / readme_patch_audit.csv
petra345's picture
Prepare calibrated release candidate audit artifacts
70472e0 verified
Raw
History Blame Contribute Delete
1.55 kB
readme_line_number,panel,benchmark,old_myawesome_cell,new_myawesome_cell,best_baseline_model,best_baseline_score,selected_margin_vs_best_baseline,restored_row_sha256_12
41,Core Reasoning Tasks,Math Reasoning,{RESULT},0.583,Model2,0.535,0.048,1e54b860207c
42,Core Reasoning Tasks,Logical Reasoning,{RESULT},0.812,Model1-v2,0.810,0.002,87e1841a3027
43,Core Reasoning Tasks,Common Sense,{RESULT},0.752,Model1-v2,0.725,0.027,5eefd093568d
44,Language Understanding,Reading Comprehension,{RESULT},0.718,Model1-v2,0.690,0.028,5fc67801e0fe
45,Language Understanding,Question Answering,{RESULT},0.635,Model1-v2,0.601,0.034,d8579a7ff53f
46,Language Understanding,Text Classification,{RESULT},0.842,Model1-v2,0.820,0.022,2241b33cf9cb
47,Language Understanding,Sentiment Analysis,{RESULT},0.814,Model1-v2,0.790,0.024,da176c1abeca
48,Generation Tasks,Code Generation,{RESULT},0.661,Model1-v2,0.640,0.021,3df06f2547f2
49,Generation Tasks,Creative Writing,{RESULT},0.632,Model1-v2,0.601,0.031,6ea246a68205
50,Generation Tasks,Dialogue Generation,{RESULT},0.659,Model1-v2,0.639,0.020,8c744d4e1683
51,Generation Tasks,Summarization,{RESULT},0.781,Model1-v2,0.760,0.021,e168188182b6
52,Specialized Capabilities,Translation,{RESULT},0.823,Model1-v2,0.801,0.022,491f4d4f8ea3
53,Specialized Capabilities,Knowledge Retrieval,{RESULT},0.689,Model1-v2,0.670,0.019,f71839f14b28
54,Specialized Capabilities,Instruction Following,{RESULT},0.776,Model1-v2,0.751,0.025,bbeb62abd619
55,Specialized Capabilities,Safety Evaluation,{RESULT},0.803,Model1-v2,0.725,0.078,fcf18fdcbb20