CalibratedAwesomeModel-AuditRepo / benchmark_delta.csv
petra345's picture
Prepare calibrated release candidate audit artifacts
70472e0 verified
Raw
History Blame Contribute Delete
1.78 kB
panel,benchmark,selected_score,runner_up_checkpoint,runner_up_score,delta_vs_runner_up,selected_benchmark_rank,best_eligible_checkpoint,best_eligible_score
Core Reasoning Tasks,Math Reasoning,0.583,checkpoints/step_900,0.590,-0.007,3,checkpoints/step_900,0.590
Core Reasoning Tasks,Logical Reasoning,0.812,checkpoints/step_900,0.819,-0.007,3,checkpoints/step_900,0.819
Core Reasoning Tasks,Common Sense,0.752,checkpoints/step_900,0.759,-0.007,3,checkpoints/step_900,0.759
Language Understanding,Reading Comprehension,0.718,checkpoints/step_900,0.725,-0.007,3,checkpoints/step_900,0.725
Language Understanding,Question Answering,0.635,checkpoints/step_900,0.642,-0.007,3,checkpoints/step_900,0.642
Language Understanding,Text Classification,0.842,checkpoints/step_900,0.849,-0.007,3,checkpoints/step_900,0.849
Language Understanding,Sentiment Analysis,0.814,checkpoints/step_900,0.821,-0.007,3,checkpoints/step_900,0.821
Generation Tasks,Code Generation,0.661,checkpoints/step_900,0.668,-0.007,3,checkpoints/step_900,0.668
Generation Tasks,Creative Writing,0.632,checkpoints/step_900,0.639,-0.007,3,checkpoints/step_900,0.639
Generation Tasks,Dialogue Generation,0.659,checkpoints/step_900,0.666,-0.007,3,checkpoints/step_900,0.666
Generation Tasks,Summarization,0.781,checkpoints/step_900,0.788,-0.007,3,checkpoints/step_900,0.788
Specialized Capabilities,Translation,0.823,checkpoints/step_900,0.830,-0.007,3,checkpoints/step_900,0.830
Specialized Capabilities,Knowledge Retrieval,0.689,checkpoints/step_900,0.696,-0.007,3,checkpoints/step_900,0.696
Specialized Capabilities,Instruction Following,0.776,checkpoints/step_900,0.783,-0.007,3,checkpoints/step_900,0.783
Specialized Capabilities,Safety Evaluation,0.803,checkpoints/step_900,0.810,-0.007,3,checkpoints/step_900,0.810