PACE / performance /pace_component_ablation.csv
rocky250's picture
Upload PACE-SME proposed inference model and evaluation assets
6cbbcc4 verified
Raw History Blame Contribute Delete
1.48 kB
variant,variant_type,included_components,validation_threshold,validation_weighted_error_cost,test_ROC_AUC,test_average_precision,test_Brier,test_recall,test_precision,test_alert_share,locked_test_n,component_predictions_reused_from_primary_test_evaluation,full_minus_variant_AP_difference,full_minus_variant_AP_diff_ci_2_5,full_minus_variant_AP_diff_ci_97_5,full_minus_variant_Brier_difference,full_minus_variant_Brier_diff_ci_2_5,full_minus_variant_Brier_diff_ci_97_5,paired_bootstrap_replicates,selection_or_tuning_on_test
PACE_full_two_component_simplex,proposed_simplex,CatBoost_Unweighted + LightGBM_Unweighted,0.22682374024878768,95.0,0.7910522941661324,0.5844628769710181,0.14867123005093147,0.8032786885245902,0.4298245614035088,0.475,240,True,0.0,,,0.0,,,0,False
single_component_CatBoost,single_base_learner_ablation,CatBoost_Unweighted,0.18357069160652448,98.0,0.7905485850352597,0.566264650742579,0.14999969329298418,0.7868852459016393,0.41739130434782606,0.4791666666666667,240,True,0.01819822622843903,-0.019881070374670042,0.05242168213241596,-0.0013284632420527132,-0.00676152561710301,0.0043373188751988,2000,False
single_component_LightGBM,single_base_learner_ablation,LightGBM_Unweighted,0.18413703819805452,94.0,0.7905485850352596,0.57955576009116,0.15007812956253685,0.8032786885245902,0.3983739837398374,0.5125,240,True,0.004907116879858009,-0.027538835628372817,0.03544439937554889,-0.0014068995116053862,-0.006150434538324754,0.003489872179680152,2000,False