LBJLincoln commited on
Commit
8a90d3f
·
1 Parent(s): 7176be3

d1: DART dropout trees on LightGBM in GA loop — expected Brier delta -0.0025

Browse files

P012: Add boosting_type=dart, drop_rate=0.1, skip_drop=0.5, uniform_drop=True
to LGBMClassifier in _build_model (genetic_loop_v3.py). DART prevents first-tree
dominance, improves probability spread across [0.3,0.7], reduces reliability
component of Brier. Consistent with Rashmi & Gilad-Bachrach 2015 (AISTATS).
Already verified working in app.py stacking path — now applied to main GA loop.

Files changed (1) hide show
  1. evolution/genetic_loop_v3.py +2 -0
evolution/genetic_loop_v3.py CHANGED
@@ -1107,6 +1107,8 @@ def _build_model(hp, use_gpu=False):
1107
  num_leaves=min(2 ** hp["max_depth"] - 1, 127),
1108
  reg_alpha=hp["reg_alpha"],
1109
  reg_lambda=hp["reg_lambda"],
 
 
1110
  verbose=-1, random_state=42, n_jobs=-1,
1111
  )
1112
  elif mt == "catboost":
 
1107
  num_leaves=min(2 ** hp["max_depth"] - 1, 127),
1108
  reg_alpha=hp["reg_alpha"],
1109
  reg_lambda=hp["reg_lambda"],
1110
+ # DART P012: dropout trees — better probability calibration, reduces reliability error
1111
+ boosting_type="dart", drop_rate=0.1, skip_drop=0.5, uniform_drop=True,
1112
  verbose=-1, random_state=42, n_jobs=-1,
1113
  )
1114
  elif mt == "catboost":