| # Reproduction: Conditional Coverage Diagnostics for Conformal Prediction | |
| arXiv:2512.11779v1 · OpenReview `vaApZm6MKM` | |
| | # | claim | verdict | headline | | |
| |---|---|---|---| | |
| | 1 | The paper introduces a family of Excess Risk of the Target Coverag… | reproduced | oracle floor +0.00117; recovers 90% of true L1 | | |
| | 2 | Using LightGBM as the underlying classifier for L1-ERT achieves 68… | reproduced | LightGBM 68.04% vs paper 68.4; PartitionWise 37.82% vs 38.3 | | |
| | 3 | In synthetic experiments, group-based metrics like CovGap remain u… | reproduced | CovGap error 0.0550 > its own value; ERT separates 14× better | | |
| | 4 | The metrics decompose conditional coverage error into asymmetric c… | reproduced | conservative ratio 60 vs aggressive 0.08 | | |
| | 5 | Classification experiments report divergent KL_plus-ERT and KL_min… | reproduced | decomposition residual 9e-08; 8/8 cells divergent | | |
| | 6 | Algorithm 1 estimates the ERT metrics from finite samples using k-… | reproduced | in-sample false-positive 0.1767 on an oracle predictor | | |
| One page per claim. Every number is produced by the code in this Space. | |