jpata commited on
Commit
0e04bd2
·
verified ·
1 Parent(s): bf7d95a

Publish FM c6879962 training artifacts (201-400/1676)

Browse files

PF FM 500k campaign: experts, joint training and fine-tunes; latest and best checkpoints, complete histories, TensorBoard, logs, configs, manifests, original-step plots and integrity metadata.

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/checkpoints/checkpoint-80000.pth +3 -0
  2. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_10000.json +1 -0
  3. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_20000.json +1 -0
  4. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_30000.json +1 -0
  5. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_40000.json +1 -0
  6. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_50000.json +1 -0
  7. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_60000.json +1 -0
  8. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_70000.json +1 -0
  9. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_80000.json +1 -0
  10. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/hyperparameters.json +1 -0
  11. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/model_kwargs.pkl +3 -0
  12. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/particleflow_spec.yaml +3198 -0
  13. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_eta.pdf +0 -0
  14. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_eta.png +0 -0
  15. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt.pdf +0 -0
  16. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt.png +0 -0
  17. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.pdf +0 -0
  18. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.png +0 -0
  19. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res.pdf +0 -0
  20. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res.png +0 -0
  21. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res_vstarget.pdf +0 -0
  22. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res_vstarget.png +0 -0
  23. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/num_elements.pdf +0 -0
  24. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/num_elements.png +0 -0
  25. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/runs/train/events.out.tfevents.1794650650.workergpu215.1009066.0 +3 -0
  26. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/runs/valid/events.out.tfevents.1794650650.workergpu215.1009066.1 +3 -0
  27. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/scenario-manifest.json +1299 -0
  28. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train-config.yaml +202 -0
  29. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train.log +0 -0
  30. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train.log.0 +0 -0
  31. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/checkpoints/best.pth +3 -0
  32. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/checkpoints/checkpoint-80000.pth +3 -0
  33. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_10000.json +1 -0
  34. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_20000.json +1 -0
  35. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_30000.json +1 -0
  36. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_40000.json +1 -0
  37. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_50000.json +1 -0
  38. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_60000.json +1 -0
  39. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_70000.json +1 -0
  40. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_80000.json +1 -0
  41. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/hyperparameters.json +1 -0
  42. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/model_kwargs.pkl +3 -0
  43. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/particleflow_spec.yaml +3198 -0
  44. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_eta.pdf +0 -0
  45. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_eta.png +0 -0
  46. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt.pdf +0 -0
  47. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt.png +0 -0
  48. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.pdf +0 -0
  49. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.png +0 -0
  50. fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_res.pdf +0 -0
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/checkpoints/checkpoint-80000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bd103bd1ffb19c2adabbea14d210620f3de3f70511d40322aecd6451f6f9ee0
3
+ size 47101757
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_10000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 17.793594306049823, "train": {"Classification_binary": 4.015713691711426, "Classification": 0.03849282115697861, "Regression_pt": 0.1724710911512375, "Regression_eta": 0.008294960483908653, "Regression_sin_phi": 0.012356956489384174, "Regression_cos_phi": 0.009977273643016815, "Regression_energy": 0.16784390807151794, "Total": 8.970200538635254, "Total_unweighted": 4.4251507027074695}, "train_group": {}, "valid": {"Classification_binary": 3.9935059547424316, "Classification": 0.03709951415657997, "Regression_pt": 0.21856904029846191, "Regression_eta": 0.01491805911064148, "Regression_sin_phi": 0.010844285599887371, "Regression_cos_phi": 0.01119080837816, "Regression_energy": 0.21647045016288757, "Total": 10.150409698486328, "Total_unweighted": 4.50259811244905, "metrics/particle/class_1/efficiency": 0.8915127515792847, "metrics/particle/class_1/pid_accuracy": 0.98338383436203, "metrics/particle/class_2/efficiency": 0.17603211104869843, "metrics/particle/class_2/pid_accuracy": 0.3094462454319, "metrics/particle/class_3/efficiency": 0.6996718645095825, "metrics/particle/class_3/pid_accuracy": 0.9764137864112854, "metrics/particle/class_4/efficiency": 0.85467129945755, "metrics/particle/class_4/pid_accuracy": 0.028340080752968788, "metrics/particle/class_5/efficiency": 0.9427083134651184, "metrics/particle/class_5/pid_accuracy": 0.0883977934718132, "metrics/particle/count/bias_mean": -0.23199999332427979, "metrics/particle/count/mae": 5.136000156402588, "metrics/particle/count/prediction_mean": 96.0199966430664, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.08249011635780334, "metrics/particle/event/energy_response_mean": 0.9582615494728088, "metrics/particle/event/met_abs_error": 12.815853118896484, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08131930232048035, "metrics/particle/event/scalar_pt_response_mean": 0.9598265886306763, "metrics/particle/event/vector_pt_closure": 0.08490834385156631, "metrics/particle/matched/delta_eta_abs_mean": 0.021934427320957184, "metrics/particle/matched/delta_phi_abs_mean": 0.01965649053454399, "metrics/particle/matched/delta_r_mean": 0.03280063718557358, "metrics/particle/matched/energy_relative_abs_mean": 0.09646397083997726, "metrics/particle/matched/pid_accuracy": 0.9474088549613953, "metrics/particle/matched/pt_relative_abs_mean": 0.09171808511018753, "metrics/particle/matching/duplicate_fraction": 0.04269943758845329, "metrics/particle/matching/efficiency": 0.7570128440856934, "metrics/particle/matching/f1": 0.7579262852668762, "metrics/particle/matching/purity": 0.7588419318199158, "metrics/particle/matching/target_coverage_dr0p05": 0.624610424041748, "metrics/particle/matching/target_coverage_dr0p10": 0.789677083492279, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6719028949737549, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.81727135181427}, "step_train_time": 0.7900326251983643, "step_valid_time": 1.851197028066963, "step_total_time": 740.6127593517303, "elapsed_training_loop_seconds": 740.6127593517303, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9760879499758485, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.20315851103941407, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1490, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1296, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1226, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8715534633490248, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8697986577181208, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8706751763520323, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.13020134228187918, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8244788164088769, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8228187919463087, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8236479677527713, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8715534633490248, "step_test_time": 3.1267466300632805, "step_plot_time": 2.3640741700073704, "step_validation_cycle_time": 7.8253866960294545}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_20000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 35.587188612099645, "train": {"Classification_binary": 3.85414981842041, "Classification": 0.039956022053956985, "Regression_pt": 0.21875329315662384, "Regression_eta": 0.013725532218813896, "Regression_sin_phi": 0.00931147113442421, "Regression_cos_phi": 0.008958750404417515, "Regression_energy": 0.23187901079654694, "Total": 10.161786079406738, "Total_unweighted": 4.3767338981851935}, "train_group": {}, "valid": {"Classification_binary": 3.8532674312591553, "Classification": 0.03542546555399895, "Regression_pt": 0.20570704340934753, "Regression_eta": 0.013729248195886612, "Regression_sin_phi": 0.009950397536158562, "Regression_cos_phi": 0.010331022553145885, "Regression_energy": 0.2029266059398651, "Total": 9.637345314025879, "Total_unweighted": 4.331337214447558, "metrics/particle/class_1/efficiency": 0.8859358429908752, "metrics/particle/class_1/pid_accuracy": 0.9806236028671265, "metrics/particle/class_2/efficiency": 0.21731650829315186, "metrics/particle/class_2/pid_accuracy": 0.4142480194568634, "metrics/particle/class_3/efficiency": 0.7200347185134888, "metrics/particle/class_3/pid_accuracy": 0.978823184967041, "metrics/particle/class_4/efficiency": 0.8719723224639893, "metrics/particle/class_4/pid_accuracy": 0.0833333358168602, "metrics/particle/class_5/efficiency": 0.9375, "metrics/particle/class_5/pid_accuracy": 0.23888888955116272, "metrics/particle/count/bias_mean": -0.052000001072883606, "metrics/particle/count/mae": 4.699999809265137, "metrics/particle/count/prediction_mean": 96.19999694824219, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.07599479705095291, "metrics/particle/event/energy_response_mean": 0.9820490479469299, "metrics/particle/event/met_abs_error": 11.6581449508667, "metrics/particle/event/scalar_pt_relative_abs_error": 0.07450247555971146, "metrics/particle/event/scalar_pt_response_mean": 0.9842734336853027, "metrics/particle/event/vector_pt_closure": 0.07765036821365356, "metrics/particle/matched/delta_eta_abs_mean": 0.019137511029839516, "metrics/particle/matched/delta_phi_abs_mean": 0.017932046204805374, "metrics/particle/matched/delta_r_mean": 0.02917354926466942, "metrics/particle/matched/energy_relative_abs_mean": 0.09705743938684464, "metrics/particle/matched/pid_accuracy": 0.9487499594688416, "metrics/particle/matched/pt_relative_abs_mean": 0.09895728528499603, "metrics/particle/matching/duplicate_fraction": 0.04049896076321602, "metrics/particle/matching/efficiency": 0.7662801742553711, "metrics/particle/matching/f1": 0.7664872407913208, "metrics/particle/matching/purity": 0.7666943669319153, "metrics/particle/matching/target_coverage_dr0p05": 0.6633005142211914, "metrics/particle/matching/target_coverage_dr0p10": 0.8033080101013184, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6701574921607971, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8215933442115784}, "step_train_time": 0.7584407329559326, "step_valid_time": 1.9819169419351965, "step_total_time": 1494.6416606903076, "elapsed_training_loop_seconds": 1494.6416606903076, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0025417175716829, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.20605151054420978, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1494, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1322, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1267, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8890383322125084, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8848728246318608, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8869506876886951, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.11512717536813923, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8520511096166778, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8480589022757697, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.850050318685005, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8890383322125084, "step_test_time": 3.2108992770081386, "step_plot_time": 2.262435681070201, "step_validation_cycle_time": 7.951159760938026}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_30000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 53.380782918149464, "train": {"Classification_binary": 3.4128012657165527, "Classification": 0.028861206024885178, "Regression_pt": 0.16473138332366943, "Regression_eta": 0.00788995809853077, "Regression_sin_phi": 0.00824070442467928, "Regression_cos_phi": 0.005993984639644623, "Regression_energy": 0.1638282686471939, "Total": 8.017716407775879, "Total_unweighted": 3.792346770875156}, "train_group": {}, "valid": {"Classification_binary": 3.730581045150757, "Classification": 0.03444462642073631, "Regression_pt": 0.20082174241542816, "Regression_eta": 0.012932317331433296, "Regression_sin_phi": 0.009554648771882057, "Regression_cos_phi": 0.009967920370399952, "Regression_energy": 0.19831660389900208, "Total": 9.3712739944458, "Total_unweighted": 4.196618904359639, "metrics/particle/class_1/efficiency": 0.8915998339653015, "metrics/particle/class_1/pid_accuracy": 0.9773260354995728, "metrics/particle/class_2/efficiency": 0.2626146674156189, "metrics/particle/class_2/pid_accuracy": 0.4519650638103485, "metrics/particle/class_3/efficiency": 0.7423277497291565, "metrics/particle/class_3/pid_accuracy": 0.9795891642570496, "metrics/particle/class_4/efficiency": 0.8615916967391968, "metrics/particle/class_4/pid_accuracy": 0.09236947447061539, "metrics/particle/class_5/efficiency": 0.9479166865348816, "metrics/particle/class_5/pid_accuracy": 0.26923078298568726, "metrics/particle/count/bias_mean": 1.9880000352859497, "metrics/particle/count/mae": 5.124000072479248, "metrics/particle/count/prediction_mean": 98.23999786376953, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.07641645520925522, "metrics/particle/event/energy_response_mean": 1.0525538921356201, "metrics/particle/event/met_abs_error": 10.3040771484375, "metrics/particle/event/scalar_pt_relative_abs_error": 0.0786113515496254, "metrics/particle/event/scalar_pt_response_mean": 1.0563106536865234, "metrics/particle/event/vector_pt_closure": 0.06726865470409393, "metrics/particle/matched/delta_eta_abs_mean": 0.019353386014699936, "metrics/particle/matched/delta_phi_abs_mean": 0.017648063600063324, "metrics/particle/matched/delta_r_mean": 0.029219524934887886, "metrics/particle/matched/energy_relative_abs_mean": 0.10384313762187958, "metrics/particle/matched/pid_accuracy": 0.9468984007835388, "metrics/particle/matched/pt_relative_abs_mean": 0.104012131690979, "metrics/particle/matching/duplicate_fraction": 0.04405537620186806, "metrics/particle/matching/efficiency": 0.7818227410316467, "metrics/particle/matching/f1": 0.773831307888031, "metrics/particle/matching/purity": 0.7660016417503357, "metrics/particle/matching/target_coverage_dr0p05": 0.6711548566818237, "metrics/particle/matching/target_coverage_dr0p10": 0.814653217792511, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6742717027664185, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8385488390922546}, "step_train_time": 0.7786905765533447, "step_valid_time": 1.9741058710496873, "step_total_time": 2247.90217089653, "elapsed_training_loop_seconds": 2247.90217089653, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.042160206545072, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.19340132982669933, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1496, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1334, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1288, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8971082716879624, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8917112299465241, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8944016091183372, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.10828877005347594, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8661735036987223, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8609625668449198, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8635601743211532, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8971082716879624, "step_test_time": 3.15345503797289, "step_plot_time": 2.269668795983307, "step_validation_cycle_time": 7.895503300009295}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_40000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 71.17437722419929, "train": {"Classification_binary": 3.3526248931884766, "Classification": 0.03167172893881798, "Regression_pt": 0.1584295928478241, "Regression_eta": 0.01037686225026846, "Regression_sin_phi": 0.013397022150456905, "Regression_cos_phi": 0.00832261424511671, "Regression_energy": 0.15761804580688477, "Total": 7.934598922729492, "Total_unweighted": 3.7324407594278455}, "train_group": {}, "valid": {"Classification_binary": 3.5372915267944336, "Classification": 0.03095990978181362, "Regression_pt": 0.18995508551597595, "Regression_eta": 0.012768946588039398, "Regression_sin_phi": 0.009282544255256653, "Regression_cos_phi": 0.009608320891857147, "Regression_energy": 0.18941877782344818, "Total": 8.88351058959961, "Total_unweighted": 3.9792851116508245, "metrics/particle/class_1/efficiency": 0.9007493853569031, "metrics/particle/class_1/pid_accuracy": 0.9783302545547485, "metrics/particle/class_2/efficiency": 0.28153669834136963, "metrics/particle/class_2/pid_accuracy": 0.5804480910301208, "metrics/particle/class_3/efficiency": 0.7419416904449463, "metrics/particle/class_3/pid_accuracy": 0.9798387289047241, "metrics/particle/class_4/efficiency": 0.8685120940208435, "metrics/particle/class_4/pid_accuracy": 0.19521912932395935, "metrics/particle/class_5/efficiency": 0.953125, "metrics/particle/class_5/pid_accuracy": 0.34972676634788513, "metrics/particle/count/bias_mean": 1.6319999694824219, "metrics/particle/count/mae": 4.455999851226807, "metrics/particle/count/prediction_mean": 97.88400268554688, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.05252637714147568, "metrics/particle/event/energy_response_mean": 1.0114774703979492, "metrics/particle/event/met_abs_error": 8.625664710998535, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05427943542599678, "metrics/particle/event/scalar_pt_response_mean": 1.0122069120407104, "metrics/particle/event/vector_pt_closure": 0.056626804172992706, "metrics/particle/matched/delta_eta_abs_mean": 0.019263634458184242, "metrics/particle/matched/delta_phi_abs_mean": 0.017914200201630592, "metrics/particle/matched/delta_r_mean": 0.02931937947869301, "metrics/particle/matched/energy_relative_abs_mean": 0.10223738104104996, "metrics/particle/matched/pid_accuracy": 0.9521899819374084, "metrics/particle/matched/pt_relative_abs_mean": 0.0932522714138031, "metrics/particle/matching/duplicate_fraction": 0.041641127318143845, "metrics/particle/matching/efficiency": 0.7875161170959473, "metrics/particle/matching/f1": 0.7808958888053894, "metrics/particle/matching/purity": 0.7743859887123108, "metrics/particle/matching/target_coverage_dr0p05": 0.6699497103691101, "metrics/particle/matching/target_coverage_dr0p10": 0.8190998435020447, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6955491900444031, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8466525077819824}, "step_train_time": 0.7785544395446777, "step_valid_time": 2.0094264149665833, "step_total_time": 3005.2798953056335, "elapsed_training_loop_seconds": 3005.2798953056335, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9999089393164721, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.15658918325822802, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1475, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1343, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1317, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9031607262945528, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9105084745762712, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9068197164078325, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.08949152542372882, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8856758574310692, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8928813559322034, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8892640108035111, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9031607262945528, "step_test_time": 3.144862362067215, "step_plot_time": 2.2593824999639764, "step_validation_cycle_time": 7.923551031039096}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_50000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 88.96797153024912, "train": {"Classification_binary": 3.421208620071411, "Classification": 0.02759786881506443, "Regression_pt": 0.16131553053855896, "Regression_eta": 0.004970055539160967, "Regression_sin_phi": 0.006630134303122759, "Regression_cos_phi": 0.005987836513668299, "Regression_energy": 0.16307257115840912, "Total": 7.915924072265625, "Total_unweighted": 3.7907826169393957}, "train_group": {}, "valid": {"Classification_binary": 3.4951415061950684, "Classification": 0.029393630102276802, "Regression_pt": 0.185575932264328, "Regression_eta": 0.012925829738378525, "Regression_sin_phi": 0.008846519514918327, "Regression_cos_phi": 0.009072529152035713, "Regression_energy": 0.18534675240516663, "Total": 8.709552764892578, "Total_unweighted": 3.9263026993721724, "metrics/particle/class_1/efficiency": 0.9005751013755798, "metrics/particle/class_1/pid_accuracy": 0.9751330614089966, "metrics/particle/class_2/efficiency": 0.2780963182449341, "metrics/particle/class_2/pid_accuracy": 0.5773195624351501, "metrics/particle/class_3/efficiency": 0.7369233965873718, "metrics/particle/class_3/pid_accuracy": 0.97826087474823, "metrics/particle/class_4/efficiency": 0.8615916967391968, "metrics/particle/class_4/pid_accuracy": 0.1807228922843933, "metrics/particle/class_5/efficiency": 0.9635416865348816, "metrics/particle/class_5/pid_accuracy": 0.4810810685157776, "metrics/particle/count/bias_mean": 1.496000051498413, "metrics/particle/count/mae": 4.567999839782715, "metrics/particle/count/prediction_mean": 97.74800109863281, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.051292069256305695, "metrics/particle/event/energy_response_mean": 1.0185492038726807, "metrics/particle/event/met_abs_error": 9.203628540039062, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05185657739639282, "metrics/particle/event/scalar_pt_response_mean": 1.0204607248306274, "metrics/particle/event/vector_pt_closure": 0.06111479178071022, "metrics/particle/matched/delta_eta_abs_mean": 0.018823673948645592, "metrics/particle/matched/delta_phi_abs_mean": 0.017793312668800354, "metrics/particle/matched/delta_r_mean": 0.02889835275709629, "metrics/particle/matched/energy_relative_abs_mean": 0.09974927455186844, "metrics/particle/matched/pid_accuracy": 0.9508734941482544, "metrics/particle/matched/pt_relative_abs_mean": 0.09472235292196274, "metrics/particle/matching/duplicate_fraction": 0.04386790469288826, "metrics/particle/matching/efficiency": 0.7850226759910583, "metrics/particle/matching/f1": 0.7789690494537354, "metrics/particle/matching/purity": 0.7730081677436829, "metrics/particle/matching/target_coverage_dr0p05": 0.6750197410583496, "metrics/particle/matching/target_coverage_dr0p10": 0.8213024139404297, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.689481794834137, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8418318629264832}, "step_train_time": 0.7675926685333252, "step_valid_time": 2.0194027920952067, "step_total_time": 3759.2077395915985, "elapsed_training_loop_seconds": 3759.2077395915985, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.0086475019767045, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.14757668473335928, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1481, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1349, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1325, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.9071956960322798, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9108710330857529, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9090296495956873, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.08912896691424713, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8910558170813719, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8946657663740716, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8928571428571429, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.9071956960322798, "step_test_time": 3.2380416449159384, "step_plot_time": 2.2700440130429342, "step_validation_cycle_time": 8.037020783987828}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_60000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 106.76156583629893, "train": {"Classification_binary": 3.1106514930725098, "Classification": 0.0271860770881176, "Regression_pt": 0.1168924868106842, "Regression_eta": 0.01179321389645338, "Regression_sin_phi": 0.009063358418643475, "Regression_cos_phi": 0.00981047935783863, "Regression_energy": 0.12327231466770172, "Total": 6.673815727233887, "Total_unweighted": 3.4086694233119488}, "train_group": {}, "valid": {"Classification_binary": 3.517404317855835, "Classification": 0.029017440974712372, "Regression_pt": 0.1943494826555252, "Regression_eta": 0.012896087020635605, "Regression_sin_phi": 0.008738631382584572, "Regression_cos_phi": 0.008890822529792786, "Regression_energy": 0.1944778710603714, "Total": 8.945260047912598, "Total_unweighted": 3.965774653479457, "metrics/particle/class_1/efficiency": 0.9105960130691528, "metrics/particle/class_1/pid_accuracy": 0.9781818389892578, "metrics/particle/class_2/efficiency": 0.26146790385246277, "metrics/particle/class_2/pid_accuracy": 0.5460526347160339, "metrics/particle/class_3/efficiency": 0.7292028665542603, "metrics/particle/class_3/pid_accuracy": 0.9769719243049622, "metrics/particle/class_4/efficiency": 0.875432550907135, "metrics/particle/class_4/pid_accuracy": 0.2134387344121933, "metrics/particle/class_5/efficiency": 0.953125, "metrics/particle/class_5/pid_accuracy": 0.4590163826942444, "metrics/particle/count/bias_mean": 0.164000004529953, "metrics/particle/count/mae": 4.699999809265137, "metrics/particle/count/prediction_mean": 96.41600036621094, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.05963905155658722, "metrics/particle/event/energy_response_mean": 0.9825883507728577, "metrics/particle/event/met_abs_error": 9.605710983276367, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05837829038500786, "metrics/particle/event/scalar_pt_response_mean": 0.9896187782287598, "metrics/particle/event/vector_pt_closure": 0.06317146122455597, "metrics/particle/matched/delta_eta_abs_mean": 0.019648971036076546, "metrics/particle/matched/delta_phi_abs_mean": 0.017693988978862762, "metrics/particle/matched/delta_r_mean": 0.029439376667141914, "metrics/particle/matched/energy_relative_abs_mean": 0.09492231905460358, "metrics/particle/matched/pid_accuracy": 0.9520055055618286, "metrics/particle/matched/pt_relative_abs_mean": 0.0910792201757431, "metrics/particle/matching/duplicate_fraction": 0.039080649614334106, "metrics/particle/matching/efficiency": 0.7853550910949707, "metrics/particle/matching/f1": 0.7846866250038147, "metrics/particle/matching/purity": 0.7840192317962646, "metrics/particle/matching/target_coverage_dr0p05": 0.6628433465957642, "metrics/particle/matching/target_coverage_dr0p10": 0.8155674934387207, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6981257796287537, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8408344984054565}, "step_train_time": 0.7721717357635498, "step_valid_time": 2.0387332050595433, "step_total_time": 4518.969594478607, "elapsed_training_loop_seconds": 4518.969594478607, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9936132448009287, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.14660449708526035, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1475, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1334, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1301, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8971082716879624, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9044067796610169, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.900742741390952, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.09559322033898306, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.874915938130464, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8820338983050847, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8784604996623903, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8971082716879624, "step_test_time": 3.1144363019848242, "step_plot_time": 2.280186887946911, "step_validation_cycle_time": 7.903902680031024}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_70000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 124.55516014234875, "train": {"Classification_binary": 2.873628616333008, "Classification": 0.02559659257531166, "Regression_pt": 0.09358017891645432, "Regression_eta": 0.013041323982179165, "Regression_sin_phi": 0.014536046423017979, "Regression_cos_phi": 0.014460190199315548, "Regression_energy": 0.10534615814685822, "Total": 6.020669460296631, "Total_unweighted": 3.1401891065761447}, "train_group": {}, "valid": {"Classification_binary": 3.6400890350341797, "Classification": 0.029988231137394905, "Regression_pt": 0.21184934675693512, "Regression_eta": 0.012796427123248577, "Regression_sin_phi": 0.008688784204423428, "Regression_cos_phi": 0.009051826782524586, "Regression_energy": 0.21239231526851654, "Total": 9.516793251037598, "Total_unweighted": 4.124855966307223, "metrics/particle/class_1/efficiency": 0.9065876603126526, "metrics/particle/class_1/pid_accuracy": 0.9786620736122131, "metrics/particle/class_2/efficiency": 0.27694955468177795, "metrics/particle/class_2/pid_accuracy": 0.6211180090904236, "metrics/particle/class_3/efficiency": 0.7238950133323669, "metrics/particle/class_3/pid_accuracy": 0.9745367169380188, "metrics/particle/class_4/efficiency": 0.8650519251823425, "metrics/particle/class_4/pid_accuracy": 0.18000000715255737, "metrics/particle/class_5/efficiency": 0.9635416865348816, "metrics/particle/class_5/pid_accuracy": 0.4810810685157776, "metrics/particle/count/bias_mean": -0.2879999876022339, "metrics/particle/count/mae": 5.176000118255615, "metrics/particle/count/prediction_mean": 95.96399688720703, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.05896647647023201, "metrics/particle/event/energy_response_mean": 0.9905875325202942, "metrics/particle/event/met_abs_error": 9.164907455444336, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05424301698803902, "metrics/particle/event/scalar_pt_response_mean": 0.9954108595848083, "metrics/particle/event/vector_pt_closure": 0.06066562607884407, "metrics/particle/matched/delta_eta_abs_mean": 0.01872519962489605, "metrics/particle/matched/delta_phi_abs_mean": 0.01775435172021389, "metrics/particle/matched/delta_r_mean": 0.02873760648071766, "metrics/particle/matched/energy_relative_abs_mean": 0.0918944850564003, "metrics/particle/matched/pid_accuracy": 0.9523455500602722, "metrics/particle/matched/pt_relative_abs_mean": 0.08879776298999786, "metrics/particle/matching/duplicate_fraction": 0.0393064059317112, "metrics/particle/matching/efficiency": 0.7822383046150208, "metrics/particle/matching/f1": 0.7834103107452393, "metrics/particle/matching/purity": 0.7845858931541443, "metrics/particle/matching/target_coverage_dr0p05": 0.6610979437828064, "metrics/particle/matching/target_coverage_dr0p10": 0.812450647354126, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6977517604827881, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8395046591758728}, "step_train_time": 0.7769639492034912, "step_valid_time": 2.0364475160604343, "step_total_time": 5276.050372123718, "elapsed_training_loop_seconds": 5276.050372123718, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9988843370443912, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.15548436553221368, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1466, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1336, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1310, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.898453261600538, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9113233287858117, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9048425330172706, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.08867667121418826, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8809683927370545, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8935879945429741, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8872333220453776, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.898453261600538, "step_test_time": 3.1147123189875856, "step_plot_time": 2.2693937179865316, "step_validation_cycle_time": 7.891613306012005}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/history/step_80000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 142.34875444839858, "train": {"Classification_binary": 2.3644888401031494, "Classification": 0.024062860757112503, "Regression_pt": 0.06747335195541382, "Regression_eta": 0.005027283914387226, "Regression_sin_phi": 0.009431242011487484, "Regression_cos_phi": 0.00709893461316824, "Regression_energy": 0.06828737258911133, "Total": 4.529984474182129, "Total_unweighted": 2.54586988594383}, "train_group": {}, "valid": {"Classification_binary": 4.056398868560791, "Classification": 0.0314062237739563, "Regression_pt": 0.22484923899173737, "Regression_eta": 0.013039530254900455, "Regression_sin_phi": 0.008591674268245697, "Regression_cos_phi": 0.009063780307769775, "Regression_energy": 0.22437454760074615, "Total": 10.26056957244873, "Total_unweighted": 4.567723863758147, "metrics/particle/class_1/efficiency": 0.9066748023033142, "metrics/particle/class_1/pid_accuracy": 0.9777030348777771, "metrics/particle/class_2/efficiency": 0.28153669834136963, "metrics/particle/class_2/pid_accuracy": 0.5580447912216187, "metrics/particle/class_3/efficiency": 0.7074888944625854, "metrics/particle/class_3/pid_accuracy": 0.9731278419494629, "metrics/particle/class_4/efficiency": 0.878892719745636, "metrics/particle/class_4/pid_accuracy": 0.20866142213344574, "metrics/particle/class_5/efficiency": 0.96875, "metrics/particle/class_5/pid_accuracy": 0.4784946143627167, "metrics/particle/count/bias_mean": 0.4880000054836273, "metrics/particle/count/mae": 4.960000038146973, "metrics/particle/count/prediction_mean": 96.73999786376953, "metrics/particle/count/target_mean": 96.25199890136719, "metrics/particle/event/energy_relative_abs_error": 0.060810983180999756, "metrics/particle/event/energy_response_mean": 0.9814264178276062, "metrics/particle/event/met_abs_error": 9.791168212890625, "metrics/particle/event/scalar_pt_relative_abs_error": 0.06013373285531998, "metrics/particle/event/scalar_pt_response_mean": 0.9856533408164978, "metrics/particle/event/vector_pt_closure": 0.06383663415908813, "metrics/particle/matched/delta_eta_abs_mean": 0.018944066017866135, "metrics/particle/matched/delta_phi_abs_mean": 0.017796777188777924, "metrics/particle/matched/delta_r_mean": 0.028913017362356186, "metrics/particle/matched/energy_relative_abs_mean": 0.0888742059469223, "metrics/particle/matched/pid_accuracy": 0.949429452419281, "metrics/particle/matched/pt_relative_abs_mean": 0.0847240537405014, "metrics/particle/matching/duplicate_fraction": 0.038453586399555206, "metrics/particle/matching/efficiency": 0.7757552862167358, "metrics/particle/matching/f1": 0.7737937569618225, "metrics/particle/matching/purity": 0.7718420624732971, "metrics/particle/matching/target_coverage_dr0p05": 0.6465943455696106, "metrics/particle/matching/target_coverage_dr0p10": 0.8050949573516846, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6971283555030823, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8350164294242859}, "step_train_time": 0.7578456401824951, "step_valid_time": 1.999780360958539, "step_total_time": 6029.745100736618, "elapsed_training_loop_seconds": 6029.745100736618, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9926528916736544, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.16582395652752713, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1487, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1470, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1335, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1305, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8977807666442502, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9081632653061225, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9029421711193778, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.09183673469387756, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8776059179556154, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8877551020408163, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8826513358133243, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8977807666442502, "step_test_time": 3.1400950169190764, "step_plot_time": 2.2967528000008315, "step_validation_cycle_time": 7.908646175055765}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/hyperparameters.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"num_mlpf_params": 3910930, "dataset": "cld", "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_12mm/tfds", "model": {"type": "attention", "input_encoding": "split", "learned_representation_mode": "last", "pt_mode": "direct-elemtype-split", "eta_mode": "linear", "sin_phi_mode": "linear", "cos_phi_mode": "linear", "energy_mode": "direct-elemtype-split", "trainable": "all", "task_queries": true, "output_mode": "elementwise", "binary_classification_focal_gamma": null, "backbone": {"mode": "shared", "num_convs": 6, "num_tracker_layers": null, "num_calo_layers": null, "num_common_layers": null}, "hit_feature_engineering": {"enabled": true, "geometry": true, "tracker_neighborhood": false, "tracker_momentum": false, "tracker_doublets": false, "calorimeter_neighborhood": true}, "set_decoder": null, "input_normalization": true, "feature_bag": true, "gnnlsh": null, "attention": {"num_convs": 6, "dropout_ff": 0.0, "activation": "elu", "layernorm": true, "num_heads": 16, "head_dim": 16, "attention_type": "flash", "dropout_conv_reg_mha": 0.0, "dropout_conv_reg_ff": 0.0, "dropout_conv_id_mha": 0.0, "dropout_conv_id_ff": 0.0, "use_pre_layernorm": true, "use_jagged_attention": false, "use_flash_attn_varlen": false, "export_onnx_fused": false, "save_attention": false}, "litept": null, "hept": null, "heptv2": null}, "conv_type": "attention", "batch_size": 1, "hyperparameters": {"batch_size": 1, "lr": 0.0005}, "backend": "pytorch", "threads": 16, "gpu_type": "l40", "mem_per_gpu_mb": 40000, "slurm_partition": "gpu", "slurm_runtime": "168h", "input_dim": 19, "num_classes": 6, "elemtypes_nonzero": [1, 2], "seed": 12345, "num_steps": 500000, "patience": 3, "checkpoint_freq": 2000, "val_freq": 10000, "num_workers": 8, "prefetch_factor": 2, "max_open_readers": 64, "gpu_batch_multiplier": 16, "dtype": "bfloat16", "lr": 0.0005, "weight_decay": 0.01, "optimizer": "lamb", "lr_schedule": "onecycle", "lr_schedule_config": {"onecycle": {"pct_start": 0.3}}, "task_loss_weights": {"calibration_steps": 100, "epsilon": 1e-08, "min_weight": 0.01, "max_weight": 1000.0}, "lr_finder": {"start_lr": 1e-07, "end_lr": 0.1, "num_steps": 1000, "smoothing": 0.98, "divergence_factor": 4.0}, "pad_to_multiple_elements": 128, "validation_diagnostics_batches": 0, "validation_linear_probe": false, "validation_linear_probe_max_events": 16, "validation_particle_metrics": true, "train": true, "lr_find": false, "test": true, "compile": false, "make_plots": true, "sort_data": false, "sampler_mode": "interleaved-shards", "load": null, "relaxed_load": false, "load_weights_only": false, "reset_task_loss_weights": false, "sampler_from_scratch": false, "comet": false, "comet_offline": false, "comet_name": "particleflow", "tensorboard_step_freq": 1000, "benchmark": {"enabled": true, "sample_interval_seconds": 1.0, "warmup_steps": 100, "gpu_timing_interval": 0}, "raytune": {"local_dir": null, "sched": "asha", "search_alg": null, "default_metric": "val_loss", "default_mode": "min", "asha": {"max_t": 200, "reduction_factor": 4, "brackets": 1, "grace_period": 10}, "hyperband": {"max_t": 200, "reduction_factor": 4}, "hyperopt": {"n_random_steps": 10}, "nevergrad": {"n_random_steps": 10}}, "train_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "valid_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "test_dataset": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": 1}}, "enabled_test_datasets": ["cld_edm_ttbar_pf"], "ntrain": null, "nvalid": 256, "ntest": 256, "data_config": null, "gpus": 1}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/model_kwargs.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:178dac78948f096d16728bd1441bcd8060b20c871566b66ca01df1d8bdd8bd67
3
+ size 4394
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/particleflow_spec.yaml ADDED
@@ -0,0 +1,3198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ models:
2
+ defaults:
3
+ backend: pytorch
4
+ checkpoint_freq: 10000
5
+ comet: false
6
+ dtype: bfloat16
7
+ gpu_type: l40
8
+ gpus: 1
9
+ load: null
10
+ lr_schedule: cosinedecay
11
+ mem_per_gpu_mb: 40000
12
+ ntest: 100
13
+ ntrain: null
14
+ num_steps: 100000
15
+ num_workers: 2
16
+ nvalid: null
17
+ optimizer: lamb
18
+ patience: 10000
19
+ prefetch_factor: 2
20
+ raytune: &id001
21
+ asha:
22
+ brackets: 1
23
+ grace_period: 10
24
+ max_t: 200
25
+ reduction_factor: 4
26
+ default_metric: val_loss
27
+ default_mode: min
28
+ hyperband:
29
+ max_t: 200
30
+ reduction_factor: 4
31
+ hyperopt:
32
+ n_random_steps: 10
33
+ local_dir: null
34
+ nevergrad:
35
+ n_random_steps: 10
36
+ sched: asha
37
+ search_alg: null
38
+ seed: 12345
39
+ slurm_partition: ${project.gpu_partition}
40
+ slurm_runtime: 168h
41
+ sort_data: false
42
+ task_loss_weights: &id002
43
+ calibration_steps: 100
44
+ epsilon: 1.0e-08
45
+ max_weight: 1.0e3
46
+ min_weight: 0.01
47
+ tensorboard_step_freq: 100
48
+ threads: 16
49
+ val_freq: 10000
50
+ pyg-cld-hits-heptv2-sector-set-v1:
51
+ architecture:
52
+ heptv2:
53
+ block_size: 128
54
+ dropout_ff: 0.0
55
+ embedding_dim: 256
56
+ num_convs: 3
57
+ num_heads: 16
58
+ width: 256
59
+ input_encoding: split
60
+ output_mode: set
61
+ set_decoder:
62
+ attention_mode: sectorized
63
+ local_attention_radius: 0.4
64
+ num_heads: 8
65
+ num_layers: 2
66
+ num_sectors: 32
67
+ num_slots: 256
68
+ proposal_mode: grid-diverse
69
+ query_init: input-conditioned
70
+ sector_neighbors: 1
71
+ use_aggregate_anchors: true
72
+ type: heptv2
73
+ backend: pytorch
74
+ checkpoint_freq: 10000
75
+ comet: false
76
+ dataset: cld_hits
77
+ dtype: bfloat16
78
+ gpu_batch_multiplier: 1
79
+ gpu_type: l40
80
+ gpus: 1
81
+ hyperparameters: &id007
82
+ batch_size: 1
83
+ lr: 0.0001
84
+ load: null
85
+ lr_schedule: cosinedecay
86
+ mem_per_gpu_mb: 40000
87
+ ntest: 100
88
+ ntrain: null
89
+ num_steps: 100000
90
+ num_workers: 2
91
+ nvalid: null
92
+ optimizer: lamb
93
+ pad_to_multiple_elements: 128
94
+ patience: 10000
95
+ prefetch_factor: 2
96
+ raytune: *id001
97
+ seed: 12345
98
+ slurm_partition: ${project.gpu_partition}
99
+ slurm_runtime: 168h
100
+ sort_data: false
101
+ task_loss_weights: *id002
102
+ tensorboard_step_freq: 100
103
+ test_datasets: &id003
104
+ - name: cld_edm_ttbar_hits
105
+ splits:
106
+ - '1'
107
+ - '2'
108
+ - '3'
109
+ - '4'
110
+ - '5'
111
+ - '6'
112
+ - '7'
113
+ - '8'
114
+ - '9'
115
+ - '10'
116
+ version: 3.2.2
117
+ - name: cld_edm_ww_fullhad_hits
118
+ splits:
119
+ - '1'
120
+ - '2'
121
+ - '3'
122
+ - '4'
123
+ - '5'
124
+ - '6'
125
+ - '7'
126
+ - '8'
127
+ - '9'
128
+ - '10'
129
+ version: 3.2.2
130
+ - name: cld_edm_qq_hits
131
+ splits:
132
+ - '1'
133
+ - '2'
134
+ - '3'
135
+ - '4'
136
+ - '5'
137
+ - '6'
138
+ - '7'
139
+ - '8'
140
+ - '9'
141
+ - '10'
142
+ version: 3.2.2
143
+ threads: 16
144
+ train_datasets: &id004
145
+ physical:
146
+ batch_size: 1
147
+ samples:
148
+ - name: cld_edm_ttbar_hits
149
+ splits:
150
+ - '1'
151
+ - '2'
152
+ - '3'
153
+ - '4'
154
+ - '5'
155
+ - '6'
156
+ - '7'
157
+ - '8'
158
+ - '9'
159
+ - '10'
160
+ version: 3.2.2
161
+ - name: cld_edm_ww_fullhad_hits
162
+ splits:
163
+ - '1'
164
+ - '2'
165
+ - '3'
166
+ - '4'
167
+ - '5'
168
+ - '6'
169
+ - '7'
170
+ - '8'
171
+ - '9'
172
+ - '10'
173
+ version: 3.2.2
174
+ - name: cld_edm_qq_hits
175
+ splits:
176
+ - '1'
177
+ - '2'
178
+ - '3'
179
+ - '4'
180
+ - '5'
181
+ - '6'
182
+ - '7'
183
+ - '8'
184
+ - '9'
185
+ - '10'
186
+ version: 3.2.2
187
+ val_freq: 10000
188
+ validation_datasets: &id005
189
+ physical:
190
+ batch_size: 1
191
+ samples:
192
+ - name: cld_edm_ttbar_hits
193
+ splits:
194
+ - '1'
195
+ - '2'
196
+ - '3'
197
+ - '4'
198
+ - '5'
199
+ - '6'
200
+ - '7'
201
+ - '8'
202
+ - '9'
203
+ - '10'
204
+ version: 3.2.2
205
+ - name: cld_edm_ww_fullhad_hits
206
+ splits:
207
+ - '1'
208
+ - '2'
209
+ - '3'
210
+ - '4'
211
+ - '5'
212
+ - '6'
213
+ - '7'
214
+ - '8'
215
+ - '9'
216
+ - '10'
217
+ version: 3.2.2
218
+ - name: cld_edm_qq_hits
219
+ splits:
220
+ - '1'
221
+ - '2'
222
+ - '3'
223
+ - '4'
224
+ - '5'
225
+ - '6'
226
+ - '7'
227
+ - '8'
228
+ - '9'
229
+ - '10'
230
+ version: 3.2.2
231
+ pyg-cld-hits-heptv2-set-v1:
232
+ architecture:
233
+ backbone:
234
+ mode: shared
235
+ num_convs: 6
236
+ binary_classification_focal_gamma: 2.0
237
+ heptv2:
238
+ block_size: 128
239
+ dropout_ff: 0.0
240
+ embedding_dim: 256
241
+ num_convs: 6
242
+ num_heads: 16
243
+ width: 256
244
+ hit_feature_engineering:
245
+ tracker_neighborhood: true
246
+ input_encoding: split
247
+ output_mode: set
248
+ set_decoder:
249
+ aggregate_grid_size: 0.1
250
+ attention_mode: global-flash
251
+ auxiliary_loss_weight: 0.25
252
+ cardinality_loss_weight: 0.05
253
+ event_consistency_loss_weight: 0.0
254
+ hit_grouping: true
255
+ hit_grouping_chunk_size: 1024
256
+ hit_grouping_detector_balanced: false
257
+ hit_grouping_dim: 32
258
+ hit_grouping_loss_weight: 0.1
259
+ local_attention_radius: 0.4
260
+ matcher:
261
+ dr_scale: 0.1
262
+ energy: 0.0
263
+ geometry: 2.0
264
+ log_energy_scale: 0.6931471805599453
265
+ log_pt_scale: 0.6931471805599453
266
+ pid: 1.0
267
+ presence: 1.0
268
+ pt: 1.0
269
+ no_object_weight: 1.0
270
+ num_heads: 8
271
+ num_layers: 4
272
+ num_sectors: 32
273
+ num_slots: 256
274
+ presence_threshold: 0.5
275
+ proposal_grid_size: 0.1
276
+ proposal_mode: grid-diverse
277
+ query_init: input-conditioned
278
+ sector_neighbors: 1
279
+ tracker_fit_correction: false
280
+ tracker_group_magnetic_field: 2.0
281
+ tracker_group_readout: false
282
+ tracker_query_fraction: 0.6
283
+ use_aggregate_anchors: true
284
+ task_queries: false
285
+ type: heptv2
286
+ backend: pytorch
287
+ checkpoint_freq: 10000
288
+ comet: false
289
+ dataset: cld_hits
290
+ dtype: bfloat16
291
+ gpu_batch_multiplier: 1
292
+ gpu_type: l40
293
+ gpus: 1
294
+ hyperparameters:
295
+ batch_size: 1
296
+ lr: 0.001
297
+ load: null
298
+ lr_schedule: cosinedecay
299
+ mem_per_gpu_mb: 40000
300
+ ntest: 100
301
+ ntrain: null
302
+ num_steps: 100000
303
+ num_workers: 2
304
+ nvalid: null
305
+ optimizer: lamb
306
+ pad_to_multiple_elements: 128
307
+ patience: 10000
308
+ prefetch_factor: 2
309
+ raytune: *id001
310
+ seed: 12345
311
+ slurm_partition: ${project.gpu_partition}
312
+ slurm_runtime: 168h
313
+ sort_data: false
314
+ task_loss_weights: *id002
315
+ tensorboard_step_freq: 100
316
+ test_datasets: *id003
317
+ threads: 16
318
+ train_datasets: *id004
319
+ val_freq: 10000
320
+ validation_datasets: *id005
321
+ pyg-cld-hits-set-v1:
322
+ architecture:
323
+ attention: &id006
324
+ head_dim: 16
325
+ num_convs: 3
326
+ num_heads: 16
327
+ use_jagged_attention: true
328
+ binary_classification_focal_gamma: 2.0
329
+ input_encoding: split
330
+ output_mode: set
331
+ set_decoder:
332
+ dropout: 0.0
333
+ ffn_multiplier: 4.0
334
+ num_heads: 8
335
+ num_layers: 2
336
+ num_slots: 256
337
+ type: attention
338
+ backend: pytorch
339
+ checkpoint_freq: 10000
340
+ comet: false
341
+ dataset: cld_hits
342
+ dtype: bfloat16
343
+ gpu_batch_multiplier: 1
344
+ gpu_type: l40
345
+ gpus: 1
346
+ hyperparameters:
347
+ batch_size: 1
348
+ lr: 0.0001
349
+ load: null
350
+ lr_schedule: cosinedecay
351
+ mem_per_gpu_mb: 40000
352
+ ntest: 100
353
+ ntrain: null
354
+ num_steps: 100000
355
+ num_workers: 2
356
+ nvalid: null
357
+ optimizer: lamb
358
+ pad_to_multiple_elements: 128
359
+ patience: 10000
360
+ prefetch_factor: 2
361
+ raytune: *id001
362
+ seed: 12345
363
+ slurm_partition: ${project.gpu_partition}
364
+ slurm_runtime: 168h
365
+ sort_data: false
366
+ task_loss_weights: *id002
367
+ tensorboard_step_freq: 100
368
+ test_datasets: *id003
369
+ threads: 16
370
+ train_datasets: *id004
371
+ val_freq: 10000
372
+ validation_datasets: *id005
373
+ pyg-cld-hits-v1:
374
+ architecture:
375
+ attention: *id006
376
+ binary_classification_focal_gamma: 2.0
377
+ input_encoding: split
378
+ output_mode: elementwise
379
+ type: attention
380
+ backend: pytorch
381
+ checkpoint_freq: 10000
382
+ comet: false
383
+ dataset: cld_hits
384
+ dtype: bfloat16
385
+ gpu_batch_multiplier: 1
386
+ gpu_type: l40
387
+ gpus: 1
388
+ hyperparameters: *id007
389
+ load: null
390
+ lr_schedule: cosinedecay
391
+ mem_per_gpu_mb: 40000
392
+ ntest: 100
393
+ ntrain: null
394
+ num_steps: 100000
395
+ num_workers: 2
396
+ nvalid: null
397
+ optimizer: lamb
398
+ pad_to_multiple_elements: 128
399
+ patience: 10000
400
+ prefetch_factor: 2
401
+ raytune: *id001
402
+ seed: 12345
403
+ slurm_partition: ${project.gpu_partition}
404
+ slurm_runtime: 168h
405
+ sort_data: false
406
+ task_loss_weights: *id002
407
+ tensorboard_step_freq: 100
408
+ test_datasets: *id003
409
+ threads: 16
410
+ train_datasets: *id004
411
+ val_freq: 10000
412
+ validation_datasets: *id005
413
+ pyg-cld-v1:
414
+ architecture:
415
+ attention:
416
+ head_dim: 16
417
+ num_convs: 3
418
+ num_heads: 16
419
+ heptv2:
420
+ cluster_hash_at_centroid: true
421
+ track_hash_at_calo: true
422
+ input_encoding: split
423
+ type: attention
424
+ backend: pytorch
425
+ checkpoint_freq: 10000
426
+ comet: false
427
+ dataset: cld
428
+ dtype: bfloat16
429
+ gpu_batch_multiplier: 1024
430
+ gpu_type: l40
431
+ gpus: 1
432
+ hyperparameters:
433
+ batch_size: 1
434
+ lr: 0.0005
435
+ load: null
436
+ lr_schedule: cosinedecay
437
+ mem_per_gpu_mb: 40000
438
+ ntest: 100
439
+ ntrain: null
440
+ num_steps: 100000
441
+ num_workers: 2
442
+ nvalid: null
443
+ optimizer: lamb
444
+ patience: 10000
445
+ prefetch_factor: 2
446
+ raytune: *id001
447
+ seed: 12345
448
+ slurm_partition: ${project.gpu_partition}
449
+ slurm_runtime: 168h
450
+ sort_data: false
451
+ task_loss_weights: *id002
452
+ tensorboard_step_freq: 100
453
+ test_datasets:
454
+ - name: cld_edm_ttbar_pf
455
+ splits:
456
+ - '1'
457
+ - '2'
458
+ - '3'
459
+ - '4'
460
+ - '5'
461
+ - '6'
462
+ - '7'
463
+ - '8'
464
+ - '9'
465
+ - '10'
466
+ version: 3.3.0
467
+ - name: cld_edm_ww_fullhad_pf
468
+ splits:
469
+ - '1'
470
+ - '2'
471
+ - '3'
472
+ - '4'
473
+ - '5'
474
+ - '6'
475
+ - '7'
476
+ - '8'
477
+ - '9'
478
+ - '10'
479
+ version: 3.3.0
480
+ - name: cld_edm_qq_pf
481
+ splits:
482
+ - '1'
483
+ - '2'
484
+ - '3'
485
+ - '4'
486
+ - '5'
487
+ - '6'
488
+ - '7'
489
+ - '8'
490
+ - '9'
491
+ - '10'
492
+ version: 3.3.0
493
+ threads: 16
494
+ train_datasets:
495
+ physical:
496
+ batch_size: 1
497
+ samples:
498
+ - name: cld_edm_ttbar_pf
499
+ splits:
500
+ - '1'
501
+ - '2'
502
+ - '3'
503
+ - '4'
504
+ - '5'
505
+ - '6'
506
+ - '7'
507
+ - '8'
508
+ - '9'
509
+ - '10'
510
+ version: 3.3.0
511
+ - name: cld_edm_ww_fullhad_pf
512
+ splits:
513
+ - '1'
514
+ - '2'
515
+ - '3'
516
+ - '4'
517
+ - '5'
518
+ - '6'
519
+ - '7'
520
+ - '8'
521
+ - '9'
522
+ - '10'
523
+ version: 3.3.0
524
+ - name: cld_edm_qq_pf
525
+ splits:
526
+ - '1'
527
+ - '2'
528
+ - '3'
529
+ - '4'
530
+ - '5'
531
+ - '6'
532
+ - '7'
533
+ - '8'
534
+ - '9'
535
+ - '10'
536
+ version: 3.3.0
537
+ val_freq: 10000
538
+ validation_datasets:
539
+ physical:
540
+ batch_size: 1
541
+ samples:
542
+ - name: cld_edm_ttbar_pf
543
+ splits:
544
+ - '1'
545
+ - '2'
546
+ - '3'
547
+ - '4'
548
+ - '5'
549
+ - '6'
550
+ - '7'
551
+ - '8'
552
+ - '9'
553
+ - '10'
554
+ version: 3.3.0
555
+ - name: cld_edm_ww_fullhad_pf
556
+ splits:
557
+ - '1'
558
+ - '2'
559
+ - '3'
560
+ - '4'
561
+ - '5'
562
+ - '6'
563
+ - '7'
564
+ - '8'
565
+ - '9'
566
+ - '10'
567
+ version: 3.3.0
568
+ - name: cld_edm_qq_pf
569
+ splits:
570
+ - '1'
571
+ - '2'
572
+ - '3'
573
+ - '4'
574
+ - '5'
575
+ - '6'
576
+ - '7'
577
+ - '8'
578
+ - '9'
579
+ - '10'
580
+ version: 3.3.0
581
+ pyg-cldcliccolliderml-v1:
582
+ architecture:
583
+ attention:
584
+ head_dim: 16
585
+ num_convs: 3
586
+ num_heads: 16
587
+ input_encoding: split
588
+ type: attention
589
+ backend: pytorch
590
+ checkpoint_freq: 10000
591
+ comet: false
592
+ dataset: cld
593
+ dtype: bfloat16
594
+ gpu_batch_multiplier: 1024
595
+ gpu_type: l40
596
+ gpus: 1
597
+ hyperparameters:
598
+ batch_size: 1
599
+ lr: 0.0005
600
+ load: null
601
+ lr_schedule: cosinedecay
602
+ mem_per_gpu_mb: 40000
603
+ ntest: 100
604
+ ntrain: null
605
+ num_steps: 100000
606
+ num_workers: 2
607
+ nvalid: null
608
+ optimizer: lamb
609
+ patience: 10000
610
+ prefetch_factor: 2
611
+ raytune: *id001
612
+ seed: 12345
613
+ slurm_partition: ${project.gpu_partition}
614
+ slurm_runtime: 168h
615
+ sort_data: false
616
+ task_loss_weights: *id002
617
+ tensorboard_step_freq: 100
618
+ test_datasets:
619
+ - name: cld_edm_ttbar_pf
620
+ splits:
621
+ - '1'
622
+ - '2'
623
+ - '3'
624
+ - '4'
625
+ - '5'
626
+ - '6'
627
+ - '7'
628
+ - '8'
629
+ - '9'
630
+ - '10'
631
+ version: 3.3.0
632
+ - name: cld_edm_ww_fullhad_pf
633
+ splits:
634
+ - '1'
635
+ - '2'
636
+ - '3'
637
+ - '4'
638
+ - '5'
639
+ - '6'
640
+ - '7'
641
+ - '8'
642
+ - '9'
643
+ - '10'
644
+ version: 3.3.0
645
+ - name: cld_edm_qq_pf
646
+ splits:
647
+ - '1'
648
+ - '2'
649
+ - '3'
650
+ - '4'
651
+ - '5'
652
+ - '6'
653
+ - '7'
654
+ - '8'
655
+ - '9'
656
+ - '10'
657
+ version: 3.3.0
658
+ - name: clic_edm_ttbar_pf
659
+ splits:
660
+ - '1'
661
+ - '2'
662
+ - '3'
663
+ - '4'
664
+ - '5'
665
+ - '6'
666
+ - '7'
667
+ - '8'
668
+ - '9'
669
+ - '10'
670
+ version: 3.3.0
671
+ - name: clic_edm_ww_fullhad_pf
672
+ splits:
673
+ - '1'
674
+ - '2'
675
+ - '3'
676
+ - '4'
677
+ - '5'
678
+ - '6'
679
+ - '7'
680
+ - '8'
681
+ - '9'
682
+ - '10'
683
+ version: 3.3.0
684
+ - name: clic_edm_qq_pf
685
+ splits:
686
+ - '1'
687
+ - '2'
688
+ - '3'
689
+ - '4'
690
+ - '5'
691
+ - '6'
692
+ - '7'
693
+ - '8'
694
+ - '9'
695
+ - '10'
696
+ version: 3.3.0
697
+ - name: colliderml_ttbar_nopu_pf
698
+ splits:
699
+ - '1'
700
+ - '2'
701
+ - '3'
702
+ - '4'
703
+ - '5'
704
+ - '6'
705
+ - '7'
706
+ - '8'
707
+ - '9'
708
+ - '10'
709
+ version: 1.5.0
710
+ threads: 16
711
+ train_datasets:
712
+ cld:
713
+ batch_size: 1
714
+ samples:
715
+ - name: cld_edm_ttbar_pf
716
+ splits:
717
+ - '1'
718
+ - '2'
719
+ - '3'
720
+ - '4'
721
+ - '5'
722
+ - '6'
723
+ - '7'
724
+ - '8'
725
+ - '9'
726
+ - '10'
727
+ version: 3.3.0
728
+ - name: cld_edm_ww_fullhad_pf
729
+ splits:
730
+ - '1'
731
+ - '2'
732
+ - '3'
733
+ - '4'
734
+ - '5'
735
+ - '6'
736
+ - '7'
737
+ - '8'
738
+ - '9'
739
+ - '10'
740
+ version: 3.3.0
741
+ - name: cld_edm_qq_pf
742
+ splits:
743
+ - '1'
744
+ - '2'
745
+ - '3'
746
+ - '4'
747
+ - '5'
748
+ - '6'
749
+ - '7'
750
+ - '8'
751
+ - '9'
752
+ - '10'
753
+ version: 3.3.0
754
+ weight: 1.0
755
+ clic:
756
+ batch_size: 1
757
+ samples:
758
+ - name: clic_edm_ttbar_pf
759
+ splits:
760
+ - '1'
761
+ - '2'
762
+ - '3'
763
+ - '4'
764
+ - '5'
765
+ - '6'
766
+ - '7'
767
+ - '8'
768
+ - '9'
769
+ - '10'
770
+ version: 3.3.0
771
+ - name: clic_edm_ww_fullhad_pf
772
+ splits:
773
+ - '1'
774
+ - '2'
775
+ - '3'
776
+ - '4'
777
+ - '5'
778
+ - '6'
779
+ - '7'
780
+ - '8'
781
+ - '9'
782
+ - '10'
783
+ version: 3.3.0
784
+ - name: clic_edm_qq_pf
785
+ splits:
786
+ - '1'
787
+ - '2'
788
+ - '3'
789
+ - '4'
790
+ - '5'
791
+ - '6'
792
+ - '7'
793
+ - '8'
794
+ - '9'
795
+ - '10'
796
+ version: 3.3.0
797
+ weight: 1.0
798
+ colliderml:
799
+ batch_size: 1
800
+ samples:
801
+ - name: colliderml_ttbar_nopu_pf
802
+ splits:
803
+ - '1'
804
+ - '2'
805
+ - '3'
806
+ - '4'
807
+ - '5'
808
+ - '6'
809
+ - '7'
810
+ - '8'
811
+ - '9'
812
+ - '10'
813
+ version: 1.5.0
814
+ weight: 1.0
815
+ val_freq: 10000
816
+ validation_datasets:
817
+ cld:
818
+ batch_size: 1
819
+ samples:
820
+ - name: cld_edm_ttbar_pf
821
+ splits:
822
+ - '1'
823
+ - '2'
824
+ - '3'
825
+ - '4'
826
+ - '5'
827
+ - '6'
828
+ - '7'
829
+ - '8'
830
+ - '9'
831
+ - '10'
832
+ version: 3.3.0
833
+ - name: cld_edm_ww_fullhad_pf
834
+ splits:
835
+ - '1'
836
+ - '2'
837
+ - '3'
838
+ - '4'
839
+ - '5'
840
+ - '6'
841
+ - '7'
842
+ - '8'
843
+ - '9'
844
+ - '10'
845
+ version: 3.3.0
846
+ - name: cld_edm_qq_pf
847
+ splits:
848
+ - '1'
849
+ - '2'
850
+ - '3'
851
+ - '4'
852
+ - '5'
853
+ - '6'
854
+ - '7'
855
+ - '8'
856
+ - '9'
857
+ - '10'
858
+ version: 3.3.0
859
+ clic:
860
+ batch_size: 1
861
+ samples:
862
+ - name: clic_edm_ttbar_pf
863
+ splits:
864
+ - '1'
865
+ - '2'
866
+ - '3'
867
+ - '4'
868
+ - '5'
869
+ - '6'
870
+ - '7'
871
+ - '8'
872
+ - '9'
873
+ - '10'
874
+ version: 3.3.0
875
+ - name: clic_edm_ww_fullhad_pf
876
+ splits:
877
+ - '1'
878
+ - '2'
879
+ - '3'
880
+ - '4'
881
+ - '5'
882
+ - '6'
883
+ - '7'
884
+ - '8'
885
+ - '9'
886
+ - '10'
887
+ version: 3.3.0
888
+ - name: clic_edm_qq_pf
889
+ splits:
890
+ - '1'
891
+ - '2'
892
+ - '3'
893
+ - '4'
894
+ - '5'
895
+ - '6'
896
+ - '7'
897
+ - '8'
898
+ - '9'
899
+ - '10'
900
+ version: 3.3.0
901
+ colliderml:
902
+ batch_size: 1
903
+ samples:
904
+ - name: colliderml_ttbar_nopu_pf
905
+ splits:
906
+ - '1'
907
+ - '2'
908
+ - '3'
909
+ - '4'
910
+ - '5'
911
+ - '6'
912
+ - '7'
913
+ - '8'
914
+ - '9'
915
+ - '10'
916
+ version: 1.5.0
917
+ pyg-clic-hits-set-v1:
918
+ architecture:
919
+ attention: &id008
920
+ head_dim: 16
921
+ num_convs: 3
922
+ num_heads: 16
923
+ binary_classification_focal_gamma: 2.0
924
+ input_encoding: split
925
+ output_mode: set
926
+ set_decoder:
927
+ dropout: 0.0
928
+ ffn_multiplier: 4.0
929
+ num_heads: 8
930
+ num_layers: 2
931
+ num_slots: 256
932
+ type: attention
933
+ backend: pytorch
934
+ checkpoint_freq: 10000
935
+ comet: false
936
+ dataset: clic_hits
937
+ dtype: bfloat16
938
+ gpu_batch_multiplier: 16
939
+ gpu_type: l40
940
+ gpus: 1
941
+ hyperparameters:
942
+ batch_size: 1
943
+ lr: 0.0001
944
+ load: null
945
+ lr_schedule: cosinedecay
946
+ mem_per_gpu_mb: 40000
947
+ ntest: 100
948
+ ntrain: null
949
+ num_steps: 100000
950
+ num_workers: 2
951
+ nvalid: null
952
+ optimizer: lamb
953
+ patience: 10000
954
+ prefetch_factor: 2
955
+ raytune: *id001
956
+ seed: 12345
957
+ slurm_partition: ${project.gpu_partition}
958
+ slurm_runtime: 168h
959
+ sort_data: false
960
+ task_loss_weights: *id002
961
+ tensorboard_step_freq: 100
962
+ test_datasets: &id009
963
+ - name: clic_edm_ttbar_hits
964
+ splits:
965
+ - '1'
966
+ - '2'
967
+ - '3'
968
+ - '4'
969
+ - '5'
970
+ - '6'
971
+ - '7'
972
+ - '8'
973
+ - '9'
974
+ - '10'
975
+ version: 3.2.2
976
+ - name: clic_edm_ww_fullhad_hits
977
+ splits:
978
+ - '1'
979
+ - '2'
980
+ - '3'
981
+ - '4'
982
+ - '5'
983
+ - '6'
984
+ - '7'
985
+ - '8'
986
+ - '9'
987
+ - '10'
988
+ version: 3.2.2
989
+ - name: clic_edm_qq_hits
990
+ splits:
991
+ - '1'
992
+ - '2'
993
+ - '3'
994
+ - '4'
995
+ - '5'
996
+ - '6'
997
+ - '7'
998
+ - '8'
999
+ - '9'
1000
+ - '10'
1001
+ version: 3.2.2
1002
+ threads: 16
1003
+ train_datasets: &id010
1004
+ physical:
1005
+ batch_size: 1
1006
+ samples:
1007
+ - name: clic_edm_ttbar_hits
1008
+ splits:
1009
+ - '1'
1010
+ - '2'
1011
+ - '3'
1012
+ - '4'
1013
+ - '5'
1014
+ - '6'
1015
+ - '7'
1016
+ - '8'
1017
+ - '9'
1018
+ - '10'
1019
+ version: 3.2.2
1020
+ - name: clic_edm_ww_fullhad_hits
1021
+ splits:
1022
+ - '1'
1023
+ - '2'
1024
+ - '3'
1025
+ - '4'
1026
+ - '5'
1027
+ - '6'
1028
+ - '7'
1029
+ - '8'
1030
+ - '9'
1031
+ - '10'
1032
+ version: 3.2.2
1033
+ - name: clic_edm_qq_hits
1034
+ splits:
1035
+ - '1'
1036
+ - '2'
1037
+ - '3'
1038
+ - '4'
1039
+ - '5'
1040
+ - '6'
1041
+ - '7'
1042
+ - '8'
1043
+ - '9'
1044
+ - '10'
1045
+ version: 3.2.2
1046
+ val_freq: 10000
1047
+ validation_datasets: &id011
1048
+ physical:
1049
+ batch_size: 1
1050
+ samples:
1051
+ - name: clic_edm_ttbar_hits
1052
+ splits:
1053
+ - '1'
1054
+ - '2'
1055
+ - '3'
1056
+ - '4'
1057
+ - '5'
1058
+ - '6'
1059
+ - '7'
1060
+ - '8'
1061
+ - '9'
1062
+ - '10'
1063
+ version: 3.2.2
1064
+ - name: clic_edm_ww_fullhad_hits
1065
+ splits:
1066
+ - '1'
1067
+ - '2'
1068
+ - '3'
1069
+ - '4'
1070
+ - '5'
1071
+ - '6'
1072
+ - '7'
1073
+ - '8'
1074
+ - '9'
1075
+ - '10'
1076
+ version: 3.2.2
1077
+ - name: clic_edm_qq_hits
1078
+ splits:
1079
+ - '1'
1080
+ - '2'
1081
+ - '3'
1082
+ - '4'
1083
+ - '5'
1084
+ - '6'
1085
+ - '7'
1086
+ - '8'
1087
+ - '9'
1088
+ - '10'
1089
+ version: 3.2.2
1090
+ pyg-clic-hits-v1:
1091
+ architecture:
1092
+ attention: *id008
1093
+ binary_classification_focal_gamma: 2.0
1094
+ input_encoding: split
1095
+ output_mode: elementwise
1096
+ type: attention
1097
+ backend: pytorch
1098
+ checkpoint_freq: 10000
1099
+ comet: false
1100
+ dataset: clic_hits
1101
+ dtype: bfloat16
1102
+ gpu_batch_multiplier: 16
1103
+ gpu_type: l40
1104
+ gpus: 1
1105
+ hyperparameters:
1106
+ batch_size: 1
1107
+ lr: 0.0001
1108
+ load: null
1109
+ lr_schedule: cosinedecay
1110
+ mem_per_gpu_mb: 40000
1111
+ ntest: 100
1112
+ ntrain: null
1113
+ num_steps: 100000
1114
+ num_workers: 2
1115
+ nvalid: null
1116
+ optimizer: lamb
1117
+ patience: 10000
1118
+ prefetch_factor: 2
1119
+ raytune: *id001
1120
+ seed: 12345
1121
+ slurm_partition: ${project.gpu_partition}
1122
+ slurm_runtime: 168h
1123
+ sort_data: false
1124
+ task_loss_weights: *id002
1125
+ tensorboard_step_freq: 100
1126
+ test_datasets: *id009
1127
+ threads: 16
1128
+ train_datasets: *id010
1129
+ val_freq: 10000
1130
+ validation_datasets: *id011
1131
+ pyg-clic-v1:
1132
+ architecture:
1133
+ attention:
1134
+ head_dim: 16
1135
+ num_convs: 3
1136
+ num_heads: 16
1137
+ heptv2:
1138
+ cluster_hash_at_centroid: true
1139
+ track_hash_at_calo: true
1140
+ input_encoding: split
1141
+ type: attention
1142
+ backend: pytorch
1143
+ checkpoint_freq: 10000
1144
+ comet: false
1145
+ dataset: clic
1146
+ dtype: bfloat16
1147
+ gpu_batch_multiplier: 1024
1148
+ gpu_type: l40
1149
+ gpus: 1
1150
+ hyperparameters:
1151
+ batch_size: 1
1152
+ lr: 0.0005
1153
+ load: null
1154
+ lr_schedule: cosinedecay
1155
+ mem_per_gpu_mb: 40000
1156
+ ntest: 100
1157
+ ntrain: null
1158
+ num_steps: 100000
1159
+ num_workers: 2
1160
+ nvalid: null
1161
+ optimizer: lamb
1162
+ patience: 10000
1163
+ prefetch_factor: 2
1164
+ raytune: *id001
1165
+ seed: 12345
1166
+ slurm_partition: ${project.gpu_partition}
1167
+ slurm_runtime: 168h
1168
+ sort_data: false
1169
+ task_loss_weights: *id002
1170
+ tensorboard_step_freq: 100
1171
+ test_datasets:
1172
+ - name: clic_edm_ttbar_pf
1173
+ splits:
1174
+ - '1'
1175
+ - '2'
1176
+ - '3'
1177
+ - '4'
1178
+ - '5'
1179
+ - '6'
1180
+ - '7'
1181
+ - '8'
1182
+ - '9'
1183
+ - '10'
1184
+ version: 3.3.0
1185
+ - name: clic_edm_ww_fullhad_pf
1186
+ splits:
1187
+ - '1'
1188
+ - '2'
1189
+ - '3'
1190
+ - '4'
1191
+ - '5'
1192
+ - '6'
1193
+ - '7'
1194
+ - '8'
1195
+ - '9'
1196
+ - '10'
1197
+ version: 3.3.0
1198
+ - name: clic_edm_qq_pf
1199
+ splits:
1200
+ - '1'
1201
+ - '2'
1202
+ - '3'
1203
+ - '4'
1204
+ - '5'
1205
+ - '6'
1206
+ - '7'
1207
+ - '8'
1208
+ - '9'
1209
+ - '10'
1210
+ version: 3.3.0
1211
+ threads: 16
1212
+ train_datasets:
1213
+ physical:
1214
+ batch_size: 1
1215
+ samples:
1216
+ - name: clic_edm_ttbar_pf
1217
+ splits:
1218
+ - '1'
1219
+ - '2'
1220
+ - '3'
1221
+ - '4'
1222
+ - '5'
1223
+ - '6'
1224
+ - '7'
1225
+ - '8'
1226
+ - '9'
1227
+ - '10'
1228
+ version: 3.3.0
1229
+ - name: clic_edm_ww_fullhad_pf
1230
+ splits:
1231
+ - '1'
1232
+ - '2'
1233
+ - '3'
1234
+ - '4'
1235
+ - '5'
1236
+ - '6'
1237
+ - '7'
1238
+ - '8'
1239
+ - '9'
1240
+ - '10'
1241
+ version: 3.3.0
1242
+ - name: clic_edm_qq_pf
1243
+ splits:
1244
+ - '1'
1245
+ - '2'
1246
+ - '3'
1247
+ - '4'
1248
+ - '5'
1249
+ - '6'
1250
+ - '7'
1251
+ - '8'
1252
+ - '9'
1253
+ - '10'
1254
+ version: 3.3.0
1255
+ val_freq: 10000
1256
+ validation_datasets:
1257
+ physical:
1258
+ batch_size: 1
1259
+ samples:
1260
+ - name: clic_edm_ttbar_pf
1261
+ splits:
1262
+ - '1'
1263
+ - '2'
1264
+ - '3'
1265
+ - '4'
1266
+ - '5'
1267
+ - '6'
1268
+ - '7'
1269
+ - '8'
1270
+ - '9'
1271
+ - '10'
1272
+ version: 3.3.0
1273
+ - name: clic_edm_ww_fullhad_pf
1274
+ splits:
1275
+ - '1'
1276
+ - '2'
1277
+ - '3'
1278
+ - '4'
1279
+ - '5'
1280
+ - '6'
1281
+ - '7'
1282
+ - '8'
1283
+ - '9'
1284
+ - '10'
1285
+ version: 3.3.0
1286
+ - name: clic_edm_qq_pf
1287
+ splits:
1288
+ - '1'
1289
+ - '2'
1290
+ - '3'
1291
+ - '4'
1292
+ - '5'
1293
+ - '6'
1294
+ - '7'
1295
+ - '8'
1296
+ - '9'
1297
+ - '10'
1298
+ version: 3.3.0
1299
+ pyg-cms-v1:
1300
+ architecture:
1301
+ attention:
1302
+ head_dim: 32
1303
+ num_convs: 3
1304
+ num_heads: 16
1305
+ heptv2:
1306
+ track_hash_at_calo: true
1307
+ input_encoding: split
1308
+ type: attention
1309
+ backend: pytorch
1310
+ checkpoint_freq: 10000
1311
+ comet: false
1312
+ dataset: cms
1313
+ dtype: bfloat16
1314
+ gpu_batch_multiplier: 4
1315
+ gpu_type: l40
1316
+ gpus: 1
1317
+ hyperparameters:
1318
+ batch_size: 1
1319
+ lr: 0.0004
1320
+ load: null
1321
+ lr_schedule: cosinedecay
1322
+ mem_per_gpu_mb: 40000
1323
+ ntest: 100
1324
+ ntrain: null
1325
+ num_steps: 100000
1326
+ num_workers: 2
1327
+ nvalid: null
1328
+ optimizer: lamb
1329
+ patience: 10000
1330
+ prefetch_factor: 2
1331
+ raytune: *id001
1332
+ seed: 12345
1333
+ slurm_partition: ${project.gpu_partition}
1334
+ slurm_runtime: 168h
1335
+ sort_data: false
1336
+ task_loss_weights: *id002
1337
+ tensorboard_step_freq: 100
1338
+ test_datasets:
1339
+ - name: cms_pf_ttbar
1340
+ splits:
1341
+ - '1'
1342
+ - '2'
1343
+ - '3'
1344
+ - '4'
1345
+ - '5'
1346
+ - '6'
1347
+ - '7'
1348
+ - '8'
1349
+ - '9'
1350
+ - '10'
1351
+ version: 3.2.0
1352
+ - name: cms_pf_qcd
1353
+ splits:
1354
+ - '1'
1355
+ - '2'
1356
+ - '3'
1357
+ - '4'
1358
+ - '5'
1359
+ - '6'
1360
+ - '7'
1361
+ - '8'
1362
+ - '9'
1363
+ - '10'
1364
+ version: 3.2.0
1365
+ - name: cms_pf_ztt
1366
+ splits:
1367
+ - '1'
1368
+ - '2'
1369
+ - '3'
1370
+ - '4'
1371
+ - '5'
1372
+ - '6'
1373
+ - '7'
1374
+ - '8'
1375
+ - '9'
1376
+ - '10'
1377
+ version: 3.2.0
1378
+ threads: 16
1379
+ train_datasets:
1380
+ physical_nopu:
1381
+ batch_size: 16
1382
+ samples:
1383
+ - name: cms_pf_ttbar_nopu
1384
+ splits:
1385
+ - '1'
1386
+ - '2'
1387
+ - '3'
1388
+ - '4'
1389
+ - '5'
1390
+ - '6'
1391
+ - '7'
1392
+ - '8'
1393
+ - '9'
1394
+ - '10'
1395
+ version: 3.2.0
1396
+ - name: cms_pf_qcd_nopu
1397
+ splits:
1398
+ - '1'
1399
+ - '2'
1400
+ - '3'
1401
+ - '4'
1402
+ - '5'
1403
+ - '6'
1404
+ - '7'
1405
+ - '8'
1406
+ - '9'
1407
+ - '10'
1408
+ version: 3.2.0
1409
+ - name: cms_pf_ztt_nopu
1410
+ splits:
1411
+ - '1'
1412
+ - '2'
1413
+ - '3'
1414
+ - '4'
1415
+ - '5'
1416
+ - '6'
1417
+ - '7'
1418
+ - '8'
1419
+ - '9'
1420
+ - '10'
1421
+ version: 3.2.0
1422
+ physical_pu:
1423
+ batch_size: 1
1424
+ samples:
1425
+ - name: cms_pf_ttbar
1426
+ splits:
1427
+ - '1'
1428
+ - '2'
1429
+ - '3'
1430
+ - '4'
1431
+ - '5'
1432
+ - '6'
1433
+ - '7'
1434
+ - '8'
1435
+ - '9'
1436
+ - '10'
1437
+ version: 3.2.0
1438
+ - name: cms_pf_qcd
1439
+ splits:
1440
+ - '1'
1441
+ - '2'
1442
+ - '3'
1443
+ - '4'
1444
+ - '5'
1445
+ - '6'
1446
+ - '7'
1447
+ - '8'
1448
+ - '9'
1449
+ - '10'
1450
+ version: 3.2.0
1451
+ - name: cms_pf_ztt
1452
+ splits:
1453
+ - '1'
1454
+ - '2'
1455
+ - '3'
1456
+ - '4'
1457
+ - '5'
1458
+ - '6'
1459
+ - '7'
1460
+ - '8'
1461
+ - '9'
1462
+ - '10'
1463
+ version: 3.2.0
1464
+ val_freq: 10000
1465
+ validation_datasets:
1466
+ physical_nopu:
1467
+ batch_size: 16
1468
+ samples:
1469
+ - name: cms_pf_ttbar_nopu
1470
+ splits:
1471
+ - '1'
1472
+ - '2'
1473
+ - '3'
1474
+ - '4'
1475
+ - '5'
1476
+ - '6'
1477
+ - '7'
1478
+ - '8'
1479
+ - '9'
1480
+ - '10'
1481
+ version: 3.2.0
1482
+ - name: cms_pf_qcd_nopu
1483
+ splits:
1484
+ - '1'
1485
+ - '2'
1486
+ - '3'
1487
+ - '4'
1488
+ - '5'
1489
+ - '6'
1490
+ - '7'
1491
+ - '8'
1492
+ - '9'
1493
+ - '10'
1494
+ version: 3.2.0
1495
+ - name: cms_pf_ztt_nopu
1496
+ splits:
1497
+ - '1'
1498
+ - '2'
1499
+ - '3'
1500
+ - '4'
1501
+ - '5'
1502
+ - '6'
1503
+ - '7'
1504
+ - '8'
1505
+ - '9'
1506
+ - '10'
1507
+ version: 3.2.0
1508
+ physical_pu:
1509
+ batch_size: 1
1510
+ samples:
1511
+ - name: cms_pf_ttbar
1512
+ splits:
1513
+ - '1'
1514
+ - '2'
1515
+ - '3'
1516
+ - '4'
1517
+ - '5'
1518
+ - '6'
1519
+ - '7'
1520
+ - '8'
1521
+ - '9'
1522
+ - '10'
1523
+ version: 3.2.0
1524
+ - name: cms_pf_qcd
1525
+ splits:
1526
+ - '1'
1527
+ - '2'
1528
+ - '3'
1529
+ - '4'
1530
+ - '5'
1531
+ - '6'
1532
+ - '7'
1533
+ - '8'
1534
+ - '9'
1535
+ - '10'
1536
+ version: 3.2.0
1537
+ - name: cms_pf_ztt
1538
+ splits:
1539
+ - '1'
1540
+ - '2'
1541
+ - '3'
1542
+ - '4'
1543
+ - '5'
1544
+ - '6'
1545
+ - '7'
1546
+ - '8'
1547
+ - '9'
1548
+ - '10'
1549
+ version: 3.2.0
1550
+ pyg-colliderml-hits-set-v1:
1551
+ architecture:
1552
+ attention: &id012
1553
+ attention_type: flash
1554
+ head_dim: 16
1555
+ num_convs: 3
1556
+ num_heads: 16
1557
+ input_encoding: split
1558
+ output_mode: set
1559
+ set_decoder:
1560
+ dropout: 0.0
1561
+ ffn_multiplier: 4.0
1562
+ num_heads: 8
1563
+ num_layers: 2
1564
+ num_slots: 512
1565
+ type: attention
1566
+ backend: pytorch
1567
+ checkpoint_freq: 10000
1568
+ comet: false
1569
+ dataset: colliderml_hits
1570
+ dtype: bfloat16
1571
+ gpu_batch_multiplier: 1
1572
+ gpu_type: l40
1573
+ gpus: 1
1574
+ hyperparameters: &id013
1575
+ batch_size: 1
1576
+ lr: 0.0001
1577
+ load: null
1578
+ lr_schedule: cosinedecay
1579
+ mem_per_gpu_mb: 40000
1580
+ ntest: 100
1581
+ ntrain: null
1582
+ num_steps: 100000
1583
+ num_workers: 2
1584
+ nvalid: null
1585
+ optimizer: lamb
1586
+ pad_to_multiple_elements: 128
1587
+ patience: 10000
1588
+ prefetch_factor: 2
1589
+ raytune: *id001
1590
+ seed: 12345
1591
+ slurm_partition: ${project.gpu_partition}
1592
+ slurm_runtime: 168h
1593
+ sort_data: false
1594
+ task_loss_weights: *id002
1595
+ tensorboard_step_freq: 100
1596
+ test_datasets: &id014
1597
+ - name: colliderml_ttbar_hits
1598
+ splits:
1599
+ - '1'
1600
+ - '2'
1601
+ - '3'
1602
+ - '4'
1603
+ - '5'
1604
+ - '6'
1605
+ - '7'
1606
+ - '8'
1607
+ - '9'
1608
+ - '10'
1609
+ version: 1.3.0
1610
+ threads: 16
1611
+ train_datasets: &id015
1612
+ physical:
1613
+ batch_size: 1
1614
+ samples:
1615
+ - name: colliderml_ttbar_hits
1616
+ splits:
1617
+ - '1'
1618
+ - '2'
1619
+ - '3'
1620
+ - '4'
1621
+ - '5'
1622
+ - '6'
1623
+ - '7'
1624
+ - '8'
1625
+ - '9'
1626
+ - '10'
1627
+ version: 1.3.0
1628
+ val_freq: 10000
1629
+ validation_datasets: &id016
1630
+ physical:
1631
+ batch_size: 1
1632
+ samples:
1633
+ - name: colliderml_ttbar_hits
1634
+ splits:
1635
+ - '1'
1636
+ - '2'
1637
+ - '3'
1638
+ - '4'
1639
+ - '5'
1640
+ - '6'
1641
+ - '7'
1642
+ - '8'
1643
+ - '9'
1644
+ - '10'
1645
+ version: 1.3.0
1646
+ pyg-colliderml-hits-v1:
1647
+ architecture:
1648
+ attention: *id012
1649
+ input_encoding: split
1650
+ type: attention
1651
+ backend: pytorch
1652
+ checkpoint_freq: 10000
1653
+ comet: false
1654
+ dataset: colliderml_hits
1655
+ dtype: bfloat16
1656
+ gpu_batch_multiplier: 8
1657
+ gpu_type: l40
1658
+ gpus: 1
1659
+ hyperparameters: *id013
1660
+ load: null
1661
+ lr_schedule: cosinedecay
1662
+ mem_per_gpu_mb: 40000
1663
+ ntest: 100
1664
+ ntrain: null
1665
+ num_steps: 100000
1666
+ num_workers: 2
1667
+ nvalid: null
1668
+ optimizer: lamb
1669
+ patience: 10000
1670
+ prefetch_factor: 2
1671
+ raytune: *id001
1672
+ seed: 12345
1673
+ slurm_partition: ${project.gpu_partition}
1674
+ slurm_runtime: 168h
1675
+ sort_data: false
1676
+ task_loss_weights: *id002
1677
+ tensorboard_step_freq: 100
1678
+ test_datasets: *id014
1679
+ threads: 16
1680
+ train_datasets: *id015
1681
+ val_freq: 10000
1682
+ validation_datasets: *id016
1683
+ pyg-colliderml-pu0pu200-groups-v1:
1684
+ architecture: &id017
1685
+ attention:
1686
+ attention_type: flash
1687
+ head_dim: 16
1688
+ num_convs: 3
1689
+ num_heads: 16
1690
+ heptv2:
1691
+ track_hash_at_calo: true
1692
+ input_encoding: split
1693
+ type: attention
1694
+ backend: pytorch
1695
+ checkpoint_freq: 10000
1696
+ comet: false
1697
+ dataset: colliderml
1698
+ dtype: bfloat16
1699
+ gpu_batch_multiplier: 1
1700
+ gpu_type: l40
1701
+ gpus: 1
1702
+ hyperparameters: &id018
1703
+ batch_size: 1
1704
+ lr: 0.0001
1705
+ load: null
1706
+ lr_schedule: cosinedecay
1707
+ mem_per_gpu_mb: 40000
1708
+ ntest: 100
1709
+ ntrain: null
1710
+ num_steps: 100000
1711
+ num_workers: 2
1712
+ nvalid: null
1713
+ optimizer: lamb
1714
+ patience: 10000
1715
+ prefetch_factor: 2
1716
+ raytune: *id001
1717
+ seed: 12345
1718
+ slurm_partition: ${project.gpu_partition}
1719
+ slurm_runtime: 168h
1720
+ sort_data: false
1721
+ task_loss_weights: *id002
1722
+ tensorboard_step_freq: 100
1723
+ test_datasets:
1724
+ - name: colliderml_ttbar_nopu_pf
1725
+ splits:
1726
+ - '1'
1727
+ - '2'
1728
+ - '3'
1729
+ - '4'
1730
+ - '5'
1731
+ - '6'
1732
+ - '7'
1733
+ - '8'
1734
+ - '9'
1735
+ - '10'
1736
+ version: 1.5.0
1737
+ - name: colliderml_ttbar_pu200_pf
1738
+ splits:
1739
+ - '1'
1740
+ - '2'
1741
+ - '3'
1742
+ - '4'
1743
+ - '5'
1744
+ - '6'
1745
+ - '7'
1746
+ - '8'
1747
+ - '9'
1748
+ - '10'
1749
+ version: 1.5.0
1750
+ threads: 16
1751
+ train_datasets:
1752
+ pu0:
1753
+ batch_size: 12
1754
+ samples:
1755
+ - name: colliderml_ttbar_nopu_pf
1756
+ splits:
1757
+ - '1'
1758
+ - '2'
1759
+ - '3'
1760
+ - '4'
1761
+ - '5'
1762
+ - '6'
1763
+ - '7'
1764
+ - '8'
1765
+ - '9'
1766
+ - '10'
1767
+ version: 1.5.0
1768
+ pu200:
1769
+ batch_size: 1
1770
+ samples:
1771
+ - name: colliderml_ttbar_pu200_pf
1772
+ splits:
1773
+ - '1'
1774
+ - '2'
1775
+ - '3'
1776
+ - '4'
1777
+ - '5'
1778
+ - '6'
1779
+ - '7'
1780
+ - '8'
1781
+ - '9'
1782
+ - '10'
1783
+ version: 1.5.0
1784
+ val_freq: 10000
1785
+ validation_datasets:
1786
+ pu0:
1787
+ batch_size: 12
1788
+ samples:
1789
+ - name: colliderml_ttbar_nopu_pf
1790
+ splits:
1791
+ - '1'
1792
+ - '2'
1793
+ - '3'
1794
+ - '4'
1795
+ - '5'
1796
+ - '6'
1797
+ - '7'
1798
+ - '8'
1799
+ - '9'
1800
+ - '10'
1801
+ version: 1.5.0
1802
+ pu200:
1803
+ batch_size: 1
1804
+ samples:
1805
+ - name: colliderml_ttbar_pu200_pf
1806
+ splits:
1807
+ - '1'
1808
+ - '2'
1809
+ - '3'
1810
+ - '4'
1811
+ - '5'
1812
+ - '6'
1813
+ - '7'
1814
+ - '8'
1815
+ - '9'
1816
+ - '10'
1817
+ version: 1.5.0
1818
+ pyg-colliderml-pu200-v1:
1819
+ architecture:
1820
+ attention:
1821
+ attention_type: flash
1822
+ head_dim: 16
1823
+ num_convs: 3
1824
+ num_heads: 16
1825
+ heptv2:
1826
+ track_hash_at_calo: true
1827
+ input_encoding: split
1828
+ type: attention
1829
+ backend: pytorch
1830
+ checkpoint_freq: 10000
1831
+ comet: false
1832
+ dataset: colliderml
1833
+ dtype: bfloat16
1834
+ gpu_batch_multiplier: 8
1835
+ gpu_type: l40
1836
+ gpus: 1
1837
+ hyperparameters:
1838
+ batch_size: 1
1839
+ lr: 0.0001
1840
+ load: null
1841
+ lr_schedule: cosinedecay
1842
+ mem_per_gpu_mb: 40000
1843
+ ntest: 100
1844
+ ntrain: null
1845
+ num_steps: 100000
1846
+ num_workers: 2
1847
+ nvalid: null
1848
+ optimizer: lamb
1849
+ patience: 10000
1850
+ prefetch_factor: 2
1851
+ raytune: *id001
1852
+ seed: 12345
1853
+ slurm_partition: ${project.gpu_partition}
1854
+ slurm_runtime: 168h
1855
+ sort_data: false
1856
+ task_loss_weights: *id002
1857
+ tensorboard_step_freq: 100
1858
+ test_datasets:
1859
+ - name: colliderml_ttbar_pu200_pf
1860
+ splits:
1861
+ - '1'
1862
+ - '2'
1863
+ - '3'
1864
+ - '4'
1865
+ - '5'
1866
+ - '6'
1867
+ - '7'
1868
+ - '8'
1869
+ - '9'
1870
+ - '10'
1871
+ version: 1.5.0
1872
+ threads: 16
1873
+ train_datasets:
1874
+ physical:
1875
+ batch_size: 1
1876
+ samples:
1877
+ - name: colliderml_ttbar_pu200_pf
1878
+ splits:
1879
+ - '1'
1880
+ - '2'
1881
+ - '3'
1882
+ - '4'
1883
+ - '5'
1884
+ - '6'
1885
+ - '7'
1886
+ - '8'
1887
+ - '9'
1888
+ - '10'
1889
+ version: 1.5.0
1890
+ val_freq: 10000
1891
+ validation_datasets:
1892
+ physical:
1893
+ batch_size: 1
1894
+ samples:
1895
+ - name: colliderml_ttbar_pu200_pf
1896
+ splits:
1897
+ - '1'
1898
+ - '2'
1899
+ - '3'
1900
+ - '4'
1901
+ - '5'
1902
+ - '6'
1903
+ - '7'
1904
+ - '8'
1905
+ - '9'
1906
+ - '10'
1907
+ version: 1.5.0
1908
+ pyg-colliderml-v1:
1909
+ architecture: *id017
1910
+ backend: pytorch
1911
+ checkpoint_freq: 10000
1912
+ comet: false
1913
+ dataset: colliderml
1914
+ dtype: bfloat16
1915
+ gpu_batch_multiplier: 8
1916
+ gpu_type: l40
1917
+ gpus: 1
1918
+ hyperparameters: *id018
1919
+ load: null
1920
+ lr_schedule: cosinedecay
1921
+ mem_per_gpu_mb: 40000
1922
+ ntest: 100
1923
+ ntrain: null
1924
+ num_steps: 100000
1925
+ num_workers: 2
1926
+ nvalid: null
1927
+ optimizer: lamb
1928
+ patience: 10000
1929
+ prefetch_factor: 2
1930
+ raytune: *id001
1931
+ seed: 12345
1932
+ slurm_partition: ${project.gpu_partition}
1933
+ slurm_runtime: 168h
1934
+ sort_data: false
1935
+ task_loss_weights: *id002
1936
+ tensorboard_step_freq: 100
1937
+ test_datasets:
1938
+ - name: colliderml_ttbar_nopu_pf
1939
+ splits:
1940
+ - '1'
1941
+ - '2'
1942
+ - '3'
1943
+ - '4'
1944
+ - '5'
1945
+ - '6'
1946
+ - '7'
1947
+ - '8'
1948
+ - '9'
1949
+ - '10'
1950
+ version: 1.5.0
1951
+ threads: 16
1952
+ train_datasets:
1953
+ physical:
1954
+ batch_size: 1
1955
+ samples:
1956
+ - name: colliderml_ttbar_nopu_pf
1957
+ splits:
1958
+ - '1'
1959
+ - '2'
1960
+ - '3'
1961
+ - '4'
1962
+ - '5'
1963
+ - '6'
1964
+ - '7'
1965
+ - '8'
1966
+ - '9'
1967
+ - '10'
1968
+ version: 1.5.0
1969
+ val_freq: 10000
1970
+ validation_datasets:
1971
+ physical:
1972
+ batch_size: 1
1973
+ samples:
1974
+ - name: colliderml_ttbar_nopu_pf
1975
+ splits:
1976
+ - '1'
1977
+ - '2'
1978
+ - '3'
1979
+ - '4'
1980
+ - '5'
1981
+ - '6'
1982
+ - '7'
1983
+ - '8'
1984
+ - '9'
1985
+ - '10'
1986
+ version: 1.5.0
1987
+ pyg-idea-pipeline-v1:
1988
+ architecture:
1989
+ heptv2:
1990
+ block_size: 100
1991
+ dropout_ff: 0.0
1992
+ embedding_dim: 256
1993
+ num_convs: 3
1994
+ num_heads: 16
1995
+ track_hash_at_calo: true
1996
+ width: 256
1997
+ input_encoding: split
1998
+ type: heptv2
1999
+ backend: pytorch
2000
+ checkpoint_freq: 10000
2001
+ comet: false
2002
+ dataset: idea
2003
+ dtype: bfloat16
2004
+ gpu_batch_multiplier: 16
2005
+ gpu_type: l40
2006
+ gpus: 1
2007
+ hyperparameters:
2008
+ batch_size: 1
2009
+ lr: 0.0005
2010
+ load: null
2011
+ lr_schedule: cosinedecay
2012
+ mem_per_gpu_mb: 40000
2013
+ ntest: 100
2014
+ ntrain: null
2015
+ num_steps: 100000
2016
+ num_workers: 2
2017
+ nvalid: null
2018
+ optimizer: lamb
2019
+ pad_to_multiple_elements: 100
2020
+ patience: 10000
2021
+ prefetch_factor: 2
2022
+ raytune: *id001
2023
+ seed: 12345
2024
+ slurm_partition: ${project.gpu_partition}
2025
+ slurm_runtime: 168h
2026
+ sort_data: false
2027
+ task_loss_weights: *id002
2028
+ tensorboard_step_freq: 100
2029
+ test_datasets:
2030
+ - name: idea_edm_qq_pf
2031
+ splits:
2032
+ - '1'
2033
+ version: 0.2.1
2034
+ - name: idea_edm_ttbar_pf
2035
+ splits:
2036
+ - '1'
2037
+ version: 0.2.1
2038
+ - name: idea_edm_ww_fullhad_pf
2039
+ splits:
2040
+ - '1'
2041
+ version: 0.2.1
2042
+ threads: 16
2043
+ train_datasets:
2044
+ physical:
2045
+ batch_size: 1
2046
+ samples:
2047
+ - name: idea_edm_qq_pf
2048
+ splits:
2049
+ - '1'
2050
+ version: 0.2.1
2051
+ - name: idea_edm_ttbar_pf
2052
+ splits:
2053
+ - '1'
2054
+ version: 0.2.1
2055
+ - name: idea_edm_ww_fullhad_pf
2056
+ splits:
2057
+ - '1'
2058
+ version: 0.2.1
2059
+ val_freq: 10000
2060
+ validation_datasets:
2061
+ physical:
2062
+ batch_size: 1
2063
+ samples:
2064
+ - name: idea_edm_qq_pf
2065
+ splits:
2066
+ - '1'
2067
+ version: 0.2.1
2068
+ - name: idea_edm_ttbar_pf
2069
+ splits:
2070
+ - '1'
2071
+ version: 0.2.1
2072
+ - name: idea_edm_ww_fullhad_pf
2073
+ splits:
2074
+ - '1'
2075
+ version: 0.2.1
2076
+ pyg-maia-v1:
2077
+ architecture:
2078
+ attention:
2079
+ head_dim: 16
2080
+ num_convs: 3
2081
+ num_heads: 16
2082
+ input_encoding: split
2083
+ type: attention
2084
+ backend: pytorch
2085
+ checkpoint_freq: 10000
2086
+ comet: false
2087
+ dataset: maia
2088
+ dtype: bfloat16
2089
+ gpu_batch_multiplier: 1
2090
+ gpu_type: l40
2091
+ gpus: 1
2092
+ hyperparameters:
2093
+ batch_size: 1
2094
+ lr: 0.0001
2095
+ load: null
2096
+ lr_schedule: cosinedecay
2097
+ mem_per_gpu_mb: 40000
2098
+ ntest: 100
2099
+ ntrain: null
2100
+ num_steps: 100000
2101
+ num_workers: 2
2102
+ nvalid: null
2103
+ optimizer: lamb
2104
+ patience: 10000
2105
+ prefetch_factor: 2
2106
+ raytune: *id001
2107
+ seed: 12345
2108
+ slurm_partition: ${project.gpu_partition}
2109
+ slurm_runtime: 168h
2110
+ sort_data: false
2111
+ task_loss_weights: *id002
2112
+ tensorboard_step_freq: 100
2113
+ test_datasets:
2114
+ - name: maia_edm_ttbar_pf
2115
+ splits:
2116
+ - '10'
2117
+ version: 1.1.0
2118
+ threads: 16
2119
+ train_datasets:
2120
+ physical:
2121
+ batch_size: 1
2122
+ samples:
2123
+ - name: maia_edm_ttbar_pf
2124
+ splits:
2125
+ - '10'
2126
+ version: 1.1.0
2127
+ val_freq: 10000
2128
+ validation_datasets:
2129
+ physical:
2130
+ batch_size: 1
2131
+ samples:
2132
+ - name: maia_edm_ttbar_pf
2133
+ splits:
2134
+ - '10'
2135
+ version: 1.1.0
2136
+ productions:
2137
+ cld:
2138
+ comment: CLD production with Key4Hep
2139
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2140
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2141
+ memory:
2142
+ gen: 4000
2143
+ post: 2000
2144
+ tfds: 16000
2145
+ model: pyg-cld-v1
2146
+ postprocessing:
2147
+ args: {}
2148
+ script: mlpf/data/key4hep/postprocessing.py
2149
+ samples:
2150
+ gun_e_10gev:
2151
+ events_per_job: 100
2152
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2153
+ process_name: gun_e_10gev
2154
+ seed_range:
2155
+ - 424242
2156
+ - 424342
2157
+ gun_mu_10gev:
2158
+ events_per_job: 100
2159
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2160
+ process_name: gun_mu_10gev
2161
+ seed_range:
2162
+ - 600000
2163
+ - 600100
2164
+ gun_pi_10gev:
2165
+ events_per_job: 100
2166
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2167
+ process_name: gun_pi_10gev
2168
+ seed_range:
2169
+ - 700000
2170
+ - 700100
2171
+ qq:
2172
+ events_per_job: 100
2173
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2174
+ process_name: p8_ee_qq_ecm365
2175
+ seed_range:
2176
+ - 500000
2177
+ - 510010
2178
+ ttbar:
2179
+ events_per_job: 100
2180
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2181
+ process_name: p8_ee_ttbar_ecm365
2182
+ seed_range:
2183
+ - 300000
2184
+ - 310010
2185
+ ww_fullhad:
2186
+ events_per_job: 100
2187
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2188
+ process_name: p8_ee_WW_fullhad_ecm365
2189
+ seed_range:
2190
+ - 400000
2191
+ - 410010
2192
+ z_qq:
2193
+ events_per_job: 100
2194
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2195
+ process_name: p8_ee_Z_qq_ecm91
2196
+ seed_range:
2197
+ - 600000
2198
+ - 610010
2199
+ z_tautau:
2200
+ events_per_job: 100
2201
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2202
+ process_name: p8_ee_Z_tautau_ecm91
2203
+ seed_range:
2204
+ - 700000
2205
+ - 710010
2206
+ zh_tautau_240:
2207
+ events_per_job: 100
2208
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2209
+ process_name: p8_ee_ZH_Htautau_ecm240
2210
+ seed_range:
2211
+ - 200000
2212
+ - 200110
2213
+ zh_tautau_365:
2214
+ events_per_job: 100
2215
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2216
+ process_name: p8_ee_ZH_Htautau_ecm365
2217
+ seed_range:
2218
+ - 200000
2219
+ - 200110
2220
+ zz:
2221
+ events_per_job: 100
2222
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2223
+ process_name: p8_ee_ZZ_ecm365
2224
+ seed_range:
2225
+ - 100000
2226
+ - 105010
2227
+ zz_tautau_240:
2228
+ events_per_job: 100
2229
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2230
+ process_name: p8_ee_ZZ_tautau_ecm240
2231
+ seed_range:
2232
+ - 100000
2233
+ - 100110
2234
+ zz_tautau_365:
2235
+ events_per_job: 100
2236
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2237
+ process_name: p8_ee_ZZ_tautau_ecm365
2238
+ seed_range:
2239
+ - 100000
2240
+ - 110010
2241
+ slurm_partition: main
2242
+ slurm_runtime: 48h
2243
+ tfds_hit_mapping:
2244
+ qq:
2245
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/qq
2246
+ config_ids:
2247
+ - 1
2248
+ - 2
2249
+ - 3
2250
+ - 4
2251
+ - 5
2252
+ - 6
2253
+ - 7
2254
+ - 8
2255
+ - 9
2256
+ - 10
2257
+ version: 3.2.2
2258
+ ttbar:
2259
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2260
+ config_ids:
2261
+ - 1
2262
+ - 2
2263
+ - 3
2264
+ - 4
2265
+ - 5
2266
+ - 6
2267
+ - 7
2268
+ - 8
2269
+ - 9
2270
+ - 10
2271
+ version: 3.2.2
2272
+ ww_fullhad:
2273
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ww_fullhad
2274
+ config_ids:
2275
+ - 1
2276
+ - 2
2277
+ - 3
2278
+ - 4
2279
+ - 5
2280
+ - 6
2281
+ - 7
2282
+ - 8
2283
+ - 9
2284
+ - 10
2285
+ version: 3.2.2
2286
+ zz:
2287
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/zz
2288
+ config_ids:
2289
+ - 1
2290
+ - 2
2291
+ - 3
2292
+ - 4
2293
+ - 5
2294
+ - 6
2295
+ - 7
2296
+ - 8
2297
+ - 9
2298
+ - 10
2299
+ version: 3.2.2
2300
+ tfds_mapping:
2301
+ qq:
2302
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/qq
2303
+ config_ids:
2304
+ - 1
2305
+ - 2
2306
+ - 3
2307
+ - 4
2308
+ - 5
2309
+ - 6
2310
+ - 7
2311
+ - 8
2312
+ - 9
2313
+ - 10
2314
+ version: 3.3.0
2315
+ ttbar:
2316
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2317
+ config_ids:
2318
+ - 1
2319
+ - 2
2320
+ - 3
2321
+ - 4
2322
+ - 5
2323
+ - 6
2324
+ - 7
2325
+ - 8
2326
+ - 9
2327
+ - 10
2328
+ version: 3.3.0
2329
+ ww_fullhad:
2330
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ww_fullhad
2331
+ config_ids:
2332
+ - 1
2333
+ - 2
2334
+ - 3
2335
+ - 4
2336
+ - 5
2337
+ - 6
2338
+ - 7
2339
+ - 8
2340
+ - 9
2341
+ - 10
2342
+ version: 3.3.0
2343
+ zz:
2344
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/zz
2345
+ config_ids:
2346
+ - 1
2347
+ - 2
2348
+ - 3
2349
+ - 4
2350
+ - 5
2351
+ - 6
2352
+ - 7
2353
+ - 8
2354
+ - 9
2355
+ - 10
2356
+ version: 3.3.0
2357
+ type: key4hep
2358
+ workspace_dir: ${project.paths.storage_root}/cld/v1.2.5_key4hep_2025-05-29
2359
+ cld_clic_colliderml:
2360
+ comment: Joint CLD+CLIC+ColliderML pu0 tracks/clusters
2361
+ model: pyg-cldcliccolliderml-v1
2362
+ source_productions:
2363
+ cld: cld
2364
+ clic: clic
2365
+ colliderml: colliderml
2366
+ type: key4hep
2367
+ cld_ecal_pitch_1p5:
2368
+ cms_energy: 91
2369
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 1.5 mm
2370
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_1p5mm/CLD_o2_v07.xml
2371
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2372
+ dataset_only: true
2373
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2374
+ memory: &id019
2375
+ gen: 8000
2376
+ post: 8000
2377
+ tfds: 8000
2378
+ model: pyg-cld-v1
2379
+ postprocessing: &id020
2380
+ args: {}
2381
+ script: mlpf/data/key4hep/postprocessing.py
2382
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2383
+ samples: &id021
2384
+ z_tautau:
2385
+ events_per_job: 100
2386
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2387
+ process_name: p8_ee_Z_tautau_ecm91
2388
+ seed_range:
2389
+ - 700000
2390
+ - 700100
2391
+ slurm_partition: main
2392
+ slurm_runtime: 48h
2393
+ tfds_hit_mapping: &id022
2394
+ z_tautau:
2395
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/z_tautau
2396
+ config_ids:
2397
+ - 1
2398
+ - 2
2399
+ - 3
2400
+ - 4
2401
+ - 5
2402
+ - 6
2403
+ - 7
2404
+ - 8
2405
+ - 9
2406
+ - 10
2407
+ version: 3.2.2
2408
+ tfds_mapping: &id023
2409
+ z_tautau:
2410
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/z_tautau
2411
+ config_ids:
2412
+ - 1
2413
+ - 2
2414
+ - 3
2415
+ - 4
2416
+ - 5
2417
+ - 6
2418
+ - 7
2419
+ - 8
2420
+ - 9
2421
+ - 10
2422
+ version: 3.3.0
2423
+ type: key4hep
2424
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_1p5mm
2425
+ cld_ecal_pitch_2:
2426
+ cms_energy: 91
2427
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2 mm
2428
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2mm/CLD_o2_v07.xml
2429
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2430
+ dataset_only: true
2431
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2432
+ memory: *id019
2433
+ model: pyg-cld-v1
2434
+ postprocessing: *id020
2435
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2436
+ samples: *id021
2437
+ slurm_partition: main
2438
+ slurm_runtime: 48h
2439
+ tfds_hit_mapping: *id022
2440
+ tfds_mapping: *id023
2441
+ type: key4hep
2442
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2mm
2443
+ cld_ecal_pitch_2p5:
2444
+ cms_energy: 91
2445
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2.5 mm
2446
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2p5mm/CLD_o2_v07.xml
2447
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2448
+ dataset_only: true
2449
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2450
+ memory: *id019
2451
+ model: pyg-cld-v1
2452
+ postprocessing: *id020
2453
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2454
+ samples: *id021
2455
+ slurm_partition: main
2456
+ slurm_runtime: 48h
2457
+ tfds_hit_mapping: *id022
2458
+ tfds_mapping: *id023
2459
+ type: key4hep
2460
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2p5mm
2461
+ cld_ecal_pitch_3:
2462
+ cms_energy: 91
2463
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 3 mm
2464
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_3mm/CLD_o2_v07.xml
2465
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2466
+ dataset_only: true
2467
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2468
+ memory: *id019
2469
+ model: pyg-cld-v1
2470
+ postprocessing: *id020
2471
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2472
+ samples: *id021
2473
+ slurm_partition: main
2474
+ slurm_runtime: 48h
2475
+ tfds_hit_mapping: *id022
2476
+ tfds_mapping: *id023
2477
+ type: key4hep
2478
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_3mm
2479
+ cld_ecal_pitch_4:
2480
+ cms_energy: 91
2481
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 4 mm
2482
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_4mm/CLD_o2_v07.xml
2483
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2484
+ dataset_only: true
2485
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2486
+ memory: *id019
2487
+ model: pyg-cld-v1
2488
+ postprocessing: *id020
2489
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2490
+ samples: *id021
2491
+ slurm_partition: main
2492
+ slurm_runtime: 48h
2493
+ tfds_hit_mapping: *id022
2494
+ tfds_mapping: *id023
2495
+ type: key4hep
2496
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_4mm
2497
+ cld_ecal_pitch_5p1:
2498
+ cms_energy: 91
2499
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 5.1 mm
2500
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_5p1mm/CLD_o2_v07.xml
2501
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2502
+ dataset_only: true
2503
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2504
+ memory: *id019
2505
+ model: pyg-cld-v1
2506
+ postprocessing: *id020
2507
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2508
+ samples: *id021
2509
+ slurm_partition: main
2510
+ slurm_runtime: 48h
2511
+ tfds_hit_mapping: *id022
2512
+ tfds_mapping: *id023
2513
+ type: key4hep
2514
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_5p1mm
2515
+ cld_hcal_pitch_10:
2516
+ cms_energy: 365
2517
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 10 mm
2518
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_10mm/CLD_o2_v07.xml
2519
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2520
+ dataset_only: true
2521
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2522
+ memory: &id024
2523
+ gen: 12000
2524
+ post: 16000
2525
+ tfds: 16000
2526
+ model: pyg-cld-v1
2527
+ postprocessing: &id025
2528
+ args: {}
2529
+ script: mlpf/data/key4hep/postprocessing.py
2530
+ samples: &id026
2531
+ ttbar:
2532
+ events_per_job: 100
2533
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2534
+ process_name: p8_ee_ttbar_ecm365
2535
+ seed_range:
2536
+ - 300000
2537
+ - 300100
2538
+ slurm_partition: main
2539
+ slurm_runtime: 48h
2540
+ tfds_hit_mapping: &id027
2541
+ ttbar:
2542
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2543
+ config_ids:
2544
+ - 1
2545
+ - 2
2546
+ - 3
2547
+ - 4
2548
+ - 5
2549
+ - 6
2550
+ - 7
2551
+ - 8
2552
+ - 9
2553
+ - 10
2554
+ version: 3.2.2
2555
+ tfds_mapping: &id028
2556
+ ttbar:
2557
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2558
+ config_ids:
2559
+ - 1
2560
+ - 2
2561
+ - 3
2562
+ - 4
2563
+ - 5
2564
+ - 6
2565
+ - 7
2566
+ - 8
2567
+ - 9
2568
+ - 10
2569
+ version: 3.3.0
2570
+ type: key4hep
2571
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_10mm
2572
+ cld_hcal_pitch_12:
2573
+ cms_energy: 365
2574
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 12 mm
2575
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_12mm/CLD_o2_v07.xml
2576
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2577
+ dataset_only: true
2578
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2579
+ memory: *id024
2580
+ model: pyg-cld-v1
2581
+ postprocessing: *id025
2582
+ samples: *id026
2583
+ slurm_partition: main
2584
+ slurm_runtime: 48h
2585
+ tfds_hit_mapping: *id027
2586
+ tfds_mapping: *id028
2587
+ type: key4hep
2588
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_12mm
2589
+ cld_hcal_pitch_15:
2590
+ cms_energy: 365
2591
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 15 mm
2592
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_15mm/CLD_o2_v07.xml
2593
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2594
+ dataset_only: true
2595
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2596
+ memory: *id024
2597
+ model: pyg-cld-v1
2598
+ postprocessing: *id025
2599
+ samples: *id026
2600
+ slurm_partition: main
2601
+ slurm_runtime: 48h
2602
+ tfds_hit_mapping: *id027
2603
+ tfds_mapping: *id028
2604
+ type: key4hep
2605
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_15mm
2606
+ cld_hcal_pitch_20:
2607
+ cms_energy: 365
2608
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 20 mm
2609
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_20mm/CLD_o2_v07.xml
2610
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2611
+ dataset_only: true
2612
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2613
+ memory: *id024
2614
+ model: pyg-cld-v1
2615
+ postprocessing: *id025
2616
+ samples: *id026
2617
+ slurm_partition: main
2618
+ slurm_runtime: 48h
2619
+ tfds_hit_mapping: *id027
2620
+ tfds_mapping: *id028
2621
+ type: key4hep
2622
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_20mm
2623
+ cld_hcal_pitch_25:
2624
+ cms_energy: 365
2625
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 25 mm
2626
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_25mm/CLD_o2_v07.xml
2627
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2628
+ dataset_only: true
2629
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2630
+ memory: *id024
2631
+ model: pyg-cld-v1
2632
+ postprocessing: *id025
2633
+ samples: *id026
2634
+ slurm_partition: main
2635
+ slurm_runtime: 48h
2636
+ tfds_hit_mapping: *id027
2637
+ tfds_mapping: *id028
2638
+ type: key4hep
2639
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_25mm
2640
+ cld_hcal_pitch_30:
2641
+ cms_energy: 365
2642
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 30 mm
2643
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_30mm/CLD_o2_v07.xml
2644
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2645
+ dataset_only: true
2646
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2647
+ memory: *id024
2648
+ model: pyg-cld-v1
2649
+ postprocessing: *id025
2650
+ samples: *id026
2651
+ slurm_partition: main
2652
+ slurm_runtime: 48h
2653
+ tfds_hit_mapping: *id027
2654
+ tfds_mapping: *id028
2655
+ type: key4hep
2656
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_30mm
2657
+ clic:
2658
+ comment: CLIC production with Key4Hep
2659
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/clic
2660
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2661
+ memory:
2662
+ gen: 4000
2663
+ post: 2000
2664
+ tfds: 16000
2665
+ model: pyg-clic-v1
2666
+ postprocessing:
2667
+ args: {}
2668
+ script: mlpf/data/key4hep/postprocessing.py
2669
+ samples:
2670
+ qq:
2671
+ events_per_job: 100
2672
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2673
+ process_name: p8_ee_qq_ecm380
2674
+ seed_range:
2675
+ - 500000
2676
+ - 510010
2677
+ ttbar:
2678
+ events_per_job: 100
2679
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2680
+ process_name: p8_ee_ttbar_ecm380
2681
+ seed_range:
2682
+ - 300000
2683
+ - 310010
2684
+ ww_fullhad:
2685
+ events_per_job: 100
2686
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2687
+ process_name: p8_ee_WW_fullhad_ecm380
2688
+ seed_range:
2689
+ - 400000
2690
+ - 410010
2691
+ slurm_partition: main
2692
+ slurm_runtime: 48h
2693
+ tfds_hit_mapping:
2694
+ qq:
2695
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/qq
2696
+ config_ids:
2697
+ - 1
2698
+ - 2
2699
+ - 3
2700
+ - 4
2701
+ - 5
2702
+ - 6
2703
+ - 7
2704
+ - 8
2705
+ - 9
2706
+ - 10
2707
+ version: 3.2.2
2708
+ ttbar:
2709
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ttbar
2710
+ config_ids:
2711
+ - 1
2712
+ - 2
2713
+ - 3
2714
+ - 4
2715
+ - 5
2716
+ - 6
2717
+ - 7
2718
+ - 8
2719
+ - 9
2720
+ - 10
2721
+ version: 3.2.2
2722
+ ww_fullhad:
2723
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ww_fullhad
2724
+ config_ids:
2725
+ - 1
2726
+ - 2
2727
+ - 3
2728
+ - 4
2729
+ - 5
2730
+ - 6
2731
+ - 7
2732
+ - 8
2733
+ - 9
2734
+ - 10
2735
+ version: 3.2.2
2736
+ tfds_mapping:
2737
+ qq:
2738
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/qq
2739
+ config_ids:
2740
+ - 1
2741
+ - 2
2742
+ - 3
2743
+ - 4
2744
+ - 5
2745
+ - 6
2746
+ - 7
2747
+ - 8
2748
+ - 9
2749
+ - 10
2750
+ version: 3.3.0
2751
+ ttbar:
2752
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ttbar
2753
+ config_ids:
2754
+ - 1
2755
+ - 2
2756
+ - 3
2757
+ - 4
2758
+ - 5
2759
+ - 6
2760
+ - 7
2761
+ - 8
2762
+ - 9
2763
+ - 10
2764
+ version: 3.3.0
2765
+ ww_fullhad:
2766
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ww_fullhad
2767
+ config_ids:
2768
+ - 1
2769
+ - 2
2770
+ - 3
2771
+ - 4
2772
+ - 5
2773
+ - 6
2774
+ - 7
2775
+ - 8
2776
+ - 9
2777
+ - 10
2778
+ version: 3.3.0
2779
+ type: key4hep
2780
+ workspace_dir: ${project.paths.storage_root}/clic/v1.2.5_key4hep_2025-05-29
2781
+ cms_run3:
2782
+ comment: Main production with CMSSW_15_0_5
2783
+ config_dir: ${project.paths.project_root}
2784
+ environment:
2785
+ cmssw_dir: ${project.cmssw_dir}
2786
+ cmssw_release: CMSSW_15_0_5
2787
+ scram_arch: el8_amd64_gcc12
2788
+ gen_container: /cvmfs/singularity.opensciencegrid.org/cmssw/cms:rhel8-x86_64
2789
+ memory:
2790
+ gen: 6000
2791
+ post: 4000
2792
+ tfds: 16000
2793
+ train: 16000
2794
+ val: 8000
2795
+ model: pyg-cms-v1
2796
+ postprocessing:
2797
+ args:
2798
+ num_events: -1
2799
+ save_full_graph: false
2800
+ script: mlpf/data/cms/postprocessing2.py
2801
+ samples:
2802
+ qcd_nopu:
2803
+ events_per_job: 100
2804
+ gen_script: mlpf/data/cms/genjob_pu.sh
2805
+ output_subdir: nopu
2806
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2807
+ pu_type: nopu
2808
+ seed_range:
2809
+ - 1000000
2810
+ - 1010010
2811
+ qcd_pu:
2812
+ events_per_job: 100
2813
+ gen_script: mlpf/data/cms/genjob_pu.sh
2814
+ output_subdir: pu55to75
2815
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2816
+ pu_type: pu55to75
2817
+ seed_range:
2818
+ - 300000
2819
+ - 310010
2820
+ qcd_val:
2821
+ copy_step2: true
2822
+ events_per_job: 100
2823
+ gen_script: mlpf/data/cms/genjob_pu.sh
2824
+ output_subdir: pu55to75_val
2825
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2826
+ pu_type: pu55to75
2827
+ seed_range:
2828
+ - 400000
2829
+ - 401010
2830
+ ttbar_nopu:
2831
+ events_per_job: 100
2832
+ gen_script: mlpf/data/cms/genjob_pu.sh
2833
+ output_subdir: nopu
2834
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2835
+ pu_type: nopu
2836
+ seed_range:
2837
+ - 800000
2838
+ - 810010
2839
+ ttbar_pu:
2840
+ events_per_job: 50
2841
+ gen_script: mlpf/data/cms/genjob_pu.sh
2842
+ output_subdir: pu55to75
2843
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2844
+ pu_type: pu55to75
2845
+ seed_range:
2846
+ - 100000
2847
+ - 110010
2848
+ ztt_nopu:
2849
+ events_per_job: 100
2850
+ gen_script: mlpf/data/cms/genjob_pu.sh
2851
+ output_subdir: nopu
2852
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2853
+ pu_type: nopu
2854
+ seed_range:
2855
+ - 1100000
2856
+ - 1110010
2857
+ ztt_pu:
2858
+ events_per_job: 100
2859
+ gen_script: mlpf/data/cms/genjob_pu.sh
2860
+ output_subdir: pu55to75
2861
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2862
+ pu_type: pu55to75
2863
+ seed_range:
2864
+ - 200000
2865
+ - 210010
2866
+ slurm_partition: ${project.cpu_partition}
2867
+ slurm_runtime: 48h
2868
+ tfds_mapping:
2869
+ qcd_nopu:
2870
+ builder_path: mlpf/heptfds/cms_pf/qcd_nopu
2871
+ config_ids:
2872
+ - 1
2873
+ - 2
2874
+ - 3
2875
+ - 4
2876
+ - 5
2877
+ - 6
2878
+ - 7
2879
+ - 8
2880
+ - 9
2881
+ - 10
2882
+ version: 3.2.0
2883
+ qcd_pu:
2884
+ builder_path: mlpf/heptfds/cms_pf/qcd
2885
+ config_ids:
2886
+ - 1
2887
+ - 2
2888
+ - 3
2889
+ - 4
2890
+ - 5
2891
+ - 6
2892
+ - 7
2893
+ - 8
2894
+ - 9
2895
+ - 10
2896
+ version: 3.2.0
2897
+ ttbar_nopu:
2898
+ builder_path: mlpf/heptfds/cms_pf/ttbar_nopu
2899
+ config_ids:
2900
+ - 1
2901
+ - 2
2902
+ - 3
2903
+ - 4
2904
+ - 5
2905
+ - 6
2906
+ - 7
2907
+ - 8
2908
+ - 9
2909
+ - 10
2910
+ version: 3.2.0
2911
+ ttbar_pu:
2912
+ builder_path: mlpf/heptfds/cms_pf/ttbar
2913
+ config_ids:
2914
+ - 1
2915
+ - 2
2916
+ - 3
2917
+ - 4
2918
+ - 5
2919
+ - 6
2920
+ - 7
2921
+ - 8
2922
+ - 9
2923
+ - 10
2924
+ version: 3.2.0
2925
+ ztt_nopu:
2926
+ builder_path: mlpf/heptfds/cms_pf/ztt_nopu
2927
+ config_ids:
2928
+ - 1
2929
+ - 2
2930
+ - 3
2931
+ - 4
2932
+ - 5
2933
+ - 6
2934
+ - 7
2935
+ - 8
2936
+ - 9
2937
+ - 10
2938
+ version: 3.2.0
2939
+ ztt_pu:
2940
+ builder_path: mlpf/heptfds/cms_pf/ztt
2941
+ config_ids:
2942
+ - 1
2943
+ - 2
2944
+ - 3
2945
+ - 4
2946
+ - 5
2947
+ - 6
2948
+ - 7
2949
+ - 8
2950
+ - 9
2951
+ - 10
2952
+ version: 3.2.0
2953
+ type: cms
2954
+ validation:
2955
+ job_types:
2956
+ - pf
2957
+ - mlpf
2958
+ threads: 8
2959
+ use_cuda: false
2960
+ validation_data:
2961
+ job_types:
2962
+ - pf
2963
+ - mlpf
2964
+ samples:
2965
+ jetmet0:
2966
+ input_filelist: data/cms/run3/${project.site_name}/jetmet0.txt
2967
+ output_subdir: Run2024C
2968
+ seed_range:
2969
+ - 1
2970
+ - 100
2971
+ threads: 8
2972
+ use_cuda: false
2973
+ workspace_dir: ${project.paths.storage_root}/cms/20260204_cmssw_15_0_5_117d32
2974
+ colliderml:
2975
+ comment: ColliderML Release 1 ttbar (no pileup), clustered view (tracks + our
2976
+ spatial clusters)
2977
+ download_root: /mnt/ceph/users/ewulff/data/colliderml/CERN__ColliderML-Release-1
2978
+ memory:
2979
+ post: 32000
2980
+ tfds: 32000
2981
+ postprocessing:
2982
+ args: {}
2983
+ script: mlpf/data/colliderml/postprocessing.py
2984
+ samples:
2985
+ ttbar_pu0:
2986
+ source_dir: ${productions.colliderml.download_root}
2987
+ ttbar_pu200:
2988
+ source_dir: ${productions.colliderml.download_root}
2989
+ source_revision: 64c3d2f112df3d5d20979d22da7cfdff13e10c4b
2990
+ tfds_hit_mapping:
2991
+ ttbar_pu0:
2992
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar
2993
+ config_ids:
2994
+ - 1
2995
+ - 2
2996
+ - 3
2997
+ - 4
2998
+ - 5
2999
+ - 6
3000
+ - 7
3001
+ - 8
3002
+ - 9
3003
+ - 10
3004
+ version: 1.3.0
3005
+ ttbar_pu200:
3006
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar_pu200
3007
+ config_ids:
3008
+ - 1
3009
+ - 2
3010
+ - 3
3011
+ - 4
3012
+ - 5
3013
+ - 6
3014
+ - 7
3015
+ - 8
3016
+ - 9
3017
+ - 10
3018
+ version: 1.3.0
3019
+ tfds_mapping:
3020
+ ttbar_pu0:
3021
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar
3022
+ config_ids:
3023
+ - 1
3024
+ - 2
3025
+ - 3
3026
+ - 4
3027
+ - 5
3028
+ - 6
3029
+ - 7
3030
+ - 8
3031
+ - 9
3032
+ - 10
3033
+ version: 1.5.0
3034
+ ttbar_pu200:
3035
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar_pu200
3036
+ config_ids:
3037
+ - 1
3038
+ - 2
3039
+ - 3
3040
+ - 4
3041
+ - 5
3042
+ - 6
3043
+ - 7
3044
+ - 8
3045
+ - 9
3046
+ - 10
3047
+ version: 1.5.0
3048
+ type: colliderml
3049
+ workspace_dir: ${productions.colliderml.workspace_root}/v1_release1_64c3d2f1
3050
+ workspace_root: /mnt/ceph/users/ewulff/mlpf/colliderml
3051
+ idea:
3052
+ comment: IDEA_o1_v03 pipeline validation with truth-seeded proxy tracks
3053
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/idea
3054
+ environment:
3055
+ progress_interval: 60
3056
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
3057
+ memory:
3058
+ gen: 16000
3059
+ post: 4000
3060
+ tfds: 8000
3061
+ model: pyg-idea-pipeline-v1
3062
+ postprocessing:
3063
+ args: {}
3064
+ script: mlpf/data/key4hep/postprocessing.py
3065
+ samples:
3066
+ gun_e_10gev:
3067
+ events_per_job: 100
3068
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3069
+ process_name: gun_e_10gev
3070
+ seed_range:
3071
+ - 424242
3072
+ - 424342
3073
+ gun_mu_10gev:
3074
+ events_per_job: 100
3075
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3076
+ process_name: gun_mu_10gev
3077
+ seed_range:
3078
+ - 600000
3079
+ - 600100
3080
+ gun_pi_10gev:
3081
+ events_per_job: 100
3082
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3083
+ process_name: gun_pi_10gev
3084
+ seed_range:
3085
+ - 700000
3086
+ - 700100
3087
+ qq:
3088
+ events_per_job: 100
3089
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3090
+ process_name: p8_ee_qq_ecm365
3091
+ seed_range:
3092
+ - 500000
3093
+ - 500100
3094
+ ttbar:
3095
+ events_per_job: 100
3096
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3097
+ process_name: p8_ee_ttbar_ecm365
3098
+ seed_range:
3099
+ - 300000
3100
+ - 300100
3101
+ ww_fullhad:
3102
+ events_per_job: 100
3103
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3104
+ process_name: p8_ee_WW_fullhad_ecm365
3105
+ seed_range:
3106
+ - 400000
3107
+ - 400100
3108
+ slurm_partition: main
3109
+ slurm_runtime: 48h
3110
+ tfds_mapping:
3111
+ qq:
3112
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/qq
3113
+ config_ids:
3114
+ - 1
3115
+ version: 0.2.1
3116
+ ttbar:
3117
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ttbar
3118
+ config_ids:
3119
+ - 1
3120
+ version: 0.2.1
3121
+ ww_fullhad:
3122
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ww_fullhad
3123
+ config_ids:
3124
+ - 1
3125
+ version: 0.2.1
3126
+ type: key4hep
3127
+ workspace_dir: ${project.paths.storage_root}/idea/IDEA_o1_v03_fccconfig_a05a3a9
3128
+ maia:
3129
+ comment: Local MAIA ttbar EDM4hep validation sample
3130
+ config_dir: ${project.paths.project_root}
3131
+ model: pyg-maia-v1
3132
+ type: maia
3133
+ workspace_dir: ${project.paths.project_root}/local_test_data/maia_smoke
3134
+ project:
3135
+ bind_mounts: &id029
3136
+ - /local
3137
+ - /cvmfs
3138
+ - /scratch/local
3139
+ - /scratch/persistent
3140
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3141
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3142
+ cpu_partition: main
3143
+ description: Machine Learning for Particle Flow Reconstruction
3144
+ executor: slurm
3145
+ gpu_partition: gpu
3146
+ name: particleflow
3147
+ paths: &id030
3148
+ project_root: /home/joosep/particleflow
3149
+ scratch_root: /scratch/local/joosep
3150
+ storage_root: /local/joosep/mlpf
3151
+ tmpdir: /scratch/local/joosep/tmp
3152
+ site_name: tallinn
3153
+ sites:
3154
+ local:
3155
+ bind_mounts:
3156
+ - /tmp
3157
+ - /mnt/work
3158
+ cmssw_dir: /home/joosep/particleflow/CMSSW_15_0_5
3159
+ container: https://jpata.web.cern.ch/jpata/particleflow-29042026-de861d.sif
3160
+ cpu_partition: local
3161
+ executor: local
3162
+ gpu_partition: local
3163
+ paths:
3164
+ project_root: /home/joosep/particleflow
3165
+ scratch_root: /tmp/particleflow
3166
+ storage_root: /mnt/work/mlpf/
3167
+ tmpdir: /tmp/particleflow/tmp
3168
+ site_name: local
3169
+ lxplus:
3170
+ bind_mounts:
3171
+ - /afs
3172
+ - /cvmfs
3173
+ - /eos/user/j/jpata
3174
+ - /etc/pki/ca-trust
3175
+ - /etc/tnsnames.ora
3176
+ - /run
3177
+ cmssw_dir: /cvmfs/cms.cern.ch
3178
+ container: /eos/user/j/jpata/www/particleflow-20260330-cd2f54.sif
3179
+ cpu_partition: tomorrow
3180
+ executor: condor
3181
+ gpu_partition: tomorrow
3182
+ paths:
3183
+ project_root: /afs/cern.ch/work/j/jpata/particleflow
3184
+ scratch_root: /tmp
3185
+ storage_root: /eos/user/j/jpata/mlpf
3186
+ tmpdir: /tmp
3187
+ site_name: lxplus
3188
+ tallinn:
3189
+ bind_mounts: *id029
3190
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3191
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3192
+ cpu_partition: main
3193
+ executor: slurm
3194
+ gpu_partition: gpu
3195
+ paths: *id030
3196
+ site_name: tallinn
3197
+ slurm_account: hepusers
3198
+ slurm_account: hepusers
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_eta.pdf ADDED
Binary file (22 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_eta.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt.pdf ADDED
Binary file (21.2 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.pdf ADDED
Binary file (21.5 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res.pdf ADDED
Binary file (25.2 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res_vstarget.pdf ADDED
Binary file (24.2 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/jet_res_vstarget.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/num_elements.pdf ADDED
Binary file (11.2 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/plots_step_80000/cld_edm_ttbar_pf/num_elements.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/runs/train/events.out.tfevents.1794650650.workergpu215.1009066.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29529b353f6c9c8275fac9d54e005780c6d22cd68508b52ff890760fb4e430d9
3
+ size 2953648
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/runs/valid/events.out.tfevents.1794650650.workergpu215.1009066.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7668287a1d2b8c35d3e476c77dc77768df7b5e97bab19aceb888490d9ff5ec32
3
+ size 4026739
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/scenario-manifest.json ADDED
@@ -0,0 +1,1299 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "scenario": {
3
+ "name": "pf_fm_experts",
4
+ "spec_file": "particleflow_spec.yaml",
5
+ "production_name": "cld",
6
+ "variants": {
7
+ "cld": {
8
+ "model_name": "pyg-cld-v1",
9
+ "production_name": null,
10
+ "gpus": null,
11
+ "data_root": null,
12
+ "data_subdir": null,
13
+ "overrides": {}
14
+ },
15
+ "clic": {
16
+ "model_name": "pyg-clic-v1",
17
+ "production_name": "clic",
18
+ "gpus": null,
19
+ "data_root": null,
20
+ "data_subdir": null,
21
+ "overrides": {}
22
+ },
23
+ "idea": {
24
+ "model_name": "pyg-idea-pipeline-v1",
25
+ "production_name": "idea",
26
+ "gpus": null,
27
+ "data_root": null,
28
+ "data_subdir": null,
29
+ "overrides": {}
30
+ },
31
+ "colliderml": {
32
+ "model_name": "pyg-colliderml-v1",
33
+ "production_name": "colliderml",
34
+ "gpus": null,
35
+ "data_root": null,
36
+ "data_subdir": null,
37
+ "overrides": {}
38
+ },
39
+ "cld_ecal_1p5mm": {
40
+ "model_name": "pyg-cld-v1",
41
+ "production_name": "cld",
42
+ "gpus": null,
43
+ "data_root": "cld_granularity",
44
+ "data_subdir": "ecal_1p5mm/tfds",
45
+ "overrides": {
46
+ "model.feature_bag": true,
47
+ "train_dataset.cld.physical.samples": {
48
+ "cld_edm_z_tautau_pf": {
49
+ "version": "3.3.0",
50
+ "splits": [
51
+ "1",
52
+ "2",
53
+ "3",
54
+ "4",
55
+ "5",
56
+ "6",
57
+ "7",
58
+ "8",
59
+ "9",
60
+ "10"
61
+ ]
62
+ }
63
+ },
64
+ "valid_dataset.cld.physical.samples": {
65
+ "cld_edm_z_tautau_pf": {
66
+ "version": "3.3.0",
67
+ "splits": [
68
+ "1",
69
+ "2",
70
+ "3",
71
+ "4",
72
+ "5",
73
+ "6",
74
+ "7",
75
+ "8",
76
+ "9",
77
+ "10"
78
+ ]
79
+ }
80
+ },
81
+ "test_dataset": {
82
+ "cld_edm_z_tautau_pf": {
83
+ "version": "3.3.0",
84
+ "splits": [
85
+ "1",
86
+ "2",
87
+ "3",
88
+ "4",
89
+ "5",
90
+ "6",
91
+ "7",
92
+ "8",
93
+ "9",
94
+ "10"
95
+ ]
96
+ }
97
+ }
98
+ }
99
+ },
100
+ "cld_ecal_2mm": {
101
+ "model_name": "pyg-cld-v1",
102
+ "production_name": "cld",
103
+ "gpus": null,
104
+ "data_root": "cld_granularity",
105
+ "data_subdir": "ecal_2mm/tfds",
106
+ "overrides": {
107
+ "model.feature_bag": true,
108
+ "train_dataset.cld.physical.samples": {
109
+ "cld_edm_z_tautau_pf": {
110
+ "version": "3.3.0",
111
+ "splits": [
112
+ "1",
113
+ "2",
114
+ "3",
115
+ "4",
116
+ "5",
117
+ "6",
118
+ "7",
119
+ "8",
120
+ "9",
121
+ "10"
122
+ ]
123
+ }
124
+ },
125
+ "valid_dataset.cld.physical.samples": {
126
+ "cld_edm_z_tautau_pf": {
127
+ "version": "3.3.0",
128
+ "splits": [
129
+ "1",
130
+ "2",
131
+ "3",
132
+ "4",
133
+ "5",
134
+ "6",
135
+ "7",
136
+ "8",
137
+ "9",
138
+ "10"
139
+ ]
140
+ }
141
+ },
142
+ "test_dataset": {
143
+ "cld_edm_z_tautau_pf": {
144
+ "version": "3.3.0",
145
+ "splits": [
146
+ "1",
147
+ "2",
148
+ "3",
149
+ "4",
150
+ "5",
151
+ "6",
152
+ "7",
153
+ "8",
154
+ "9",
155
+ "10"
156
+ ]
157
+ }
158
+ }
159
+ }
160
+ },
161
+ "cld_ecal_2p5mm": {
162
+ "model_name": "pyg-cld-v1",
163
+ "production_name": "cld",
164
+ "gpus": null,
165
+ "data_root": "cld_granularity",
166
+ "data_subdir": "ecal_2p5mm/tfds",
167
+ "overrides": {
168
+ "model.feature_bag": true,
169
+ "train_dataset.cld.physical.samples": {
170
+ "cld_edm_z_tautau_pf": {
171
+ "version": "3.3.0",
172
+ "splits": [
173
+ "1",
174
+ "2",
175
+ "3",
176
+ "4",
177
+ "5",
178
+ "6",
179
+ "7",
180
+ "8",
181
+ "9",
182
+ "10"
183
+ ]
184
+ }
185
+ },
186
+ "valid_dataset.cld.physical.samples": {
187
+ "cld_edm_z_tautau_pf": {
188
+ "version": "3.3.0",
189
+ "splits": [
190
+ "1",
191
+ "2",
192
+ "3",
193
+ "4",
194
+ "5",
195
+ "6",
196
+ "7",
197
+ "8",
198
+ "9",
199
+ "10"
200
+ ]
201
+ }
202
+ },
203
+ "test_dataset": {
204
+ "cld_edm_z_tautau_pf": {
205
+ "version": "3.3.0",
206
+ "splits": [
207
+ "1",
208
+ "2",
209
+ "3",
210
+ "4",
211
+ "5",
212
+ "6",
213
+ "7",
214
+ "8",
215
+ "9",
216
+ "10"
217
+ ]
218
+ }
219
+ }
220
+ }
221
+ },
222
+ "cld_ecal_3mm": {
223
+ "model_name": "pyg-cld-v1",
224
+ "production_name": "cld",
225
+ "gpus": null,
226
+ "data_root": "cld_granularity",
227
+ "data_subdir": "ecal_3mm/tfds",
228
+ "overrides": {
229
+ "model.feature_bag": true,
230
+ "train_dataset.cld.physical.samples": {
231
+ "cld_edm_z_tautau_pf": {
232
+ "version": "3.3.0",
233
+ "splits": [
234
+ "1",
235
+ "2",
236
+ "3",
237
+ "4",
238
+ "5",
239
+ "6",
240
+ "7",
241
+ "8",
242
+ "9",
243
+ "10"
244
+ ]
245
+ }
246
+ },
247
+ "valid_dataset.cld.physical.samples": {
248
+ "cld_edm_z_tautau_pf": {
249
+ "version": "3.3.0",
250
+ "splits": [
251
+ "1",
252
+ "2",
253
+ "3",
254
+ "4",
255
+ "5",
256
+ "6",
257
+ "7",
258
+ "8",
259
+ "9",
260
+ "10"
261
+ ]
262
+ }
263
+ },
264
+ "test_dataset": {
265
+ "cld_edm_z_tautau_pf": {
266
+ "version": "3.3.0",
267
+ "splits": [
268
+ "1",
269
+ "2",
270
+ "3",
271
+ "4",
272
+ "5",
273
+ "6",
274
+ "7",
275
+ "8",
276
+ "9",
277
+ "10"
278
+ ]
279
+ }
280
+ }
281
+ }
282
+ },
283
+ "cld_ecal_4mm": {
284
+ "model_name": "pyg-cld-v1",
285
+ "production_name": "cld",
286
+ "gpus": null,
287
+ "data_root": "cld_granularity",
288
+ "data_subdir": "ecal_4mm/tfds",
289
+ "overrides": {
290
+ "model.feature_bag": true,
291
+ "train_dataset.cld.physical.samples": {
292
+ "cld_edm_z_tautau_pf": {
293
+ "version": "3.3.0",
294
+ "splits": [
295
+ "1",
296
+ "2",
297
+ "3",
298
+ "4",
299
+ "5",
300
+ "6",
301
+ "7",
302
+ "8",
303
+ "9",
304
+ "10"
305
+ ]
306
+ }
307
+ },
308
+ "valid_dataset.cld.physical.samples": {
309
+ "cld_edm_z_tautau_pf": {
310
+ "version": "3.3.0",
311
+ "splits": [
312
+ "1",
313
+ "2",
314
+ "3",
315
+ "4",
316
+ "5",
317
+ "6",
318
+ "7",
319
+ "8",
320
+ "9",
321
+ "10"
322
+ ]
323
+ }
324
+ },
325
+ "test_dataset": {
326
+ "cld_edm_z_tautau_pf": {
327
+ "version": "3.3.0",
328
+ "splits": [
329
+ "1",
330
+ "2",
331
+ "3",
332
+ "4",
333
+ "5",
334
+ "6",
335
+ "7",
336
+ "8",
337
+ "9",
338
+ "10"
339
+ ]
340
+ }
341
+ }
342
+ }
343
+ },
344
+ "cld_ecal_5p1mm": {
345
+ "model_name": "pyg-cld-v1",
346
+ "production_name": "cld",
347
+ "gpus": null,
348
+ "data_root": "cld_granularity",
349
+ "data_subdir": "ecal_5p1mm/tfds",
350
+ "overrides": {
351
+ "model.feature_bag": true,
352
+ "train_dataset.cld.physical.samples": {
353
+ "cld_edm_z_tautau_pf": {
354
+ "version": "3.3.0",
355
+ "splits": [
356
+ "1",
357
+ "2",
358
+ "3",
359
+ "4",
360
+ "5",
361
+ "6",
362
+ "7",
363
+ "8",
364
+ "9",
365
+ "10"
366
+ ]
367
+ }
368
+ },
369
+ "valid_dataset.cld.physical.samples": {
370
+ "cld_edm_z_tautau_pf": {
371
+ "version": "3.3.0",
372
+ "splits": [
373
+ "1",
374
+ "2",
375
+ "3",
376
+ "4",
377
+ "5",
378
+ "6",
379
+ "7",
380
+ "8",
381
+ "9",
382
+ "10"
383
+ ]
384
+ }
385
+ },
386
+ "test_dataset": {
387
+ "cld_edm_z_tautau_pf": {
388
+ "version": "3.3.0",
389
+ "splits": [
390
+ "1",
391
+ "2",
392
+ "3",
393
+ "4",
394
+ "5",
395
+ "6",
396
+ "7",
397
+ "8",
398
+ "9",
399
+ "10"
400
+ ]
401
+ }
402
+ }
403
+ }
404
+ },
405
+ "cld_hcal_10mm": {
406
+ "model_name": "pyg-cld-v1",
407
+ "production_name": "cld",
408
+ "gpus": null,
409
+ "data_root": "cld_granularity",
410
+ "data_subdir": "hcal_10mm/tfds",
411
+ "overrides": {
412
+ "model.feature_bag": true,
413
+ "train_dataset.cld.physical.samples": {
414
+ "cld_edm_ttbar_pf": {
415
+ "version": "3.3.0",
416
+ "splits": [
417
+ "1",
418
+ "2",
419
+ "3",
420
+ "4",
421
+ "5",
422
+ "6",
423
+ "7",
424
+ "8",
425
+ "9",
426
+ "10"
427
+ ]
428
+ }
429
+ },
430
+ "valid_dataset.cld.physical.samples": {
431
+ "cld_edm_ttbar_pf": {
432
+ "version": "3.3.0",
433
+ "splits": [
434
+ "1",
435
+ "2",
436
+ "3",
437
+ "4",
438
+ "5",
439
+ "6",
440
+ "7",
441
+ "8",
442
+ "9",
443
+ "10"
444
+ ]
445
+ }
446
+ },
447
+ "test_dataset": {
448
+ "cld_edm_ttbar_pf": {
449
+ "version": "3.3.0",
450
+ "splits": [
451
+ "1",
452
+ "2",
453
+ "3",
454
+ "4",
455
+ "5",
456
+ "6",
457
+ "7",
458
+ "8",
459
+ "9",
460
+ "10"
461
+ ]
462
+ }
463
+ }
464
+ }
465
+ },
466
+ "cld_hcal_12mm": {
467
+ "model_name": "pyg-cld-v1",
468
+ "production_name": "cld",
469
+ "gpus": null,
470
+ "data_root": "cld_granularity",
471
+ "data_subdir": "hcal_12mm/tfds",
472
+ "overrides": {
473
+ "model.feature_bag": true,
474
+ "train_dataset.cld.physical.samples": {
475
+ "cld_edm_ttbar_pf": {
476
+ "version": "3.3.0",
477
+ "splits": [
478
+ "1",
479
+ "2",
480
+ "3",
481
+ "4",
482
+ "5",
483
+ "6",
484
+ "7",
485
+ "8",
486
+ "9",
487
+ "10"
488
+ ]
489
+ }
490
+ },
491
+ "valid_dataset.cld.physical.samples": {
492
+ "cld_edm_ttbar_pf": {
493
+ "version": "3.3.0",
494
+ "splits": [
495
+ "1",
496
+ "2",
497
+ "3",
498
+ "4",
499
+ "5",
500
+ "6",
501
+ "7",
502
+ "8",
503
+ "9",
504
+ "10"
505
+ ]
506
+ }
507
+ },
508
+ "test_dataset": {
509
+ "cld_edm_ttbar_pf": {
510
+ "version": "3.3.0",
511
+ "splits": [
512
+ "1",
513
+ "2",
514
+ "3",
515
+ "4",
516
+ "5",
517
+ "6",
518
+ "7",
519
+ "8",
520
+ "9",
521
+ "10"
522
+ ]
523
+ }
524
+ }
525
+ }
526
+ },
527
+ "cld_hcal_15mm": {
528
+ "model_name": "pyg-cld-v1",
529
+ "production_name": "cld",
530
+ "gpus": null,
531
+ "data_root": "cld_granularity",
532
+ "data_subdir": "hcal_15mm/tfds",
533
+ "overrides": {
534
+ "model.feature_bag": true,
535
+ "train_dataset.cld.physical.samples": {
536
+ "cld_edm_ttbar_pf": {
537
+ "version": "3.3.0",
538
+ "splits": [
539
+ "1",
540
+ "2",
541
+ "3",
542
+ "4",
543
+ "5",
544
+ "6",
545
+ "7",
546
+ "8",
547
+ "9",
548
+ "10"
549
+ ]
550
+ }
551
+ },
552
+ "valid_dataset.cld.physical.samples": {
553
+ "cld_edm_ttbar_pf": {
554
+ "version": "3.3.0",
555
+ "splits": [
556
+ "1",
557
+ "2",
558
+ "3",
559
+ "4",
560
+ "5",
561
+ "6",
562
+ "7",
563
+ "8",
564
+ "9",
565
+ "10"
566
+ ]
567
+ }
568
+ },
569
+ "test_dataset": {
570
+ "cld_edm_ttbar_pf": {
571
+ "version": "3.3.0",
572
+ "splits": [
573
+ "1",
574
+ "2",
575
+ "3",
576
+ "4",
577
+ "5",
578
+ "6",
579
+ "7",
580
+ "8",
581
+ "9",
582
+ "10"
583
+ ]
584
+ }
585
+ }
586
+ }
587
+ },
588
+ "cld_hcal_20mm": {
589
+ "model_name": "pyg-cld-v1",
590
+ "production_name": "cld",
591
+ "gpus": null,
592
+ "data_root": "cld_granularity",
593
+ "data_subdir": "hcal_20mm/tfds",
594
+ "overrides": {
595
+ "model.feature_bag": true,
596
+ "train_dataset.cld.physical.samples": {
597
+ "cld_edm_ttbar_pf": {
598
+ "version": "3.3.0",
599
+ "splits": [
600
+ "1",
601
+ "2",
602
+ "3",
603
+ "4",
604
+ "5",
605
+ "6",
606
+ "7",
607
+ "8",
608
+ "9",
609
+ "10"
610
+ ]
611
+ }
612
+ },
613
+ "valid_dataset.cld.physical.samples": {
614
+ "cld_edm_ttbar_pf": {
615
+ "version": "3.3.0",
616
+ "splits": [
617
+ "1",
618
+ "2",
619
+ "3",
620
+ "4",
621
+ "5",
622
+ "6",
623
+ "7",
624
+ "8",
625
+ "9",
626
+ "10"
627
+ ]
628
+ }
629
+ },
630
+ "test_dataset": {
631
+ "cld_edm_ttbar_pf": {
632
+ "version": "3.3.0",
633
+ "splits": [
634
+ "1",
635
+ "2",
636
+ "3",
637
+ "4",
638
+ "5",
639
+ "6",
640
+ "7",
641
+ "8",
642
+ "9",
643
+ "10"
644
+ ]
645
+ }
646
+ }
647
+ }
648
+ },
649
+ "cld_hcal_25mm": {
650
+ "model_name": "pyg-cld-v1",
651
+ "production_name": "cld",
652
+ "gpus": null,
653
+ "data_root": "cld_granularity",
654
+ "data_subdir": "hcal_25mm/tfds",
655
+ "overrides": {
656
+ "model.feature_bag": true,
657
+ "train_dataset.cld.physical.samples": {
658
+ "cld_edm_ttbar_pf": {
659
+ "version": "3.3.0",
660
+ "splits": [
661
+ "1",
662
+ "2",
663
+ "3",
664
+ "4",
665
+ "5",
666
+ "6",
667
+ "7",
668
+ "8",
669
+ "9",
670
+ "10"
671
+ ]
672
+ }
673
+ },
674
+ "valid_dataset.cld.physical.samples": {
675
+ "cld_edm_ttbar_pf": {
676
+ "version": "3.3.0",
677
+ "splits": [
678
+ "1",
679
+ "2",
680
+ "3",
681
+ "4",
682
+ "5",
683
+ "6",
684
+ "7",
685
+ "8",
686
+ "9",
687
+ "10"
688
+ ]
689
+ }
690
+ },
691
+ "test_dataset": {
692
+ "cld_edm_ttbar_pf": {
693
+ "version": "3.3.0",
694
+ "splits": [
695
+ "1",
696
+ "2",
697
+ "3",
698
+ "4",
699
+ "5",
700
+ "6",
701
+ "7",
702
+ "8",
703
+ "9",
704
+ "10"
705
+ ]
706
+ }
707
+ }
708
+ }
709
+ },
710
+ "cld_hcal_30mm": {
711
+ "model_name": "pyg-cld-v1",
712
+ "production_name": "cld",
713
+ "gpus": null,
714
+ "data_root": "cld_granularity",
715
+ "data_subdir": "hcal_30mm/tfds",
716
+ "overrides": {
717
+ "model.feature_bag": true,
718
+ "train_dataset.cld.physical.samples": {
719
+ "cld_edm_ttbar_pf": {
720
+ "version": "3.3.0",
721
+ "splits": [
722
+ "1",
723
+ "2",
724
+ "3",
725
+ "4",
726
+ "5",
727
+ "6",
728
+ "7",
729
+ "8",
730
+ "9",
731
+ "10"
732
+ ]
733
+ }
734
+ },
735
+ "valid_dataset.cld.physical.samples": {
736
+ "cld_edm_ttbar_pf": {
737
+ "version": "3.3.0",
738
+ "splits": [
739
+ "1",
740
+ "2",
741
+ "3",
742
+ "4",
743
+ "5",
744
+ "6",
745
+ "7",
746
+ "8",
747
+ "9",
748
+ "10"
749
+ ]
750
+ }
751
+ },
752
+ "test_dataset": {
753
+ "cld_edm_ttbar_pf": {
754
+ "version": "3.3.0",
755
+ "splits": [
756
+ "1",
757
+ "2",
758
+ "3",
759
+ "4",
760
+ "5",
761
+ "6",
762
+ "7",
763
+ "8",
764
+ "9",
765
+ "10"
766
+ ]
767
+ }
768
+ }
769
+ }
770
+ }
771
+ },
772
+ "seeds": [
773
+ 12345
774
+ ],
775
+ "training": {
776
+ "global_batch_size": 16,
777
+ "parameters": {
778
+ "optimizer": "lamb",
779
+ "lr": 0.0005,
780
+ "lr_schedule": "onecycle",
781
+ "lr_schedule_config.onecycle.pct_start": 0.3,
782
+ "num_steps": 500000,
783
+ "tensorboard_step_freq": 1000,
784
+ "benchmark.enabled": true,
785
+ "benchmark.sample_interval_seconds": 1.0,
786
+ "benchmark.warmup_steps": 100,
787
+ "benchmark.gpu_timing_interval": 0,
788
+ "val_freq": 10000,
789
+ "checkpoint_freq": 2000,
790
+ "patience": 3,
791
+ "nvalid": 256,
792
+ "ntest": 256,
793
+ "sampler_mode": "interleaved-shards",
794
+ "pad_to_multiple_elements": 128,
795
+ "validation_particle_metrics": true,
796
+ "make_plots": true
797
+ }
798
+ },
799
+ "common_overrides": {
800
+ "model.type": "attention",
801
+ "model.heptv2": null,
802
+ "model.attention": {
803
+ "num_convs": 6,
804
+ "num_heads": 16,
805
+ "head_dim": 16,
806
+ "attention_type": "flash",
807
+ "dropout_ff": 0.0
808
+ },
809
+ "model.input_encoding": "split",
810
+ "model.input_normalization": true,
811
+ "model.backbone.mode": "shared",
812
+ "model.backbone.num_convs": 6
813
+ },
814
+ "allowed_variant_differences": [
815
+ "model.feature_bag",
816
+ "data_dir",
817
+ "dataset",
818
+ "hyperparameters.lr",
819
+ "input_dim",
820
+ "train_dataset",
821
+ "valid_dataset",
822
+ "test_dataset",
823
+ "enabled_test_datasets"
824
+ ]
825
+ },
826
+ "platform": {
827
+ "name": "flatiron_h100_single",
828
+ "gpus": 1,
829
+ "python_command": [
830
+ "uv",
831
+ "run",
832
+ "python3"
833
+ ],
834
+ "data_dir": {
835
+ "cld": "/mnt/ceph/users/jpata/mlpf/cld/v1.2.5_key4hep_2025-05-29/tfds",
836
+ "clic": "/mnt/ceph/users/jpata/mlpf/clic/v1.2.5_key4hep_2025-05-29/tfds",
837
+ "idea": "/mnt/ceph/users/jpata/mlpf/idea/IDEA_o1_v03_fccconfig_a05a3a9/tfds",
838
+ "colliderml": "/mnt/ceph/users/ewulff/tensorflow_datasets/colliderml/",
839
+ "cld_granularity": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29"
840
+ },
841
+ "experiments_dir": "/mnt/home/jpata/particleflow/experiments",
842
+ "environment": {},
843
+ "runtime_overrides": {
844
+ "dtype": "bfloat16",
845
+ "num_workers": 8,
846
+ "prefetch_factor": 2,
847
+ "model.attention.use_flash_attn_varlen": false
848
+ },
849
+ "slurm": {
850
+ "partition": "gpu",
851
+ "constraint": "h100",
852
+ "account": null,
853
+ "qos": null,
854
+ "reservation": null,
855
+ "time": "48:00:00",
856
+ "nodes": 1,
857
+ "tasks_per_node": 1,
858
+ "cpus_per_task": 64,
859
+ "cpus_per_gpu": 24,
860
+ "gpu_request": "gpus-per-task",
861
+ "gpu_type": null,
862
+ "memory": "128G",
863
+ "memory_per_gpu": null,
864
+ "no_requeue": false
865
+ }
866
+ },
867
+ "job": {
868
+ "scenario_name": "pf_fm_experts",
869
+ "platform_name": "flatiron_h100_single",
870
+ "variant_name": "cld_hcal_12mm",
871
+ "model_name": "pyg-cld-v1",
872
+ "production_name": "cld",
873
+ "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_12mm/tfds",
874
+ "seed": 12345,
875
+ "global_batch_size": 16,
876
+ "per_gpu_batch_size": 16,
877
+ "gpu_batch_multiplier": 16,
878
+ "settings": {
879
+ "optimizer": "lamb",
880
+ "lr": 0.0005,
881
+ "lr_schedule": "onecycle",
882
+ "lr_schedule_config.onecycle.pct_start": 0.3,
883
+ "num_steps": 500000,
884
+ "tensorboard_step_freq": 1000,
885
+ "benchmark.enabled": true,
886
+ "benchmark.sample_interval_seconds": 1.0,
887
+ "benchmark.warmup_steps": 100,
888
+ "benchmark.gpu_timing_interval": 0,
889
+ "val_freq": 10000,
890
+ "checkpoint_freq": 2000,
891
+ "patience": 3,
892
+ "nvalid": 256,
893
+ "ntest": 256,
894
+ "sampler_mode": "interleaved-shards",
895
+ "pad_to_multiple_elements": 128,
896
+ "validation_particle_metrics": true,
897
+ "make_plots": true,
898
+ "model.type": "attention",
899
+ "model.heptv2": null,
900
+ "model.attention": {
901
+ "num_convs": 6,
902
+ "num_heads": 16,
903
+ "head_dim": 16,
904
+ "attention_type": "flash",
905
+ "dropout_ff": 0.0
906
+ },
907
+ "model.input_encoding": "split",
908
+ "model.input_normalization": true,
909
+ "model.backbone.mode": "shared",
910
+ "model.backbone.num_convs": 6,
911
+ "dtype": "bfloat16",
912
+ "num_workers": 8,
913
+ "prefetch_factor": 2,
914
+ "model.attention.use_flash_attn_varlen": false,
915
+ "model.feature_bag": true,
916
+ "train_dataset.cld.physical.samples": {
917
+ "cld_edm_ttbar_pf": {
918
+ "version": "3.3.0",
919
+ "splits": [
920
+ "1",
921
+ "2",
922
+ "3",
923
+ "4",
924
+ "5",
925
+ "6",
926
+ "7",
927
+ "8",
928
+ "9",
929
+ "10"
930
+ ]
931
+ }
932
+ },
933
+ "valid_dataset.cld.physical.samples": {
934
+ "cld_edm_ttbar_pf": {
935
+ "version": "3.3.0",
936
+ "splits": [
937
+ "1",
938
+ "2",
939
+ "3",
940
+ "4",
941
+ "5",
942
+ "6",
943
+ "7",
944
+ "8",
945
+ "9",
946
+ "10"
947
+ ]
948
+ }
949
+ },
950
+ "test_dataset": {
951
+ "cld_edm_ttbar_pf": {
952
+ "version": "3.3.0",
953
+ "splits": [
954
+ "1",
955
+ "2",
956
+ "3",
957
+ "4",
958
+ "5",
959
+ "6",
960
+ "7",
961
+ "8",
962
+ "9",
963
+ "10"
964
+ ]
965
+ }
966
+ },
967
+ "seed": 12345,
968
+ "gpu_batch_multiplier": 16
969
+ }
970
+ },
971
+ "resolved_config": {
972
+ "dataset": "cld",
973
+ "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_12mm/tfds",
974
+ "model": {
975
+ "type": "attention",
976
+ "input_encoding": "split",
977
+ "learned_representation_mode": "last",
978
+ "pt_mode": "direct-elemtype-split",
979
+ "eta_mode": "linear",
980
+ "sin_phi_mode": "linear",
981
+ "cos_phi_mode": "linear",
982
+ "energy_mode": "direct-elemtype-split",
983
+ "trainable": "all",
984
+ "task_queries": true,
985
+ "output_mode": "elementwise",
986
+ "binary_classification_focal_gamma": null,
987
+ "backbone": {
988
+ "mode": "shared",
989
+ "num_convs": 6,
990
+ "num_tracker_layers": null,
991
+ "num_calo_layers": null,
992
+ "num_common_layers": null
993
+ },
994
+ "hit_feature_engineering": {
995
+ "enabled": true,
996
+ "geometry": true,
997
+ "tracker_neighborhood": false,
998
+ "tracker_momentum": false,
999
+ "tracker_doublets": false,
1000
+ "calorimeter_neighborhood": true
1001
+ },
1002
+ "set_decoder": null,
1003
+ "input_normalization": true,
1004
+ "feature_bag": true,
1005
+ "gnnlsh": null,
1006
+ "attention": {
1007
+ "num_convs": 6,
1008
+ "dropout_ff": 0.0,
1009
+ "activation": "elu",
1010
+ "layernorm": true,
1011
+ "num_heads": 16,
1012
+ "head_dim": 16,
1013
+ "attention_type": "flash",
1014
+ "dropout_conv_reg_mha": 0.0,
1015
+ "dropout_conv_reg_ff": 0.0,
1016
+ "dropout_conv_id_mha": 0.0,
1017
+ "dropout_conv_id_ff": 0.0,
1018
+ "use_pre_layernorm": true,
1019
+ "use_jagged_attention": false,
1020
+ "use_flash_attn_varlen": false,
1021
+ "export_onnx_fused": false,
1022
+ "save_attention": false
1023
+ },
1024
+ "litept": null,
1025
+ "hept": null,
1026
+ "heptv2": null
1027
+ },
1028
+ "conv_type": "attention",
1029
+ "batch_size": 1,
1030
+ "hyperparameters": {
1031
+ "batch_size": 1,
1032
+ "lr": 0.0005
1033
+ },
1034
+ "backend": "pytorch",
1035
+ "threads": 16,
1036
+ "gpu_type": "l40",
1037
+ "mem_per_gpu_mb": 40000,
1038
+ "slurm_partition": "gpu",
1039
+ "slurm_runtime": "168h",
1040
+ "input_dim": 19,
1041
+ "num_classes": 6,
1042
+ "elemtypes_nonzero": [
1043
+ 1,
1044
+ 2
1045
+ ],
1046
+ "seed": 12345,
1047
+ "num_steps": 500000,
1048
+ "patience": 3,
1049
+ "checkpoint_freq": 2000,
1050
+ "val_freq": 10000,
1051
+ "num_workers": 8,
1052
+ "prefetch_factor": 2,
1053
+ "max_open_readers": 64,
1054
+ "gpu_batch_multiplier": 16,
1055
+ "dtype": "bfloat16",
1056
+ "lr": 0.0005,
1057
+ "weight_decay": 0.01,
1058
+ "optimizer": "lamb",
1059
+ "lr_schedule": "onecycle",
1060
+ "lr_schedule_config": {
1061
+ "onecycle": {
1062
+ "pct_start": 0.3
1063
+ }
1064
+ },
1065
+ "task_loss_weights": {
1066
+ "calibration_steps": 100,
1067
+ "epsilon": 1e-08,
1068
+ "min_weight": 0.01,
1069
+ "max_weight": 1000.0
1070
+ },
1071
+ "lr_finder": {
1072
+ "start_lr": 1e-07,
1073
+ "end_lr": 0.1,
1074
+ "num_steps": 1000,
1075
+ "smoothing": 0.98,
1076
+ "divergence_factor": 4.0
1077
+ },
1078
+ "pad_to_multiple_elements": 128,
1079
+ "validation_diagnostics_batches": 0,
1080
+ "validation_linear_probe": false,
1081
+ "validation_linear_probe_max_events": 16,
1082
+ "validation_particle_metrics": true,
1083
+ "train": true,
1084
+ "lr_find": false,
1085
+ "test": true,
1086
+ "compile": false,
1087
+ "make_plots": true,
1088
+ "sort_data": false,
1089
+ "sampler_mode": "interleaved-shards",
1090
+ "load": null,
1091
+ "relaxed_load": false,
1092
+ "load_weights_only": false,
1093
+ "reset_task_loss_weights": false,
1094
+ "sampler_from_scratch": false,
1095
+ "comet": false,
1096
+ "comet_offline": false,
1097
+ "comet_name": "particleflow",
1098
+ "tensorboard_step_freq": 1000,
1099
+ "benchmark": {
1100
+ "enabled": true,
1101
+ "sample_interval_seconds": 1.0,
1102
+ "warmup_steps": 100,
1103
+ "gpu_timing_interval": 0
1104
+ },
1105
+ "raytune": {
1106
+ "local_dir": null,
1107
+ "sched": "asha",
1108
+ "search_alg": null,
1109
+ "default_metric": "val_loss",
1110
+ "default_mode": "min",
1111
+ "asha": {
1112
+ "max_t": 200,
1113
+ "reduction_factor": 4,
1114
+ "brackets": 1,
1115
+ "grace_period": 10
1116
+ },
1117
+ "hyperband": {
1118
+ "max_t": 200,
1119
+ "reduction_factor": 4
1120
+ },
1121
+ "hyperopt": {
1122
+ "n_random_steps": 10
1123
+ },
1124
+ "nevergrad": {
1125
+ "n_random_steps": 10
1126
+ }
1127
+ },
1128
+ "train_dataset": {
1129
+ "cld": {
1130
+ "physical": {
1131
+ "batch_size": 1,
1132
+ "weight": null,
1133
+ "samples": {
1134
+ "cld_edm_ttbar_pf": {
1135
+ "version": "3.3.0",
1136
+ "splits": [
1137
+ "1",
1138
+ "2",
1139
+ "3",
1140
+ "4",
1141
+ "5",
1142
+ "6",
1143
+ "7",
1144
+ "8",
1145
+ "9",
1146
+ "10"
1147
+ ],
1148
+ "batch_size": null
1149
+ }
1150
+ }
1151
+ }
1152
+ }
1153
+ },
1154
+ "valid_dataset": {
1155
+ "cld": {
1156
+ "physical": {
1157
+ "batch_size": 1,
1158
+ "weight": null,
1159
+ "samples": {
1160
+ "cld_edm_ttbar_pf": {
1161
+ "version": "3.3.0",
1162
+ "splits": [
1163
+ "1",
1164
+ "2",
1165
+ "3",
1166
+ "4",
1167
+ "5",
1168
+ "6",
1169
+ "7",
1170
+ "8",
1171
+ "9",
1172
+ "10"
1173
+ ],
1174
+ "batch_size": null
1175
+ }
1176
+ }
1177
+ }
1178
+ }
1179
+ },
1180
+ "test_dataset": {
1181
+ "cld_edm_ttbar_pf": {
1182
+ "version": "3.3.0",
1183
+ "splits": [
1184
+ "1",
1185
+ "2",
1186
+ "3",
1187
+ "4",
1188
+ "5",
1189
+ "6",
1190
+ "7",
1191
+ "8",
1192
+ "9",
1193
+ "10"
1194
+ ],
1195
+ "batch_size": 1
1196
+ }
1197
+ },
1198
+ "enabled_test_datasets": [
1199
+ "cld_edm_ttbar_pf"
1200
+ ],
1201
+ "ntrain": null,
1202
+ "nvalid": 256,
1203
+ "ntest": 256,
1204
+ "data_config": null,
1205
+ "gpus": 1
1206
+ },
1207
+ "command": [
1208
+ "uv",
1209
+ "run",
1210
+ "python3",
1211
+ "-u",
1212
+ "mlpf/pipeline.py",
1213
+ "--spec-file",
1214
+ "particleflow_spec.yaml",
1215
+ "--model-name",
1216
+ "pyg-cld-v1",
1217
+ "--production-name",
1218
+ "cld",
1219
+ "--data-dir",
1220
+ "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_12mm/tfds",
1221
+ "--experiment-dir",
1222
+ "/mnt/home/jpata/particleflow/experiments/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441",
1223
+ "train",
1224
+ "--gpus",
1225
+ "1",
1226
+ "--dtype",
1227
+ "bfloat16",
1228
+ "--make-plots",
1229
+ "--optimizer",
1230
+ "lamb",
1231
+ "--lr",
1232
+ "0.0005",
1233
+ "--lr_schedule",
1234
+ "onecycle",
1235
+ "--lr_schedule_config.onecycle.pct_start",
1236
+ "0.3",
1237
+ "--num_steps",
1238
+ "500000",
1239
+ "--tensorboard_step_freq",
1240
+ "1000",
1241
+ "--benchmark.enabled",
1242
+ "true",
1243
+ "--benchmark.sample_interval_seconds",
1244
+ "1.0",
1245
+ "--benchmark.warmup_steps",
1246
+ "100",
1247
+ "--benchmark.gpu_timing_interval",
1248
+ "0",
1249
+ "--val_freq",
1250
+ "10000",
1251
+ "--checkpoint_freq",
1252
+ "2000",
1253
+ "--patience",
1254
+ "3",
1255
+ "--nvalid",
1256
+ "256",
1257
+ "--ntest",
1258
+ "256",
1259
+ "--sampler_mode",
1260
+ "interleaved-shards",
1261
+ "--pad_to_multiple_elements",
1262
+ "128",
1263
+ "--validation_particle_metrics",
1264
+ "true",
1265
+ "--model.type",
1266
+ "attention",
1267
+ "--model.heptv2",
1268
+ "null",
1269
+ "--model.attention",
1270
+ "{\"num_convs\": 6, \"num_heads\": 16, \"head_dim\": 16, \"attention_type\": \"flash\", \"dropout_ff\": 0.0}",
1271
+ "--model.input_encoding",
1272
+ "split",
1273
+ "--model.input_normalization",
1274
+ "true",
1275
+ "--model.backbone.mode",
1276
+ "shared",
1277
+ "--model.backbone.num_convs",
1278
+ "6",
1279
+ "--num_workers",
1280
+ "8",
1281
+ "--prefetch_factor",
1282
+ "2",
1283
+ "--model.attention.use_flash_attn_varlen",
1284
+ "false",
1285
+ "--model.feature_bag",
1286
+ "true",
1287
+ "--train_dataset.cld.physical.samples",
1288
+ "{\"cld_edm_ttbar_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1289
+ "--valid_dataset.cld.physical.samples",
1290
+ "{\"cld_edm_ttbar_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1291
+ "--test_dataset",
1292
+ "{\"cld_edm_ttbar_pf\": {\"version\": \"3.3.0\", \"splits\": [\"1\", \"2\", \"3\", \"4\", \"5\", \"6\", \"7\", \"8\", \"9\", \"10\"]}}",
1293
+ "--seed",
1294
+ "12345",
1295
+ "--gpu_batch_multiplier",
1296
+ "16"
1297
+ ],
1298
+ "git_revision": "c68799620d27ceec2dc167db69d47fa42d3e84f7"
1299
+ }
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train-config.yaml ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ backend: pytorch
2
+ batch_size: 1
3
+ benchmark:
4
+ enabled: true
5
+ gpu_timing_interval: 0
6
+ sample_interval_seconds: 1.0
7
+ warmup_steps: 100
8
+ checkpoint_freq: 2000
9
+ comet: false
10
+ comet_name: particleflow
11
+ comet_offline: false
12
+ compile: false
13
+ conv_type: attention
14
+ data_config: null
15
+ data_dir: /mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_12mm/tfds
16
+ dataset: cld
17
+ dtype: bfloat16
18
+ elemtypes_nonzero:
19
+ - 1
20
+ - 2
21
+ enabled_test_datasets:
22
+ - cld_edm_ttbar_pf
23
+ gpu_batch_multiplier: 16
24
+ gpu_type: l40
25
+ gpus: 1
26
+ hyperparameters:
27
+ batch_size: 1
28
+ lr: 0.0005
29
+ input_dim: 19
30
+ load: null
31
+ load_weights_only: false
32
+ lr: 0.0005
33
+ lr_find: false
34
+ lr_finder:
35
+ divergence_factor: 4.0
36
+ end_lr: 0.1
37
+ num_steps: 1000
38
+ smoothing: 0.98
39
+ start_lr: 1.0e-07
40
+ lr_schedule: onecycle
41
+ lr_schedule_config:
42
+ onecycle:
43
+ pct_start: 0.3
44
+ make_plots: true
45
+ max_open_readers: 64
46
+ mem_per_gpu_mb: 40000
47
+ model:
48
+ attention:
49
+ activation: elu
50
+ attention_type: flash
51
+ dropout_conv_id_ff: 0.0
52
+ dropout_conv_id_mha: 0.0
53
+ dropout_conv_reg_ff: 0.0
54
+ dropout_conv_reg_mha: 0.0
55
+ dropout_ff: 0.0
56
+ export_onnx_fused: false
57
+ head_dim: 16
58
+ layernorm: true
59
+ num_convs: 6
60
+ num_heads: 16
61
+ save_attention: false
62
+ use_flash_attn_varlen: false
63
+ use_jagged_attention: false
64
+ use_pre_layernorm: true
65
+ backbone:
66
+ mode: shared
67
+ num_calo_layers: null
68
+ num_common_layers: null
69
+ num_convs: 6
70
+ num_tracker_layers: null
71
+ binary_classification_focal_gamma: null
72
+ cos_phi_mode: linear
73
+ energy_mode: direct-elemtype-split
74
+ eta_mode: linear
75
+ feature_bag: true
76
+ gnnlsh: null
77
+ hept: null
78
+ heptv2: null
79
+ hit_feature_engineering:
80
+ calorimeter_neighborhood: true
81
+ enabled: true
82
+ geometry: true
83
+ tracker_doublets: false
84
+ tracker_momentum: false
85
+ tracker_neighborhood: false
86
+ input_encoding: split
87
+ input_normalization: true
88
+ learned_representation_mode: last
89
+ litept: null
90
+ output_mode: elementwise
91
+ pt_mode: direct-elemtype-split
92
+ set_decoder: null
93
+ sin_phi_mode: linear
94
+ task_queries: true
95
+ trainable: all
96
+ type: attention
97
+ ntest: 256
98
+ ntrain: null
99
+ num_classes: 6
100
+ num_steps: 500000
101
+ num_workers: 8
102
+ nvalid: 256
103
+ optimizer: lamb
104
+ pad_to_multiple_elements: 128
105
+ patience: 3
106
+ prefetch_factor: 2
107
+ raytune:
108
+ asha:
109
+ brackets: 1
110
+ grace_period: 10
111
+ max_t: 200
112
+ reduction_factor: 4
113
+ default_metric: val_loss
114
+ default_mode: min
115
+ hyperband:
116
+ max_t: 200
117
+ reduction_factor: 4
118
+ hyperopt:
119
+ n_random_steps: 10
120
+ local_dir: null
121
+ nevergrad:
122
+ n_random_steps: 10
123
+ sched: asha
124
+ search_alg: null
125
+ relaxed_load: false
126
+ reset_task_loss_weights: false
127
+ sampler_from_scratch: false
128
+ sampler_mode: interleaved-shards
129
+ seed: 12345
130
+ slurm_partition: gpu
131
+ slurm_runtime: 168h
132
+ sort_data: false
133
+ task_loss_weights:
134
+ calibration_steps: 100
135
+ epsilon: 1.0e-08
136
+ max_weight: 1000.0
137
+ min_weight: 0.01
138
+ tensorboard_step_freq: 1000
139
+ test: true
140
+ test_dataset:
141
+ cld_edm_ttbar_pf:
142
+ batch_size: 1
143
+ splits:
144
+ - '1'
145
+ - '2'
146
+ - '3'
147
+ - '4'
148
+ - '5'
149
+ - '6'
150
+ - '7'
151
+ - '8'
152
+ - '9'
153
+ - '10'
154
+ version: 3.3.0
155
+ threads: 16
156
+ train: true
157
+ train_dataset:
158
+ cld:
159
+ physical:
160
+ batch_size: 1
161
+ samples:
162
+ cld_edm_ttbar_pf:
163
+ batch_size: null
164
+ splits:
165
+ - '1'
166
+ - '2'
167
+ - '3'
168
+ - '4'
169
+ - '5'
170
+ - '6'
171
+ - '7'
172
+ - '8'
173
+ - '9'
174
+ - '10'
175
+ version: 3.3.0
176
+ weight: null
177
+ val_freq: 10000
178
+ valid_dataset:
179
+ cld:
180
+ physical:
181
+ batch_size: 1
182
+ samples:
183
+ cld_edm_ttbar_pf:
184
+ batch_size: null
185
+ splits:
186
+ - '1'
187
+ - '2'
188
+ - '3'
189
+ - '4'
190
+ - '5'
191
+ - '6'
192
+ - '7'
193
+ - '8'
194
+ - '9'
195
+ - '10'
196
+ version: 3.3.0
197
+ weight: null
198
+ validation_diagnostics_batches: 0
199
+ validation_linear_probe: false
200
+ validation_linear_probe_max_events: 16
201
+ validation_particle_metrics: true
202
+ weight_decay: 0.01
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train.log ADDED
The diff for this file is too large to render. See raw diff
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_12mm_seed12345_20261114_050401_337441/train.log.0 ADDED
The diff for this file is too large to render. See raw diff
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/checkpoints/best.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d501d6f84cf5dacfe4e829b74860c0220668002eb0df37c516d06b9fc50ff8a0
3
+ size 47063573
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/checkpoints/checkpoint-80000.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e94221a862865d0c6bbcb1141eb533dbd8d5a18987270df90818e36d50962fa2
3
+ size 47101757
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_10000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 17.793594306049823, "train": {"Classification_binary": 4.047906398773193, "Classification": 0.03491271659731865, "Regression_pt": 0.19679301977157593, "Regression_eta": 0.010869265533983707, "Regression_sin_phi": 0.00764417415484786, "Regression_cos_phi": 0.014010682702064514, "Regression_energy": 0.20095232129096985, "Total": 9.658344268798828, "Total_unweighted": 4.513088578823954}, "train_group": {}, "valid": {"Classification_binary": 3.9108524322509766, "Classification": 0.03643159940838814, "Regression_pt": 0.21664279699325562, "Regression_eta": 0.010460799559950829, "Regression_sin_phi": 0.011134270578622818, "Regression_cos_phi": 0.010292326100170612, "Regression_energy": 0.21312686800956726, "Total": 9.937812805175781, "Total_unweighted": 4.408941092900932, "metrics/particle/class_1/efficiency": 0.886261522769928, "metrics/particle/class_1/pid_accuracy": 0.9831691980361938, "metrics/particle/class_2/efficiency": 0.1854695826768875, "metrics/particle/class_2/pid_accuracy": 0.2675159275531769, "metrics/particle/class_3/efficiency": 0.6814606189727783, "metrics/particle/class_3/pid_accuracy": 0.9747755527496338, "metrics/particle/class_4/efficiency": 0.8510638475418091, "metrics/particle/class_4/pid_accuracy": 0.0357142873108387, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.13294798135757446, "metrics/particle/count/bias_mean": -1.8960000276565552, "metrics/particle/count/mae": 5.97599983215332, "metrics/particle/count/prediction_mean": 95.2959976196289, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.0847148448228836, "metrics/particle/event/energy_response_mean": 0.937248706817627, "metrics/particle/event/met_abs_error": 13.20606803894043, "metrics/particle/event/scalar_pt_relative_abs_error": 0.08545704931020737, "metrics/particle/event/scalar_pt_response_mean": 0.9399251937866211, "metrics/particle/event/vector_pt_closure": 0.09018290042877197, "metrics/particle/matched/delta_eta_abs_mean": 0.02135424315929413, "metrics/particle/matched/delta_phi_abs_mean": 0.01936238259077072, "metrics/particle/matched/delta_r_mean": 0.03206022083759308, "metrics/particle/matched/energy_relative_abs_mean": 0.09153047204017639, "metrics/particle/matched/pid_accuracy": 0.9450139999389648, "metrics/particle/matched/pt_relative_abs_mean": 0.09002381563186646, "metrics/particle/matching/duplicate_fraction": 0.03786098212003708, "metrics/particle/matching/efficiency": 0.750720202922821, "metrics/particle/matching/f1": 0.7581148147583008, "metrics/particle/matching/purity": 0.7656564712524414, "metrics/particle/matching/target_coverage_dr0p05": 0.6270063519477844, "metrics/particle/matching/target_coverage_dr0p10": 0.7867314219474792, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6725245118141174, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8110132813453674}, "step_train_time": 0.5033819675445557, "step_valid_time": 2.827445324975997, "step_total_time": 1125.9072289466858, "elapsed_training_loop_seconds": 1125.9072289466858, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.96722163061684, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.20520508074827026, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1540, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1334, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1270, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8679245283018868, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8662337662337662, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.867078323041924, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.13376623376623376, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8262849707221861, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8246753246753247, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8254793630159246, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8679245283018868, "step_test_time": 5.112317278981209, "step_plot_time": 3.7475358429946937, "step_validation_cycle_time": 12.185602041019592}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_20000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 35.587188612099645, "train": {"Classification_binary": 3.755035161972046, "Classification": 0.030766112729907036, "Regression_pt": 0.18972326815128326, "Regression_eta": 0.008292192593216896, "Regression_sin_phi": 0.010117613710463047, "Regression_cos_phi": 0.010780028067529202, "Regression_energy": 0.18777777254581451, "Total": 9.049174308776855, "Total_unweighted": 4.19249214977026}, "train_group": {}, "valid": {"Classification_binary": 3.758218288421631, "Classification": 0.034800175577402115, "Regression_pt": 0.20862939953804016, "Regression_eta": 0.009746267460286617, "Regression_sin_phi": 0.01023948099464178, "Regression_cos_phi": 0.00960924569517374, "Regression_energy": 0.20414426922798157, "Total": 9.536052703857422, "Total_unweighted": 4.235387126915157, "metrics/particle/class_1/efficiency": 0.9002457857131958, "metrics/particle/class_1/pid_accuracy": 0.981924295425415, "metrics/particle/class_2/efficiency": 0.2244536280632019, "metrics/particle/class_2/pid_accuracy": 0.38684210181236267, "metrics/particle/class_3/efficiency": 0.7089443802833557, "metrics/particle/class_3/pid_accuracy": 0.9787670969963074, "metrics/particle/class_4/efficiency": 0.8875380158424377, "metrics/particle/class_4/pid_accuracy": 0.051369864493608475, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.22543352842330933, "metrics/particle/count/bias_mean": -0.335999995470047, "metrics/particle/count/mae": 5.383999824523926, "metrics/particle/count/prediction_mean": 96.85600280761719, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.06883686035871506, "metrics/particle/event/energy_response_mean": 0.9625418782234192, "metrics/particle/event/met_abs_error": 11.73847484588623, "metrics/particle/event/scalar_pt_relative_abs_error": 0.07211460918188095, "metrics/particle/event/scalar_pt_response_mean": 0.9654827117919922, "metrics/particle/event/vector_pt_closure": 0.08092375099658966, "metrics/particle/matched/delta_eta_abs_mean": 0.020168418064713478, "metrics/particle/matched/delta_phi_abs_mean": 0.017607519403100014, "metrics/particle/matched/delta_r_mean": 0.029780156910419464, "metrics/particle/matched/energy_relative_abs_mean": 0.09282054752111435, "metrics/particle/matched/pid_accuracy": 0.947194516658783, "metrics/particle/matched/pt_relative_abs_mean": 0.0889245942234993, "metrics/particle/matching/duplicate_fraction": 0.03985297679901123, "metrics/particle/matching/efficiency": 0.7723680734634399, "metrics/particle/matching/f1": 0.7737054824829102, "metrics/particle/matching/purity": 0.7750474810600281, "metrics/particle/matching/target_coverage_dr0p05": 0.6644991636276245, "metrics/particle/matching/target_coverage_dr0p10": 0.8087085485458374, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6825664639472961, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.822536826133728}, "step_train_time": 0.5048179626464844, "step_valid_time": 3.1001110979705118, "step_total_time": 2254.600822210312, "elapsed_training_loop_seconds": 2254.600822210312, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9788676780815435, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.19157644981597066, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1531, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1362, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1313, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8861418347430059, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8896146309601568, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8878748370273793, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.11038536903984324, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8542615484710475, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8576094056172436, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8559322033898306, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8861418347430059, "step_test_time": 6.152728537039366, "step_plot_time": 3.3736198699916713, "step_validation_cycle_time": 13.22875212301733}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_30000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 53.380782918149464, "train": {"Classification_binary": 3.3508493900299072, "Classification": 0.03731197491288185, "Regression_pt": 0.16957814991474152, "Regression_eta": 0.004778955597430468, "Regression_sin_phi": 0.00526938121765852, "Regression_cos_phi": 0.006440068129450083, "Regression_energy": 0.16827520728111267, "Total": 8.10025405883789, "Total_unweighted": 3.7425031270831823}, "train_group": {}, "valid": {"Classification_binary": 3.6424074172973633, "Classification": 0.03376489132642746, "Regression_pt": 0.20280314981937408, "Regression_eta": 0.009351449087262154, "Regression_sin_phi": 0.010002302937209606, "Regression_cos_phi": 0.0093085253611207, "Regression_energy": 0.19866140186786652, "Total": 9.259737014770508, "Total_unweighted": 4.106299137696624, "metrics/particle/class_1/efficiency": 0.898381233215332, "metrics/particle/class_1/pid_accuracy": 0.9811320900917053, "metrics/particle/class_2/efficiency": 0.26461902260780334, "metrics/particle/class_2/pid_accuracy": 0.4508928656578064, "metrics/particle/class_3/efficiency": 0.7319607734680176, "metrics/particle/class_3/pid_accuracy": 0.9767811894416809, "metrics/particle/class_4/efficiency": 0.8571428656578064, "metrics/particle/class_4/pid_accuracy": 0.10283687710762024, "metrics/particle/class_5/efficiency": 0.9555555582046509, "metrics/particle/class_5/pid_accuracy": 0.2616279125213623, "metrics/particle/count/bias_mean": 1.2519999742507935, "metrics/particle/count/mae": 5.228000164031982, "metrics/particle/count/prediction_mean": 98.44400024414062, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.06115042790770531, "metrics/particle/event/energy_response_mean": 0.9977719783782959, "metrics/particle/event/met_abs_error": 10.875683784484863, "metrics/particle/event/scalar_pt_relative_abs_error": 0.06162707880139351, "metrics/particle/event/scalar_pt_response_mean": 1.000388741493225, "metrics/particle/event/vector_pt_closure": 0.0704115703701973, "metrics/particle/matched/delta_eta_abs_mean": 0.018319426104426384, "metrics/particle/matched/delta_phi_abs_mean": 0.01871260441839695, "metrics/particle/matched/delta_r_mean": 0.029089869931340218, "metrics/particle/matched/energy_relative_abs_mean": 0.0978604331612587, "metrics/particle/matched/pid_accuracy": 0.9474236965179443, "metrics/particle/matched/pt_relative_abs_mean": 0.08857803046703339, "metrics/particle/matching/duplicate_fraction": 0.040347810834646225, "metrics/particle/matching/efficiency": 0.783562421798706, "metrics/particle/matching/f1": 0.7785479426383972, "metrics/particle/matching/purity": 0.7735971808433533, "metrics/particle/matching/target_coverage_dr0p05": 0.677874743938446, "metrics/particle/matching/target_coverage_dr0p10": 0.8181331753730774, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6955716609954834, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8372705578804016}, "step_train_time": 0.5206878185272217, "step_valid_time": 3.045110734004993, "step_total_time": 3390.208925962448, "elapsed_training_loop_seconds": 3390.208925962448, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9969863234183436, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.16678877470757747, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1539, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1370, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1339, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8913467794404685, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8901884340480831, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8907672301690507, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.10981156595191682, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8711776187378009, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8700454840805718, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8706111833550065, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8913467794404685, "step_test_time": 4.577003402984701, "step_plot_time": 3.3257214829791337, "step_validation_cycle_time": 11.520161048974842}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_40000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 71.17437722419929, "train": {"Classification_binary": 3.5788309574127197, "Classification": 0.03496738523244858, "Regression_pt": 0.16577251255512238, "Regression_eta": 0.012889145873486996, "Regression_sin_phi": 0.01443580910563469, "Regression_cos_phi": 0.014162941835820675, "Regression_energy": 0.16210047900676727, "Total": 8.430500984191895, "Total_unweighted": 3.9831592310220003}, "train_group": {}, "valid": {"Classification_binary": 3.4741718769073486, "Classification": 0.030074467882514, "Regression_pt": 0.19464339315891266, "Regression_eta": 0.009383060038089752, "Regression_sin_phi": 0.009678435511887074, "Regression_cos_phi": 0.009100694209337234, "Regression_energy": 0.19111716747283936, "Total": 8.850305557250977, "Total_unweighted": 3.9181690951809287, "metrics/particle/class_1/efficiency": 0.9070259928703308, "metrics/particle/class_1/pid_accuracy": 0.9799103140830994, "metrics/particle/class_2/efficiency": 0.2593030035495758, "metrics/particle/class_2/pid_accuracy": 0.42596811056137085, "metrics/particle/class_3/efficiency": 0.7265222668647766, "metrics/particle/class_3/pid_accuracy": 0.9794145226478577, "metrics/particle/class_4/efficiency": 0.8723404407501221, "metrics/particle/class_4/pid_accuracy": 0.18118466436862946, "metrics/particle/class_5/efficiency": 0.9555555582046509, "metrics/particle/class_5/pid_accuracy": 0.5, "metrics/particle/count/bias_mean": 2.671999931335449, "metrics/particle/count/mae": 5.383999824523926, "metrics/particle/count/prediction_mean": 99.86399841308594, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.05773709714412689, "metrics/particle/event/energy_response_mean": 1.0084294080734253, "metrics/particle/event/met_abs_error": 10.320469856262207, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05617302283644676, "metrics/particle/event/scalar_pt_response_mean": 1.0129504203796387, "metrics/particle/event/vector_pt_closure": 0.06545049697160721, "metrics/particle/matched/delta_eta_abs_mean": 0.020995933562517166, "metrics/particle/matched/delta_phi_abs_mean": 0.017463000491261482, "metrics/particle/matched/delta_r_mean": 0.030356086790561676, "metrics/particle/matched/energy_relative_abs_mean": 0.09346853941679001, "metrics/particle/matched/pid_accuracy": 0.9506314992904663, "metrics/particle/matched/pt_relative_abs_mean": 0.08863113075494766, "metrics/particle/matching/duplicate_fraction": 0.04077545553445816, "metrics/particle/matching/efficiency": 0.7852909564971924, "metrics/particle/matching/f1": 0.7746427655220032, "metrics/particle/matching/purity": 0.7642794251441956, "metrics/particle/matching/target_coverage_dr0p05": 0.6576672792434692, "metrics/particle/matching/target_coverage_dr0p10": 0.8203967213630676, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6997695565223694, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8439789414405823}, "step_train_time": 0.5422346591949463, "step_valid_time": 3.0096948530408554, "step_total_time": 4519.461629867554, "elapsed_training_loop_seconds": 4519.461629867554, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 1.003638939675446, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.1539782797216238, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1529, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1375, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1349, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8945998698763825, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.8992805755395683, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8969341161121983, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.10071942446043165, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8776837996096292, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.882275997383911, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8799739073711677, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8945998698763825, "step_test_time": 4.526663433003705, "step_plot_time": 3.3197973169735633, "step_validation_cycle_time": 11.405437969020568}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_50000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 88.96797153024912, "train": {"Classification_binary": 3.34846830368042, "Classification": 0.024878952652215958, "Regression_pt": 0.15517234802246094, "Regression_eta": 0.0120466947555542, "Regression_sin_phi": 0.01177880261093378, "Regression_cos_phi": 0.01294709648936987, "Regression_energy": 0.15030261874198914, "Total": 7.7647504806518555, "Total_unweighted": 3.715594816952944}, "train_group": {}, "valid": {"Classification_binary": 3.398388147354126, "Classification": 0.028745677322149277, "Regression_pt": 0.19652824103832245, "Regression_eta": 0.009002959355711937, "Regression_sin_phi": 0.009297116659581661, "Regression_cos_phi": 0.008729079738259315, "Regression_energy": 0.19459721446037292, "Total": 8.81229019165039, "Total_unweighted": 3.8452884359285235, "metrics/particle/class_1/efficiency": 0.911263644695282, "metrics/particle/class_1/pid_accuracy": 0.9807477593421936, "metrics/particle/class_2/efficiency": 0.24867099523544312, "metrics/particle/class_2/pid_accuracy": 0.4679335057735443, "metrics/particle/class_3/efficiency": 0.7332232594490051, "metrics/particle/class_3/pid_accuracy": 0.9790728688240051, "metrics/particle/class_4/efficiency": 0.8723404407501221, "metrics/particle/class_4/pid_accuracy": 0.18815331161022186, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.5028901696205139, "metrics/particle/count/bias_mean": 1.0080000162124634, "metrics/particle/count/mae": 4.736000061035156, "metrics/particle/count/prediction_mean": 98.19999694824219, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.060431286692619324, "metrics/particle/event/energy_response_mean": 0.9673931002616882, "metrics/particle/event/met_abs_error": 9.339198112487793, "metrics/particle/event/scalar_pt_relative_abs_error": 0.056078288704156876, "metrics/particle/event/scalar_pt_response_mean": 0.9696944952011108, "metrics/particle/event/vector_pt_closure": 0.06336898356676102, "metrics/particle/matched/delta_eta_abs_mean": 0.019394321367144585, "metrics/particle/matched/delta_phi_abs_mean": 0.01735205575823784, "metrics/particle/matched/delta_r_mean": 0.02899051643908024, "metrics/particle/matched/energy_relative_abs_mean": 0.09371477365493774, "metrics/particle/matched/pid_accuracy": 0.9526664018630981, "metrics/particle/matched/pt_relative_abs_mean": 0.08995641022920609, "metrics/particle/matching/duplicate_fraction": 0.03649694472551346, "metrics/particle/matching/efficiency": 0.7894888520240784, "metrics/particle/matching/f1": 0.7854160070419312, "metrics/particle/matching/purity": 0.7813849449157715, "metrics/particle/matching/target_coverage_dr0p05": 0.6819491386413574, "metrics/particle/matching/target_coverage_dr0p10": 0.8223310708999634, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7002222537994385, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8437319993972778}, "step_train_time": 0.5212991237640381, "step_valid_time": 2.953678696008865, "step_total_time": 5652.9423933029175, "elapsed_training_loop_seconds": 5652.9423933029175, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.988628068250184, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.16443158893589493, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1514, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1379, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1355, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8972023422251139, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9108322324966975, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9039659128154703, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.0891677675033025, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8815875081327261, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8949801849405549, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8882333661094723, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8972023422251139, "step_test_time": 4.737001038971357, "step_plot_time": 3.2326010090182535, "step_validation_cycle_time": 11.467040440998971}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_60000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 106.76156583629893, "train": {"Classification_binary": 2.9626874923706055, "Classification": 0.027811478823423386, "Regression_pt": 0.11601206660270691, "Regression_eta": 0.009595781564712524, "Regression_sin_phi": 0.0077623105607926846, "Regression_cos_phi": 0.006769426167011261, "Regression_energy": 0.11287444829940796, "Total": 6.333952903747559, "Total_unweighted": 3.24351300438866}, "train_group": {}, "valid": {"Classification_binary": 3.389996290206909, "Classification": 0.028687071055173874, "Regression_pt": 0.20304207503795624, "Regression_eta": 0.00884409248828888, "Regression_sin_phi": 0.009012368507683277, "Regression_cos_phi": 0.00842109601944685, "Regression_energy": 0.20039425790309906, "Total": 8.9484224319458, "Total_unweighted": 3.8483972512185574, "metrics/particle/class_1/efficiency": 0.9087210893630981, "metrics/particle/class_1/pid_accuracy": 0.9800410270690918, "metrics/particle/class_2/efficiency": 0.26934435963630676, "metrics/particle/class_2/pid_accuracy": 0.5416666865348816, "metrics/particle/class_3/efficiency": 0.7453626990318298, "metrics/particle/class_3/pid_accuracy": 0.9771987199783325, "metrics/particle/class_4/efficiency": 0.8662614226341248, "metrics/particle/class_4/pid_accuracy": 0.1894736886024475, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.5375722646713257, "metrics/particle/count/bias_mean": 1.6039999723434448, "metrics/particle/count/mae": 5.156000137329102, "metrics/particle/count/prediction_mean": 98.7959976196289, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.05748842656612396, "metrics/particle/event/energy_response_mean": 0.9963624477386475, "metrics/particle/event/met_abs_error": 9.110469818115234, "metrics/particle/event/scalar_pt_relative_abs_error": 0.055367324501276016, "metrics/particle/event/scalar_pt_response_mean": 0.9993220567703247, "metrics/particle/event/vector_pt_closure": 0.06031731143593788, "metrics/particle/matched/delta_eta_abs_mean": 0.01938633993268013, "metrics/particle/matched/delta_phi_abs_mean": 0.017949974164366722, "metrics/particle/matched/delta_r_mean": 0.029445819556713104, "metrics/particle/matched/energy_relative_abs_mean": 0.09658314287662506, "metrics/particle/matched/pid_accuracy": 0.952928364276886, "metrics/particle/matched/pt_relative_abs_mean": 0.08881019055843353, "metrics/particle/matching/duplicate_fraction": 0.03793675824999809, "metrics/particle/matching/efficiency": 0.7947567701339722, "metrics/particle/matching/f1": 0.7882523536682129, "metrics/particle/matching/purity": 0.7818534970283508, "metrics/particle/matching/target_coverage_dr0p05": 0.6738002896308899, "metrics/particle/matching/target_coverage_dr0p10": 0.825376570224762, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7104700207710266, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8499053716659546}, "step_train_time": 0.543316125869751, "step_valid_time": 3.0415816939785145, "step_total_time": 6788.611540794373, "elapsed_training_loop_seconds": 6788.611540794373, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9995522460320504, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.15006191538943825, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1523, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1384, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1356, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.900455432661028, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9087327642810243, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9045751633986928, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.0912672357189757, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8822381262199089, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8903479973736047, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8862745098039215, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.900455432661028, "step_test_time": 4.911544725007843, "step_plot_time": 3.3138791330275126, "step_validation_cycle_time": 11.707692619005684}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_70000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 124.55516014234875, "train": {"Classification_binary": 2.7871880531311035, "Classification": 0.02288082242012024, "Regression_pt": 0.09837143123149872, "Regression_eta": 0.007841509766876698, "Regression_sin_phi": 0.00896299909800291, "Regression_cos_phi": 0.00998236145824194, "Regression_energy": 0.09799132496118546, "Total": 5.732627868652344, "Total_unweighted": 3.0332185020670295}, "train_group": {}, "valid": {"Classification_binary": 3.5038537979125977, "Classification": 0.029884055256843567, "Regression_pt": 0.2220441699028015, "Regression_eta": 0.008846208453178406, "Regression_sin_phi": 0.009006254374980927, "Regression_cos_phi": 0.008350864052772522, "Regression_energy": 0.218821719288826, "Total": 9.537223815917969, "Total_unweighted": 4.000807069242001, "metrics/particle/class_1/efficiency": 0.9126197099685669, "metrics/particle/class_1/pid_accuracy": 0.9798476696014404, "metrics/particle/class_2/efficiency": 0.2640283405780792, "metrics/particle/class_2/pid_accuracy": 0.5436241626739502, "metrics/particle/class_3/efficiency": 0.7262309193611145, "metrics/particle/class_3/pid_accuracy": 0.9741909503936768, "metrics/particle/class_4/efficiency": 0.8449848294258118, "metrics/particle/class_4/pid_accuracy": 0.23021583259105682, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.5780346989631653, "metrics/particle/count/bias_mean": 0.19599999487400055, "metrics/particle/count/mae": 5.228000164031982, "metrics/particle/count/prediction_mean": 97.38800048828125, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.06252363324165344, "metrics/particle/event/energy_response_mean": 0.965347945690155, "metrics/particle/event/met_abs_error": 8.446518898010254, "metrics/particle/event/scalar_pt_relative_abs_error": 0.060470763593912125, "metrics/particle/event/scalar_pt_response_mean": 0.9693287014961243, "metrics/particle/event/vector_pt_closure": 0.05981817469000816, "metrics/particle/matched/delta_eta_abs_mean": 0.019232187420129776, "metrics/particle/matched/delta_phi_abs_mean": 0.01804475672543049, "metrics/particle/matched/delta_r_mean": 0.02941523678600788, "metrics/particle/matched/energy_relative_abs_mean": 0.09374495595693588, "metrics/particle/matched/pid_accuracy": 0.9529356360435486, "metrics/particle/matched/pt_relative_abs_mean": 0.08457843959331512, "metrics/particle/matching/duplicate_fraction": 0.03643159195780754, "metrics/particle/matching/efficiency": 0.7878837585449219, "metrics/particle/matching/f1": 0.7870901226997375, "metrics/particle/matching/purity": 0.7862980961799622, "metrics/particle/matching/target_coverage_dr0p05": 0.6603423953056335, "metrics/particle/matching/target_coverage_dr0p10": 0.8167338967323303, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.7093176245689392, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8429500460624695}, "step_train_time": 0.5342497825622559, "step_valid_time": 3.0343004589667544, "step_total_time": 7924.2665338516235, "elapsed_training_loop_seconds": 7924.2665338516235, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9799559588226247, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.151735692832065, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1518, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1377, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1358, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8959011060507482, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9071146245059288, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.9014729950900163, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.09288537549407115, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8835393623942746, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8945981554677207, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.8890343698854337, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8959011060507482, "step_test_time": 4.7910252379952, "step_plot_time": 3.334346054994967, "step_validation_cycle_time": 11.63585800700821}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/history/step_80000.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"epoch": 142.34875444839858, "train": {"Classification_binary": 2.2896721363067627, "Classification": 0.021268203854560852, "Regression_pt": 0.059610556811094284, "Regression_eta": 0.005329466890543699, "Regression_sin_phi": 0.00543194031342864, "Regression_cos_phi": 0.008943123742938042, "Regression_energy": 0.06184519827365875, "Total": 4.220189094543457, "Total_unweighted": 2.452100626192987}, "train_group": {}, "valid": {"Classification_binary": 3.864603281021118, "Classification": 0.031170925125479698, "Regression_pt": 0.24233151972293854, "Regression_eta": 0.008463987149298191, "Regression_sin_phi": 0.009011328220367432, "Regression_cos_phi": 0.008363064378499985, "Regression_energy": 0.24049578607082367, "Total": 10.424847602844238, "Total_unweighted": 4.404439891688526, "metrics/particle/class_1/efficiency": 0.9034664034843445, "metrics/particle/class_1/pid_accuracy": 0.9771106839179993, "metrics/particle/class_2/efficiency": 0.28824570775032043, "metrics/particle/class_2/pid_accuracy": 0.5491803288459778, "metrics/particle/class_3/efficiency": 0.7133145332336426, "metrics/particle/class_3/pid_accuracy": 0.9726344347000122, "metrics/particle/class_4/efficiency": 0.8449848294258118, "metrics/particle/class_4/pid_accuracy": 0.2374100685119629, "metrics/particle/class_5/efficiency": 0.9611111283302307, "metrics/particle/class_5/pid_accuracy": 0.5086705088615417, "metrics/particle/count/bias_mean": 0.19599999487400055, "metrics/particle/count/mae": 5.6519999504089355, "metrics/particle/count/prediction_mean": 97.38800048828125, "metrics/particle/count/target_mean": 97.19200134277344, "metrics/particle/event/energy_relative_abs_error": 0.05911681056022644, "metrics/particle/event/energy_response_mean": 0.9935271143913269, "metrics/particle/event/met_abs_error": 9.56840705871582, "metrics/particle/event/scalar_pt_relative_abs_error": 0.05700228735804558, "metrics/particle/event/scalar_pt_response_mean": 0.9956931471824646, "metrics/particle/event/vector_pt_closure": 0.06280514597892761, "metrics/particle/matched/delta_eta_abs_mean": 0.018261604011058807, "metrics/particle/matched/delta_phi_abs_mean": 0.018629638478159904, "metrics/particle/matched/delta_r_mean": 0.029120605438947678, "metrics/particle/matched/energy_relative_abs_mean": 0.09257248044013977, "metrics/particle/matched/pid_accuracy": 0.94921875, "metrics/particle/matched/pt_relative_abs_mean": 0.08627600222826004, "metrics/particle/matching/duplicate_fraction": 0.039224546402692795, "metrics/particle/matching/efficiency": 0.7796526551246643, "metrics/particle/matching/f1": 0.7788673043251038, "metrics/particle/matching/purity": 0.7780835628509521, "metrics/particle/matching/target_coverage_dr0p05": 0.6575026512145996, "metrics/particle/matching/target_coverage_dr0p10": 0.8090789318084717, "metrics/particle/matching/target_coverage_rel_pt0p20": 0.6981232762336731, "metrics/particle/matching/target_coverage_rel_pt0p50": 0.8346777558326721}, "step_train_time": 0.5213687419891357, "step_valid_time": 3.0519486449775286, "step_total_time": 9061.787279129028, "elapsed_training_loop_seconds": 9061.787279129028, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/med": 0.9988941515355578, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/iqr": 0.1557990572660375, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_reference_jets": 1537, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_candidate_jets": 1523, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_angular_matches": 1375, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/num_response_qualified_matches": 1353, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_rel_pt_cut": 0.5, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_recall": 0.8945998698763825, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_precision": 0.9028233749179252, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_f1": 0.8986928104575164, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/angular_fake_rate": 0.09717662508207485, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_recall": 0.8802862719583604, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_precision": 0.8883782009192384, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/response_qualified_f1": 0.884313725490196, "step/cld_edm_ttbar_pf/jet_ratio/jet_ratio_target_to_pred_pt/match_frac": 0.8945998698763825, "step_test_time": 4.915793558000587, "step_plot_time": 3.3285685760201886, "step_validation_cycle_time": 11.758462058962323}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/hyperparameters.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"num_mlpf_params": 3910930, "dataset": "cld", "data_dir": "/mnt/ceph/users/jpata/mlpf/cld/granularity_scan_2025-05-29/hcal_15mm/tfds", "model": {"type": "attention", "input_encoding": "split", "learned_representation_mode": "last", "pt_mode": "direct-elemtype-split", "eta_mode": "linear", "sin_phi_mode": "linear", "cos_phi_mode": "linear", "energy_mode": "direct-elemtype-split", "trainable": "all", "task_queries": true, "output_mode": "elementwise", "binary_classification_focal_gamma": null, "backbone": {"mode": "shared", "num_convs": 6, "num_tracker_layers": null, "num_calo_layers": null, "num_common_layers": null}, "hit_feature_engineering": {"enabled": true, "geometry": true, "tracker_neighborhood": false, "tracker_momentum": false, "tracker_doublets": false, "calorimeter_neighborhood": true}, "set_decoder": null, "input_normalization": true, "feature_bag": true, "gnnlsh": null, "attention": {"num_convs": 6, "dropout_ff": 0.0, "activation": "elu", "layernorm": true, "num_heads": 16, "head_dim": 16, "attention_type": "flash", "dropout_conv_reg_mha": 0.0, "dropout_conv_reg_ff": 0.0, "dropout_conv_id_mha": 0.0, "dropout_conv_id_ff": 0.0, "use_pre_layernorm": true, "use_jagged_attention": false, "use_flash_attn_varlen": false, "export_onnx_fused": false, "save_attention": false}, "litept": null, "hept": null, "heptv2": null}, "conv_type": "attention", "batch_size": 1, "hyperparameters": {"batch_size": 1, "lr": 0.0005}, "backend": "pytorch", "threads": 16, "gpu_type": "l40", "mem_per_gpu_mb": 40000, "slurm_partition": "gpu", "slurm_runtime": "168h", "input_dim": 19, "num_classes": 6, "elemtypes_nonzero": [1, 2], "seed": 12345, "num_steps": 500000, "patience": 3, "checkpoint_freq": 2000, "val_freq": 10000, "num_workers": 8, "prefetch_factor": 2, "max_open_readers": 64, "gpu_batch_multiplier": 16, "dtype": "bfloat16", "lr": 0.0005, "weight_decay": 0.01, "optimizer": "lamb", "lr_schedule": "onecycle", "lr_schedule_config": {"onecycle": {"pct_start": 0.3}}, "task_loss_weights": {"calibration_steps": 100, "epsilon": 1e-08, "min_weight": 0.01, "max_weight": 1000.0}, "lr_finder": {"start_lr": 1e-07, "end_lr": 0.1, "num_steps": 1000, "smoothing": 0.98, "divergence_factor": 4.0}, "pad_to_multiple_elements": 128, "validation_diagnostics_batches": 0, "validation_linear_probe": false, "validation_linear_probe_max_events": 16, "validation_particle_metrics": true, "train": true, "lr_find": false, "test": true, "compile": false, "make_plots": true, "sort_data": false, "sampler_mode": "interleaved-shards", "load": null, "relaxed_load": false, "load_weights_only": false, "reset_task_loss_weights": false, "sampler_from_scratch": false, "comet": false, "comet_offline": false, "comet_name": "particleflow", "tensorboard_step_freq": 1000, "benchmark": {"enabled": true, "sample_interval_seconds": 1.0, "warmup_steps": 100, "gpu_timing_interval": 0}, "raytune": {"local_dir": null, "sched": "asha", "search_alg": null, "default_metric": "val_loss", "default_mode": "min", "asha": {"max_t": 200, "reduction_factor": 4, "brackets": 1, "grace_period": 10}, "hyperband": {"max_t": 200, "reduction_factor": 4}, "hyperopt": {"n_random_steps": 10}, "nevergrad": {"n_random_steps": 10}}, "train_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "valid_dataset": {"cld": {"physical": {"batch_size": 1, "weight": null, "samples": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": null}}}}}, "test_dataset": {"cld_edm_ttbar_pf": {"version": "3.3.0", "splits": ["1", "2", "3", "4", "5", "6", "7", "8", "9", "10"], "batch_size": 1}}, "enabled_test_datasets": ["cld_edm_ttbar_pf"], "ntrain": null, "nvalid": 256, "ntest": 256, "data_config": null, "gpus": 1}
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/model_kwargs.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0d6a3bc67f8dbc26f9b1246c27bf2e3b7721f94dddf15cc6b154c87dea6457b
3
+ size 4394
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/particleflow_spec.yaml ADDED
@@ -0,0 +1,3198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ models:
2
+ defaults:
3
+ backend: pytorch
4
+ checkpoint_freq: 10000
5
+ comet: false
6
+ dtype: bfloat16
7
+ gpu_type: l40
8
+ gpus: 1
9
+ load: null
10
+ lr_schedule: cosinedecay
11
+ mem_per_gpu_mb: 40000
12
+ ntest: 100
13
+ ntrain: null
14
+ num_steps: 100000
15
+ num_workers: 2
16
+ nvalid: null
17
+ optimizer: lamb
18
+ patience: 10000
19
+ prefetch_factor: 2
20
+ raytune: &id001
21
+ asha:
22
+ brackets: 1
23
+ grace_period: 10
24
+ max_t: 200
25
+ reduction_factor: 4
26
+ default_metric: val_loss
27
+ default_mode: min
28
+ hyperband:
29
+ max_t: 200
30
+ reduction_factor: 4
31
+ hyperopt:
32
+ n_random_steps: 10
33
+ local_dir: null
34
+ nevergrad:
35
+ n_random_steps: 10
36
+ sched: asha
37
+ search_alg: null
38
+ seed: 12345
39
+ slurm_partition: ${project.gpu_partition}
40
+ slurm_runtime: 168h
41
+ sort_data: false
42
+ task_loss_weights: &id002
43
+ calibration_steps: 100
44
+ epsilon: 1.0e-08
45
+ max_weight: 1.0e3
46
+ min_weight: 0.01
47
+ tensorboard_step_freq: 100
48
+ threads: 16
49
+ val_freq: 10000
50
+ pyg-cld-hits-heptv2-sector-set-v1:
51
+ architecture:
52
+ heptv2:
53
+ block_size: 128
54
+ dropout_ff: 0.0
55
+ embedding_dim: 256
56
+ num_convs: 3
57
+ num_heads: 16
58
+ width: 256
59
+ input_encoding: split
60
+ output_mode: set
61
+ set_decoder:
62
+ attention_mode: sectorized
63
+ local_attention_radius: 0.4
64
+ num_heads: 8
65
+ num_layers: 2
66
+ num_sectors: 32
67
+ num_slots: 256
68
+ proposal_mode: grid-diverse
69
+ query_init: input-conditioned
70
+ sector_neighbors: 1
71
+ use_aggregate_anchors: true
72
+ type: heptv2
73
+ backend: pytorch
74
+ checkpoint_freq: 10000
75
+ comet: false
76
+ dataset: cld_hits
77
+ dtype: bfloat16
78
+ gpu_batch_multiplier: 1
79
+ gpu_type: l40
80
+ gpus: 1
81
+ hyperparameters: &id007
82
+ batch_size: 1
83
+ lr: 0.0001
84
+ load: null
85
+ lr_schedule: cosinedecay
86
+ mem_per_gpu_mb: 40000
87
+ ntest: 100
88
+ ntrain: null
89
+ num_steps: 100000
90
+ num_workers: 2
91
+ nvalid: null
92
+ optimizer: lamb
93
+ pad_to_multiple_elements: 128
94
+ patience: 10000
95
+ prefetch_factor: 2
96
+ raytune: *id001
97
+ seed: 12345
98
+ slurm_partition: ${project.gpu_partition}
99
+ slurm_runtime: 168h
100
+ sort_data: false
101
+ task_loss_weights: *id002
102
+ tensorboard_step_freq: 100
103
+ test_datasets: &id003
104
+ - name: cld_edm_ttbar_hits
105
+ splits:
106
+ - '1'
107
+ - '2'
108
+ - '3'
109
+ - '4'
110
+ - '5'
111
+ - '6'
112
+ - '7'
113
+ - '8'
114
+ - '9'
115
+ - '10'
116
+ version: 3.2.2
117
+ - name: cld_edm_ww_fullhad_hits
118
+ splits:
119
+ - '1'
120
+ - '2'
121
+ - '3'
122
+ - '4'
123
+ - '5'
124
+ - '6'
125
+ - '7'
126
+ - '8'
127
+ - '9'
128
+ - '10'
129
+ version: 3.2.2
130
+ - name: cld_edm_qq_hits
131
+ splits:
132
+ - '1'
133
+ - '2'
134
+ - '3'
135
+ - '4'
136
+ - '5'
137
+ - '6'
138
+ - '7'
139
+ - '8'
140
+ - '9'
141
+ - '10'
142
+ version: 3.2.2
143
+ threads: 16
144
+ train_datasets: &id004
145
+ physical:
146
+ batch_size: 1
147
+ samples:
148
+ - name: cld_edm_ttbar_hits
149
+ splits:
150
+ - '1'
151
+ - '2'
152
+ - '3'
153
+ - '4'
154
+ - '5'
155
+ - '6'
156
+ - '7'
157
+ - '8'
158
+ - '9'
159
+ - '10'
160
+ version: 3.2.2
161
+ - name: cld_edm_ww_fullhad_hits
162
+ splits:
163
+ - '1'
164
+ - '2'
165
+ - '3'
166
+ - '4'
167
+ - '5'
168
+ - '6'
169
+ - '7'
170
+ - '8'
171
+ - '9'
172
+ - '10'
173
+ version: 3.2.2
174
+ - name: cld_edm_qq_hits
175
+ splits:
176
+ - '1'
177
+ - '2'
178
+ - '3'
179
+ - '4'
180
+ - '5'
181
+ - '6'
182
+ - '7'
183
+ - '8'
184
+ - '9'
185
+ - '10'
186
+ version: 3.2.2
187
+ val_freq: 10000
188
+ validation_datasets: &id005
189
+ physical:
190
+ batch_size: 1
191
+ samples:
192
+ - name: cld_edm_ttbar_hits
193
+ splits:
194
+ - '1'
195
+ - '2'
196
+ - '3'
197
+ - '4'
198
+ - '5'
199
+ - '6'
200
+ - '7'
201
+ - '8'
202
+ - '9'
203
+ - '10'
204
+ version: 3.2.2
205
+ - name: cld_edm_ww_fullhad_hits
206
+ splits:
207
+ - '1'
208
+ - '2'
209
+ - '3'
210
+ - '4'
211
+ - '5'
212
+ - '6'
213
+ - '7'
214
+ - '8'
215
+ - '9'
216
+ - '10'
217
+ version: 3.2.2
218
+ - name: cld_edm_qq_hits
219
+ splits:
220
+ - '1'
221
+ - '2'
222
+ - '3'
223
+ - '4'
224
+ - '5'
225
+ - '6'
226
+ - '7'
227
+ - '8'
228
+ - '9'
229
+ - '10'
230
+ version: 3.2.2
231
+ pyg-cld-hits-heptv2-set-v1:
232
+ architecture:
233
+ backbone:
234
+ mode: shared
235
+ num_convs: 6
236
+ binary_classification_focal_gamma: 2.0
237
+ heptv2:
238
+ block_size: 128
239
+ dropout_ff: 0.0
240
+ embedding_dim: 256
241
+ num_convs: 6
242
+ num_heads: 16
243
+ width: 256
244
+ hit_feature_engineering:
245
+ tracker_neighborhood: true
246
+ input_encoding: split
247
+ output_mode: set
248
+ set_decoder:
249
+ aggregate_grid_size: 0.1
250
+ attention_mode: global-flash
251
+ auxiliary_loss_weight: 0.25
252
+ cardinality_loss_weight: 0.05
253
+ event_consistency_loss_weight: 0.0
254
+ hit_grouping: true
255
+ hit_grouping_chunk_size: 1024
256
+ hit_grouping_detector_balanced: false
257
+ hit_grouping_dim: 32
258
+ hit_grouping_loss_weight: 0.1
259
+ local_attention_radius: 0.4
260
+ matcher:
261
+ dr_scale: 0.1
262
+ energy: 0.0
263
+ geometry: 2.0
264
+ log_energy_scale: 0.6931471805599453
265
+ log_pt_scale: 0.6931471805599453
266
+ pid: 1.0
267
+ presence: 1.0
268
+ pt: 1.0
269
+ no_object_weight: 1.0
270
+ num_heads: 8
271
+ num_layers: 4
272
+ num_sectors: 32
273
+ num_slots: 256
274
+ presence_threshold: 0.5
275
+ proposal_grid_size: 0.1
276
+ proposal_mode: grid-diverse
277
+ query_init: input-conditioned
278
+ sector_neighbors: 1
279
+ tracker_fit_correction: false
280
+ tracker_group_magnetic_field: 2.0
281
+ tracker_group_readout: false
282
+ tracker_query_fraction: 0.6
283
+ use_aggregate_anchors: true
284
+ task_queries: false
285
+ type: heptv2
286
+ backend: pytorch
287
+ checkpoint_freq: 10000
288
+ comet: false
289
+ dataset: cld_hits
290
+ dtype: bfloat16
291
+ gpu_batch_multiplier: 1
292
+ gpu_type: l40
293
+ gpus: 1
294
+ hyperparameters:
295
+ batch_size: 1
296
+ lr: 0.001
297
+ load: null
298
+ lr_schedule: cosinedecay
299
+ mem_per_gpu_mb: 40000
300
+ ntest: 100
301
+ ntrain: null
302
+ num_steps: 100000
303
+ num_workers: 2
304
+ nvalid: null
305
+ optimizer: lamb
306
+ pad_to_multiple_elements: 128
307
+ patience: 10000
308
+ prefetch_factor: 2
309
+ raytune: *id001
310
+ seed: 12345
311
+ slurm_partition: ${project.gpu_partition}
312
+ slurm_runtime: 168h
313
+ sort_data: false
314
+ task_loss_weights: *id002
315
+ tensorboard_step_freq: 100
316
+ test_datasets: *id003
317
+ threads: 16
318
+ train_datasets: *id004
319
+ val_freq: 10000
320
+ validation_datasets: *id005
321
+ pyg-cld-hits-set-v1:
322
+ architecture:
323
+ attention: &id006
324
+ head_dim: 16
325
+ num_convs: 3
326
+ num_heads: 16
327
+ use_jagged_attention: true
328
+ binary_classification_focal_gamma: 2.0
329
+ input_encoding: split
330
+ output_mode: set
331
+ set_decoder:
332
+ dropout: 0.0
333
+ ffn_multiplier: 4.0
334
+ num_heads: 8
335
+ num_layers: 2
336
+ num_slots: 256
337
+ type: attention
338
+ backend: pytorch
339
+ checkpoint_freq: 10000
340
+ comet: false
341
+ dataset: cld_hits
342
+ dtype: bfloat16
343
+ gpu_batch_multiplier: 1
344
+ gpu_type: l40
345
+ gpus: 1
346
+ hyperparameters:
347
+ batch_size: 1
348
+ lr: 0.0001
349
+ load: null
350
+ lr_schedule: cosinedecay
351
+ mem_per_gpu_mb: 40000
352
+ ntest: 100
353
+ ntrain: null
354
+ num_steps: 100000
355
+ num_workers: 2
356
+ nvalid: null
357
+ optimizer: lamb
358
+ pad_to_multiple_elements: 128
359
+ patience: 10000
360
+ prefetch_factor: 2
361
+ raytune: *id001
362
+ seed: 12345
363
+ slurm_partition: ${project.gpu_partition}
364
+ slurm_runtime: 168h
365
+ sort_data: false
366
+ task_loss_weights: *id002
367
+ tensorboard_step_freq: 100
368
+ test_datasets: *id003
369
+ threads: 16
370
+ train_datasets: *id004
371
+ val_freq: 10000
372
+ validation_datasets: *id005
373
+ pyg-cld-hits-v1:
374
+ architecture:
375
+ attention: *id006
376
+ binary_classification_focal_gamma: 2.0
377
+ input_encoding: split
378
+ output_mode: elementwise
379
+ type: attention
380
+ backend: pytorch
381
+ checkpoint_freq: 10000
382
+ comet: false
383
+ dataset: cld_hits
384
+ dtype: bfloat16
385
+ gpu_batch_multiplier: 1
386
+ gpu_type: l40
387
+ gpus: 1
388
+ hyperparameters: *id007
389
+ load: null
390
+ lr_schedule: cosinedecay
391
+ mem_per_gpu_mb: 40000
392
+ ntest: 100
393
+ ntrain: null
394
+ num_steps: 100000
395
+ num_workers: 2
396
+ nvalid: null
397
+ optimizer: lamb
398
+ pad_to_multiple_elements: 128
399
+ patience: 10000
400
+ prefetch_factor: 2
401
+ raytune: *id001
402
+ seed: 12345
403
+ slurm_partition: ${project.gpu_partition}
404
+ slurm_runtime: 168h
405
+ sort_data: false
406
+ task_loss_weights: *id002
407
+ tensorboard_step_freq: 100
408
+ test_datasets: *id003
409
+ threads: 16
410
+ train_datasets: *id004
411
+ val_freq: 10000
412
+ validation_datasets: *id005
413
+ pyg-cld-v1:
414
+ architecture:
415
+ attention:
416
+ head_dim: 16
417
+ num_convs: 3
418
+ num_heads: 16
419
+ heptv2:
420
+ cluster_hash_at_centroid: true
421
+ track_hash_at_calo: true
422
+ input_encoding: split
423
+ type: attention
424
+ backend: pytorch
425
+ checkpoint_freq: 10000
426
+ comet: false
427
+ dataset: cld
428
+ dtype: bfloat16
429
+ gpu_batch_multiplier: 1024
430
+ gpu_type: l40
431
+ gpus: 1
432
+ hyperparameters:
433
+ batch_size: 1
434
+ lr: 0.0005
435
+ load: null
436
+ lr_schedule: cosinedecay
437
+ mem_per_gpu_mb: 40000
438
+ ntest: 100
439
+ ntrain: null
440
+ num_steps: 100000
441
+ num_workers: 2
442
+ nvalid: null
443
+ optimizer: lamb
444
+ patience: 10000
445
+ prefetch_factor: 2
446
+ raytune: *id001
447
+ seed: 12345
448
+ slurm_partition: ${project.gpu_partition}
449
+ slurm_runtime: 168h
450
+ sort_data: false
451
+ task_loss_weights: *id002
452
+ tensorboard_step_freq: 100
453
+ test_datasets:
454
+ - name: cld_edm_ttbar_pf
455
+ splits:
456
+ - '1'
457
+ - '2'
458
+ - '3'
459
+ - '4'
460
+ - '5'
461
+ - '6'
462
+ - '7'
463
+ - '8'
464
+ - '9'
465
+ - '10'
466
+ version: 3.3.0
467
+ - name: cld_edm_ww_fullhad_pf
468
+ splits:
469
+ - '1'
470
+ - '2'
471
+ - '3'
472
+ - '4'
473
+ - '5'
474
+ - '6'
475
+ - '7'
476
+ - '8'
477
+ - '9'
478
+ - '10'
479
+ version: 3.3.0
480
+ - name: cld_edm_qq_pf
481
+ splits:
482
+ - '1'
483
+ - '2'
484
+ - '3'
485
+ - '4'
486
+ - '5'
487
+ - '6'
488
+ - '7'
489
+ - '8'
490
+ - '9'
491
+ - '10'
492
+ version: 3.3.0
493
+ threads: 16
494
+ train_datasets:
495
+ physical:
496
+ batch_size: 1
497
+ samples:
498
+ - name: cld_edm_ttbar_pf
499
+ splits:
500
+ - '1'
501
+ - '2'
502
+ - '3'
503
+ - '4'
504
+ - '5'
505
+ - '6'
506
+ - '7'
507
+ - '8'
508
+ - '9'
509
+ - '10'
510
+ version: 3.3.0
511
+ - name: cld_edm_ww_fullhad_pf
512
+ splits:
513
+ - '1'
514
+ - '2'
515
+ - '3'
516
+ - '4'
517
+ - '5'
518
+ - '6'
519
+ - '7'
520
+ - '8'
521
+ - '9'
522
+ - '10'
523
+ version: 3.3.0
524
+ - name: cld_edm_qq_pf
525
+ splits:
526
+ - '1'
527
+ - '2'
528
+ - '3'
529
+ - '4'
530
+ - '5'
531
+ - '6'
532
+ - '7'
533
+ - '8'
534
+ - '9'
535
+ - '10'
536
+ version: 3.3.0
537
+ val_freq: 10000
538
+ validation_datasets:
539
+ physical:
540
+ batch_size: 1
541
+ samples:
542
+ - name: cld_edm_ttbar_pf
543
+ splits:
544
+ - '1'
545
+ - '2'
546
+ - '3'
547
+ - '4'
548
+ - '5'
549
+ - '6'
550
+ - '7'
551
+ - '8'
552
+ - '9'
553
+ - '10'
554
+ version: 3.3.0
555
+ - name: cld_edm_ww_fullhad_pf
556
+ splits:
557
+ - '1'
558
+ - '2'
559
+ - '3'
560
+ - '4'
561
+ - '5'
562
+ - '6'
563
+ - '7'
564
+ - '8'
565
+ - '9'
566
+ - '10'
567
+ version: 3.3.0
568
+ - name: cld_edm_qq_pf
569
+ splits:
570
+ - '1'
571
+ - '2'
572
+ - '3'
573
+ - '4'
574
+ - '5'
575
+ - '6'
576
+ - '7'
577
+ - '8'
578
+ - '9'
579
+ - '10'
580
+ version: 3.3.0
581
+ pyg-cldcliccolliderml-v1:
582
+ architecture:
583
+ attention:
584
+ head_dim: 16
585
+ num_convs: 3
586
+ num_heads: 16
587
+ input_encoding: split
588
+ type: attention
589
+ backend: pytorch
590
+ checkpoint_freq: 10000
591
+ comet: false
592
+ dataset: cld
593
+ dtype: bfloat16
594
+ gpu_batch_multiplier: 1024
595
+ gpu_type: l40
596
+ gpus: 1
597
+ hyperparameters:
598
+ batch_size: 1
599
+ lr: 0.0005
600
+ load: null
601
+ lr_schedule: cosinedecay
602
+ mem_per_gpu_mb: 40000
603
+ ntest: 100
604
+ ntrain: null
605
+ num_steps: 100000
606
+ num_workers: 2
607
+ nvalid: null
608
+ optimizer: lamb
609
+ patience: 10000
610
+ prefetch_factor: 2
611
+ raytune: *id001
612
+ seed: 12345
613
+ slurm_partition: ${project.gpu_partition}
614
+ slurm_runtime: 168h
615
+ sort_data: false
616
+ task_loss_weights: *id002
617
+ tensorboard_step_freq: 100
618
+ test_datasets:
619
+ - name: cld_edm_ttbar_pf
620
+ splits:
621
+ - '1'
622
+ - '2'
623
+ - '3'
624
+ - '4'
625
+ - '5'
626
+ - '6'
627
+ - '7'
628
+ - '8'
629
+ - '9'
630
+ - '10'
631
+ version: 3.3.0
632
+ - name: cld_edm_ww_fullhad_pf
633
+ splits:
634
+ - '1'
635
+ - '2'
636
+ - '3'
637
+ - '4'
638
+ - '5'
639
+ - '6'
640
+ - '7'
641
+ - '8'
642
+ - '9'
643
+ - '10'
644
+ version: 3.3.0
645
+ - name: cld_edm_qq_pf
646
+ splits:
647
+ - '1'
648
+ - '2'
649
+ - '3'
650
+ - '4'
651
+ - '5'
652
+ - '6'
653
+ - '7'
654
+ - '8'
655
+ - '9'
656
+ - '10'
657
+ version: 3.3.0
658
+ - name: clic_edm_ttbar_pf
659
+ splits:
660
+ - '1'
661
+ - '2'
662
+ - '3'
663
+ - '4'
664
+ - '5'
665
+ - '6'
666
+ - '7'
667
+ - '8'
668
+ - '9'
669
+ - '10'
670
+ version: 3.3.0
671
+ - name: clic_edm_ww_fullhad_pf
672
+ splits:
673
+ - '1'
674
+ - '2'
675
+ - '3'
676
+ - '4'
677
+ - '5'
678
+ - '6'
679
+ - '7'
680
+ - '8'
681
+ - '9'
682
+ - '10'
683
+ version: 3.3.0
684
+ - name: clic_edm_qq_pf
685
+ splits:
686
+ - '1'
687
+ - '2'
688
+ - '3'
689
+ - '4'
690
+ - '5'
691
+ - '6'
692
+ - '7'
693
+ - '8'
694
+ - '9'
695
+ - '10'
696
+ version: 3.3.0
697
+ - name: colliderml_ttbar_nopu_pf
698
+ splits:
699
+ - '1'
700
+ - '2'
701
+ - '3'
702
+ - '4'
703
+ - '5'
704
+ - '6'
705
+ - '7'
706
+ - '8'
707
+ - '9'
708
+ - '10'
709
+ version: 1.5.0
710
+ threads: 16
711
+ train_datasets:
712
+ cld:
713
+ batch_size: 1
714
+ samples:
715
+ - name: cld_edm_ttbar_pf
716
+ splits:
717
+ - '1'
718
+ - '2'
719
+ - '3'
720
+ - '4'
721
+ - '5'
722
+ - '6'
723
+ - '7'
724
+ - '8'
725
+ - '9'
726
+ - '10'
727
+ version: 3.3.0
728
+ - name: cld_edm_ww_fullhad_pf
729
+ splits:
730
+ - '1'
731
+ - '2'
732
+ - '3'
733
+ - '4'
734
+ - '5'
735
+ - '6'
736
+ - '7'
737
+ - '8'
738
+ - '9'
739
+ - '10'
740
+ version: 3.3.0
741
+ - name: cld_edm_qq_pf
742
+ splits:
743
+ - '1'
744
+ - '2'
745
+ - '3'
746
+ - '4'
747
+ - '5'
748
+ - '6'
749
+ - '7'
750
+ - '8'
751
+ - '9'
752
+ - '10'
753
+ version: 3.3.0
754
+ weight: 1.0
755
+ clic:
756
+ batch_size: 1
757
+ samples:
758
+ - name: clic_edm_ttbar_pf
759
+ splits:
760
+ - '1'
761
+ - '2'
762
+ - '3'
763
+ - '4'
764
+ - '5'
765
+ - '6'
766
+ - '7'
767
+ - '8'
768
+ - '9'
769
+ - '10'
770
+ version: 3.3.0
771
+ - name: clic_edm_ww_fullhad_pf
772
+ splits:
773
+ - '1'
774
+ - '2'
775
+ - '3'
776
+ - '4'
777
+ - '5'
778
+ - '6'
779
+ - '7'
780
+ - '8'
781
+ - '9'
782
+ - '10'
783
+ version: 3.3.0
784
+ - name: clic_edm_qq_pf
785
+ splits:
786
+ - '1'
787
+ - '2'
788
+ - '3'
789
+ - '4'
790
+ - '5'
791
+ - '6'
792
+ - '7'
793
+ - '8'
794
+ - '9'
795
+ - '10'
796
+ version: 3.3.0
797
+ weight: 1.0
798
+ colliderml:
799
+ batch_size: 1
800
+ samples:
801
+ - name: colliderml_ttbar_nopu_pf
802
+ splits:
803
+ - '1'
804
+ - '2'
805
+ - '3'
806
+ - '4'
807
+ - '5'
808
+ - '6'
809
+ - '7'
810
+ - '8'
811
+ - '9'
812
+ - '10'
813
+ version: 1.5.0
814
+ weight: 1.0
815
+ val_freq: 10000
816
+ validation_datasets:
817
+ cld:
818
+ batch_size: 1
819
+ samples:
820
+ - name: cld_edm_ttbar_pf
821
+ splits:
822
+ - '1'
823
+ - '2'
824
+ - '3'
825
+ - '4'
826
+ - '5'
827
+ - '6'
828
+ - '7'
829
+ - '8'
830
+ - '9'
831
+ - '10'
832
+ version: 3.3.0
833
+ - name: cld_edm_ww_fullhad_pf
834
+ splits:
835
+ - '1'
836
+ - '2'
837
+ - '3'
838
+ - '4'
839
+ - '5'
840
+ - '6'
841
+ - '7'
842
+ - '8'
843
+ - '9'
844
+ - '10'
845
+ version: 3.3.0
846
+ - name: cld_edm_qq_pf
847
+ splits:
848
+ - '1'
849
+ - '2'
850
+ - '3'
851
+ - '4'
852
+ - '5'
853
+ - '6'
854
+ - '7'
855
+ - '8'
856
+ - '9'
857
+ - '10'
858
+ version: 3.3.0
859
+ clic:
860
+ batch_size: 1
861
+ samples:
862
+ - name: clic_edm_ttbar_pf
863
+ splits:
864
+ - '1'
865
+ - '2'
866
+ - '3'
867
+ - '4'
868
+ - '5'
869
+ - '6'
870
+ - '7'
871
+ - '8'
872
+ - '9'
873
+ - '10'
874
+ version: 3.3.0
875
+ - name: clic_edm_ww_fullhad_pf
876
+ splits:
877
+ - '1'
878
+ - '2'
879
+ - '3'
880
+ - '4'
881
+ - '5'
882
+ - '6'
883
+ - '7'
884
+ - '8'
885
+ - '9'
886
+ - '10'
887
+ version: 3.3.0
888
+ - name: clic_edm_qq_pf
889
+ splits:
890
+ - '1'
891
+ - '2'
892
+ - '3'
893
+ - '4'
894
+ - '5'
895
+ - '6'
896
+ - '7'
897
+ - '8'
898
+ - '9'
899
+ - '10'
900
+ version: 3.3.0
901
+ colliderml:
902
+ batch_size: 1
903
+ samples:
904
+ - name: colliderml_ttbar_nopu_pf
905
+ splits:
906
+ - '1'
907
+ - '2'
908
+ - '3'
909
+ - '4'
910
+ - '5'
911
+ - '6'
912
+ - '7'
913
+ - '8'
914
+ - '9'
915
+ - '10'
916
+ version: 1.5.0
917
+ pyg-clic-hits-set-v1:
918
+ architecture:
919
+ attention: &id008
920
+ head_dim: 16
921
+ num_convs: 3
922
+ num_heads: 16
923
+ binary_classification_focal_gamma: 2.0
924
+ input_encoding: split
925
+ output_mode: set
926
+ set_decoder:
927
+ dropout: 0.0
928
+ ffn_multiplier: 4.0
929
+ num_heads: 8
930
+ num_layers: 2
931
+ num_slots: 256
932
+ type: attention
933
+ backend: pytorch
934
+ checkpoint_freq: 10000
935
+ comet: false
936
+ dataset: clic_hits
937
+ dtype: bfloat16
938
+ gpu_batch_multiplier: 16
939
+ gpu_type: l40
940
+ gpus: 1
941
+ hyperparameters:
942
+ batch_size: 1
943
+ lr: 0.0001
944
+ load: null
945
+ lr_schedule: cosinedecay
946
+ mem_per_gpu_mb: 40000
947
+ ntest: 100
948
+ ntrain: null
949
+ num_steps: 100000
950
+ num_workers: 2
951
+ nvalid: null
952
+ optimizer: lamb
953
+ patience: 10000
954
+ prefetch_factor: 2
955
+ raytune: *id001
956
+ seed: 12345
957
+ slurm_partition: ${project.gpu_partition}
958
+ slurm_runtime: 168h
959
+ sort_data: false
960
+ task_loss_weights: *id002
961
+ tensorboard_step_freq: 100
962
+ test_datasets: &id009
963
+ - name: clic_edm_ttbar_hits
964
+ splits:
965
+ - '1'
966
+ - '2'
967
+ - '3'
968
+ - '4'
969
+ - '5'
970
+ - '6'
971
+ - '7'
972
+ - '8'
973
+ - '9'
974
+ - '10'
975
+ version: 3.2.2
976
+ - name: clic_edm_ww_fullhad_hits
977
+ splits:
978
+ - '1'
979
+ - '2'
980
+ - '3'
981
+ - '4'
982
+ - '5'
983
+ - '6'
984
+ - '7'
985
+ - '8'
986
+ - '9'
987
+ - '10'
988
+ version: 3.2.2
989
+ - name: clic_edm_qq_hits
990
+ splits:
991
+ - '1'
992
+ - '2'
993
+ - '3'
994
+ - '4'
995
+ - '5'
996
+ - '6'
997
+ - '7'
998
+ - '8'
999
+ - '9'
1000
+ - '10'
1001
+ version: 3.2.2
1002
+ threads: 16
1003
+ train_datasets: &id010
1004
+ physical:
1005
+ batch_size: 1
1006
+ samples:
1007
+ - name: clic_edm_ttbar_hits
1008
+ splits:
1009
+ - '1'
1010
+ - '2'
1011
+ - '3'
1012
+ - '4'
1013
+ - '5'
1014
+ - '6'
1015
+ - '7'
1016
+ - '8'
1017
+ - '9'
1018
+ - '10'
1019
+ version: 3.2.2
1020
+ - name: clic_edm_ww_fullhad_hits
1021
+ splits:
1022
+ - '1'
1023
+ - '2'
1024
+ - '3'
1025
+ - '4'
1026
+ - '5'
1027
+ - '6'
1028
+ - '7'
1029
+ - '8'
1030
+ - '9'
1031
+ - '10'
1032
+ version: 3.2.2
1033
+ - name: clic_edm_qq_hits
1034
+ splits:
1035
+ - '1'
1036
+ - '2'
1037
+ - '3'
1038
+ - '4'
1039
+ - '5'
1040
+ - '6'
1041
+ - '7'
1042
+ - '8'
1043
+ - '9'
1044
+ - '10'
1045
+ version: 3.2.2
1046
+ val_freq: 10000
1047
+ validation_datasets: &id011
1048
+ physical:
1049
+ batch_size: 1
1050
+ samples:
1051
+ - name: clic_edm_ttbar_hits
1052
+ splits:
1053
+ - '1'
1054
+ - '2'
1055
+ - '3'
1056
+ - '4'
1057
+ - '5'
1058
+ - '6'
1059
+ - '7'
1060
+ - '8'
1061
+ - '9'
1062
+ - '10'
1063
+ version: 3.2.2
1064
+ - name: clic_edm_ww_fullhad_hits
1065
+ splits:
1066
+ - '1'
1067
+ - '2'
1068
+ - '3'
1069
+ - '4'
1070
+ - '5'
1071
+ - '6'
1072
+ - '7'
1073
+ - '8'
1074
+ - '9'
1075
+ - '10'
1076
+ version: 3.2.2
1077
+ - name: clic_edm_qq_hits
1078
+ splits:
1079
+ - '1'
1080
+ - '2'
1081
+ - '3'
1082
+ - '4'
1083
+ - '5'
1084
+ - '6'
1085
+ - '7'
1086
+ - '8'
1087
+ - '9'
1088
+ - '10'
1089
+ version: 3.2.2
1090
+ pyg-clic-hits-v1:
1091
+ architecture:
1092
+ attention: *id008
1093
+ binary_classification_focal_gamma: 2.0
1094
+ input_encoding: split
1095
+ output_mode: elementwise
1096
+ type: attention
1097
+ backend: pytorch
1098
+ checkpoint_freq: 10000
1099
+ comet: false
1100
+ dataset: clic_hits
1101
+ dtype: bfloat16
1102
+ gpu_batch_multiplier: 16
1103
+ gpu_type: l40
1104
+ gpus: 1
1105
+ hyperparameters:
1106
+ batch_size: 1
1107
+ lr: 0.0001
1108
+ load: null
1109
+ lr_schedule: cosinedecay
1110
+ mem_per_gpu_mb: 40000
1111
+ ntest: 100
1112
+ ntrain: null
1113
+ num_steps: 100000
1114
+ num_workers: 2
1115
+ nvalid: null
1116
+ optimizer: lamb
1117
+ patience: 10000
1118
+ prefetch_factor: 2
1119
+ raytune: *id001
1120
+ seed: 12345
1121
+ slurm_partition: ${project.gpu_partition}
1122
+ slurm_runtime: 168h
1123
+ sort_data: false
1124
+ task_loss_weights: *id002
1125
+ tensorboard_step_freq: 100
1126
+ test_datasets: *id009
1127
+ threads: 16
1128
+ train_datasets: *id010
1129
+ val_freq: 10000
1130
+ validation_datasets: *id011
1131
+ pyg-clic-v1:
1132
+ architecture:
1133
+ attention:
1134
+ head_dim: 16
1135
+ num_convs: 3
1136
+ num_heads: 16
1137
+ heptv2:
1138
+ cluster_hash_at_centroid: true
1139
+ track_hash_at_calo: true
1140
+ input_encoding: split
1141
+ type: attention
1142
+ backend: pytorch
1143
+ checkpoint_freq: 10000
1144
+ comet: false
1145
+ dataset: clic
1146
+ dtype: bfloat16
1147
+ gpu_batch_multiplier: 1024
1148
+ gpu_type: l40
1149
+ gpus: 1
1150
+ hyperparameters:
1151
+ batch_size: 1
1152
+ lr: 0.0005
1153
+ load: null
1154
+ lr_schedule: cosinedecay
1155
+ mem_per_gpu_mb: 40000
1156
+ ntest: 100
1157
+ ntrain: null
1158
+ num_steps: 100000
1159
+ num_workers: 2
1160
+ nvalid: null
1161
+ optimizer: lamb
1162
+ patience: 10000
1163
+ prefetch_factor: 2
1164
+ raytune: *id001
1165
+ seed: 12345
1166
+ slurm_partition: ${project.gpu_partition}
1167
+ slurm_runtime: 168h
1168
+ sort_data: false
1169
+ task_loss_weights: *id002
1170
+ tensorboard_step_freq: 100
1171
+ test_datasets:
1172
+ - name: clic_edm_ttbar_pf
1173
+ splits:
1174
+ - '1'
1175
+ - '2'
1176
+ - '3'
1177
+ - '4'
1178
+ - '5'
1179
+ - '6'
1180
+ - '7'
1181
+ - '8'
1182
+ - '9'
1183
+ - '10'
1184
+ version: 3.3.0
1185
+ - name: clic_edm_ww_fullhad_pf
1186
+ splits:
1187
+ - '1'
1188
+ - '2'
1189
+ - '3'
1190
+ - '4'
1191
+ - '5'
1192
+ - '6'
1193
+ - '7'
1194
+ - '8'
1195
+ - '9'
1196
+ - '10'
1197
+ version: 3.3.0
1198
+ - name: clic_edm_qq_pf
1199
+ splits:
1200
+ - '1'
1201
+ - '2'
1202
+ - '3'
1203
+ - '4'
1204
+ - '5'
1205
+ - '6'
1206
+ - '7'
1207
+ - '8'
1208
+ - '9'
1209
+ - '10'
1210
+ version: 3.3.0
1211
+ threads: 16
1212
+ train_datasets:
1213
+ physical:
1214
+ batch_size: 1
1215
+ samples:
1216
+ - name: clic_edm_ttbar_pf
1217
+ splits:
1218
+ - '1'
1219
+ - '2'
1220
+ - '3'
1221
+ - '4'
1222
+ - '5'
1223
+ - '6'
1224
+ - '7'
1225
+ - '8'
1226
+ - '9'
1227
+ - '10'
1228
+ version: 3.3.0
1229
+ - name: clic_edm_ww_fullhad_pf
1230
+ splits:
1231
+ - '1'
1232
+ - '2'
1233
+ - '3'
1234
+ - '4'
1235
+ - '5'
1236
+ - '6'
1237
+ - '7'
1238
+ - '8'
1239
+ - '9'
1240
+ - '10'
1241
+ version: 3.3.0
1242
+ - name: clic_edm_qq_pf
1243
+ splits:
1244
+ - '1'
1245
+ - '2'
1246
+ - '3'
1247
+ - '4'
1248
+ - '5'
1249
+ - '6'
1250
+ - '7'
1251
+ - '8'
1252
+ - '9'
1253
+ - '10'
1254
+ version: 3.3.0
1255
+ val_freq: 10000
1256
+ validation_datasets:
1257
+ physical:
1258
+ batch_size: 1
1259
+ samples:
1260
+ - name: clic_edm_ttbar_pf
1261
+ splits:
1262
+ - '1'
1263
+ - '2'
1264
+ - '3'
1265
+ - '4'
1266
+ - '5'
1267
+ - '6'
1268
+ - '7'
1269
+ - '8'
1270
+ - '9'
1271
+ - '10'
1272
+ version: 3.3.0
1273
+ - name: clic_edm_ww_fullhad_pf
1274
+ splits:
1275
+ - '1'
1276
+ - '2'
1277
+ - '3'
1278
+ - '4'
1279
+ - '5'
1280
+ - '6'
1281
+ - '7'
1282
+ - '8'
1283
+ - '9'
1284
+ - '10'
1285
+ version: 3.3.0
1286
+ - name: clic_edm_qq_pf
1287
+ splits:
1288
+ - '1'
1289
+ - '2'
1290
+ - '3'
1291
+ - '4'
1292
+ - '5'
1293
+ - '6'
1294
+ - '7'
1295
+ - '8'
1296
+ - '9'
1297
+ - '10'
1298
+ version: 3.3.0
1299
+ pyg-cms-v1:
1300
+ architecture:
1301
+ attention:
1302
+ head_dim: 32
1303
+ num_convs: 3
1304
+ num_heads: 16
1305
+ heptv2:
1306
+ track_hash_at_calo: true
1307
+ input_encoding: split
1308
+ type: attention
1309
+ backend: pytorch
1310
+ checkpoint_freq: 10000
1311
+ comet: false
1312
+ dataset: cms
1313
+ dtype: bfloat16
1314
+ gpu_batch_multiplier: 4
1315
+ gpu_type: l40
1316
+ gpus: 1
1317
+ hyperparameters:
1318
+ batch_size: 1
1319
+ lr: 0.0004
1320
+ load: null
1321
+ lr_schedule: cosinedecay
1322
+ mem_per_gpu_mb: 40000
1323
+ ntest: 100
1324
+ ntrain: null
1325
+ num_steps: 100000
1326
+ num_workers: 2
1327
+ nvalid: null
1328
+ optimizer: lamb
1329
+ patience: 10000
1330
+ prefetch_factor: 2
1331
+ raytune: *id001
1332
+ seed: 12345
1333
+ slurm_partition: ${project.gpu_partition}
1334
+ slurm_runtime: 168h
1335
+ sort_data: false
1336
+ task_loss_weights: *id002
1337
+ tensorboard_step_freq: 100
1338
+ test_datasets:
1339
+ - name: cms_pf_ttbar
1340
+ splits:
1341
+ - '1'
1342
+ - '2'
1343
+ - '3'
1344
+ - '4'
1345
+ - '5'
1346
+ - '6'
1347
+ - '7'
1348
+ - '8'
1349
+ - '9'
1350
+ - '10'
1351
+ version: 3.2.0
1352
+ - name: cms_pf_qcd
1353
+ splits:
1354
+ - '1'
1355
+ - '2'
1356
+ - '3'
1357
+ - '4'
1358
+ - '5'
1359
+ - '6'
1360
+ - '7'
1361
+ - '8'
1362
+ - '9'
1363
+ - '10'
1364
+ version: 3.2.0
1365
+ - name: cms_pf_ztt
1366
+ splits:
1367
+ - '1'
1368
+ - '2'
1369
+ - '3'
1370
+ - '4'
1371
+ - '5'
1372
+ - '6'
1373
+ - '7'
1374
+ - '8'
1375
+ - '9'
1376
+ - '10'
1377
+ version: 3.2.0
1378
+ threads: 16
1379
+ train_datasets:
1380
+ physical_nopu:
1381
+ batch_size: 16
1382
+ samples:
1383
+ - name: cms_pf_ttbar_nopu
1384
+ splits:
1385
+ - '1'
1386
+ - '2'
1387
+ - '3'
1388
+ - '4'
1389
+ - '5'
1390
+ - '6'
1391
+ - '7'
1392
+ - '8'
1393
+ - '9'
1394
+ - '10'
1395
+ version: 3.2.0
1396
+ - name: cms_pf_qcd_nopu
1397
+ splits:
1398
+ - '1'
1399
+ - '2'
1400
+ - '3'
1401
+ - '4'
1402
+ - '5'
1403
+ - '6'
1404
+ - '7'
1405
+ - '8'
1406
+ - '9'
1407
+ - '10'
1408
+ version: 3.2.0
1409
+ - name: cms_pf_ztt_nopu
1410
+ splits:
1411
+ - '1'
1412
+ - '2'
1413
+ - '3'
1414
+ - '4'
1415
+ - '5'
1416
+ - '6'
1417
+ - '7'
1418
+ - '8'
1419
+ - '9'
1420
+ - '10'
1421
+ version: 3.2.0
1422
+ physical_pu:
1423
+ batch_size: 1
1424
+ samples:
1425
+ - name: cms_pf_ttbar
1426
+ splits:
1427
+ - '1'
1428
+ - '2'
1429
+ - '3'
1430
+ - '4'
1431
+ - '5'
1432
+ - '6'
1433
+ - '7'
1434
+ - '8'
1435
+ - '9'
1436
+ - '10'
1437
+ version: 3.2.0
1438
+ - name: cms_pf_qcd
1439
+ splits:
1440
+ - '1'
1441
+ - '2'
1442
+ - '3'
1443
+ - '4'
1444
+ - '5'
1445
+ - '6'
1446
+ - '7'
1447
+ - '8'
1448
+ - '9'
1449
+ - '10'
1450
+ version: 3.2.0
1451
+ - name: cms_pf_ztt
1452
+ splits:
1453
+ - '1'
1454
+ - '2'
1455
+ - '3'
1456
+ - '4'
1457
+ - '5'
1458
+ - '6'
1459
+ - '7'
1460
+ - '8'
1461
+ - '9'
1462
+ - '10'
1463
+ version: 3.2.0
1464
+ val_freq: 10000
1465
+ validation_datasets:
1466
+ physical_nopu:
1467
+ batch_size: 16
1468
+ samples:
1469
+ - name: cms_pf_ttbar_nopu
1470
+ splits:
1471
+ - '1'
1472
+ - '2'
1473
+ - '3'
1474
+ - '4'
1475
+ - '5'
1476
+ - '6'
1477
+ - '7'
1478
+ - '8'
1479
+ - '9'
1480
+ - '10'
1481
+ version: 3.2.0
1482
+ - name: cms_pf_qcd_nopu
1483
+ splits:
1484
+ - '1'
1485
+ - '2'
1486
+ - '3'
1487
+ - '4'
1488
+ - '5'
1489
+ - '6'
1490
+ - '7'
1491
+ - '8'
1492
+ - '9'
1493
+ - '10'
1494
+ version: 3.2.0
1495
+ - name: cms_pf_ztt_nopu
1496
+ splits:
1497
+ - '1'
1498
+ - '2'
1499
+ - '3'
1500
+ - '4'
1501
+ - '5'
1502
+ - '6'
1503
+ - '7'
1504
+ - '8'
1505
+ - '9'
1506
+ - '10'
1507
+ version: 3.2.0
1508
+ physical_pu:
1509
+ batch_size: 1
1510
+ samples:
1511
+ - name: cms_pf_ttbar
1512
+ splits:
1513
+ - '1'
1514
+ - '2'
1515
+ - '3'
1516
+ - '4'
1517
+ - '5'
1518
+ - '6'
1519
+ - '7'
1520
+ - '8'
1521
+ - '9'
1522
+ - '10'
1523
+ version: 3.2.0
1524
+ - name: cms_pf_qcd
1525
+ splits:
1526
+ - '1'
1527
+ - '2'
1528
+ - '3'
1529
+ - '4'
1530
+ - '5'
1531
+ - '6'
1532
+ - '7'
1533
+ - '8'
1534
+ - '9'
1535
+ - '10'
1536
+ version: 3.2.0
1537
+ - name: cms_pf_ztt
1538
+ splits:
1539
+ - '1'
1540
+ - '2'
1541
+ - '3'
1542
+ - '4'
1543
+ - '5'
1544
+ - '6'
1545
+ - '7'
1546
+ - '8'
1547
+ - '9'
1548
+ - '10'
1549
+ version: 3.2.0
1550
+ pyg-colliderml-hits-set-v1:
1551
+ architecture:
1552
+ attention: &id012
1553
+ attention_type: flash
1554
+ head_dim: 16
1555
+ num_convs: 3
1556
+ num_heads: 16
1557
+ input_encoding: split
1558
+ output_mode: set
1559
+ set_decoder:
1560
+ dropout: 0.0
1561
+ ffn_multiplier: 4.0
1562
+ num_heads: 8
1563
+ num_layers: 2
1564
+ num_slots: 512
1565
+ type: attention
1566
+ backend: pytorch
1567
+ checkpoint_freq: 10000
1568
+ comet: false
1569
+ dataset: colliderml_hits
1570
+ dtype: bfloat16
1571
+ gpu_batch_multiplier: 1
1572
+ gpu_type: l40
1573
+ gpus: 1
1574
+ hyperparameters: &id013
1575
+ batch_size: 1
1576
+ lr: 0.0001
1577
+ load: null
1578
+ lr_schedule: cosinedecay
1579
+ mem_per_gpu_mb: 40000
1580
+ ntest: 100
1581
+ ntrain: null
1582
+ num_steps: 100000
1583
+ num_workers: 2
1584
+ nvalid: null
1585
+ optimizer: lamb
1586
+ pad_to_multiple_elements: 128
1587
+ patience: 10000
1588
+ prefetch_factor: 2
1589
+ raytune: *id001
1590
+ seed: 12345
1591
+ slurm_partition: ${project.gpu_partition}
1592
+ slurm_runtime: 168h
1593
+ sort_data: false
1594
+ task_loss_weights: *id002
1595
+ tensorboard_step_freq: 100
1596
+ test_datasets: &id014
1597
+ - name: colliderml_ttbar_hits
1598
+ splits:
1599
+ - '1'
1600
+ - '2'
1601
+ - '3'
1602
+ - '4'
1603
+ - '5'
1604
+ - '6'
1605
+ - '7'
1606
+ - '8'
1607
+ - '9'
1608
+ - '10'
1609
+ version: 1.3.0
1610
+ threads: 16
1611
+ train_datasets: &id015
1612
+ physical:
1613
+ batch_size: 1
1614
+ samples:
1615
+ - name: colliderml_ttbar_hits
1616
+ splits:
1617
+ - '1'
1618
+ - '2'
1619
+ - '3'
1620
+ - '4'
1621
+ - '5'
1622
+ - '6'
1623
+ - '7'
1624
+ - '8'
1625
+ - '9'
1626
+ - '10'
1627
+ version: 1.3.0
1628
+ val_freq: 10000
1629
+ validation_datasets: &id016
1630
+ physical:
1631
+ batch_size: 1
1632
+ samples:
1633
+ - name: colliderml_ttbar_hits
1634
+ splits:
1635
+ - '1'
1636
+ - '2'
1637
+ - '3'
1638
+ - '4'
1639
+ - '5'
1640
+ - '6'
1641
+ - '7'
1642
+ - '8'
1643
+ - '9'
1644
+ - '10'
1645
+ version: 1.3.0
1646
+ pyg-colliderml-hits-v1:
1647
+ architecture:
1648
+ attention: *id012
1649
+ input_encoding: split
1650
+ type: attention
1651
+ backend: pytorch
1652
+ checkpoint_freq: 10000
1653
+ comet: false
1654
+ dataset: colliderml_hits
1655
+ dtype: bfloat16
1656
+ gpu_batch_multiplier: 8
1657
+ gpu_type: l40
1658
+ gpus: 1
1659
+ hyperparameters: *id013
1660
+ load: null
1661
+ lr_schedule: cosinedecay
1662
+ mem_per_gpu_mb: 40000
1663
+ ntest: 100
1664
+ ntrain: null
1665
+ num_steps: 100000
1666
+ num_workers: 2
1667
+ nvalid: null
1668
+ optimizer: lamb
1669
+ patience: 10000
1670
+ prefetch_factor: 2
1671
+ raytune: *id001
1672
+ seed: 12345
1673
+ slurm_partition: ${project.gpu_partition}
1674
+ slurm_runtime: 168h
1675
+ sort_data: false
1676
+ task_loss_weights: *id002
1677
+ tensorboard_step_freq: 100
1678
+ test_datasets: *id014
1679
+ threads: 16
1680
+ train_datasets: *id015
1681
+ val_freq: 10000
1682
+ validation_datasets: *id016
1683
+ pyg-colliderml-pu0pu200-groups-v1:
1684
+ architecture: &id017
1685
+ attention:
1686
+ attention_type: flash
1687
+ head_dim: 16
1688
+ num_convs: 3
1689
+ num_heads: 16
1690
+ heptv2:
1691
+ track_hash_at_calo: true
1692
+ input_encoding: split
1693
+ type: attention
1694
+ backend: pytorch
1695
+ checkpoint_freq: 10000
1696
+ comet: false
1697
+ dataset: colliderml
1698
+ dtype: bfloat16
1699
+ gpu_batch_multiplier: 1
1700
+ gpu_type: l40
1701
+ gpus: 1
1702
+ hyperparameters: &id018
1703
+ batch_size: 1
1704
+ lr: 0.0001
1705
+ load: null
1706
+ lr_schedule: cosinedecay
1707
+ mem_per_gpu_mb: 40000
1708
+ ntest: 100
1709
+ ntrain: null
1710
+ num_steps: 100000
1711
+ num_workers: 2
1712
+ nvalid: null
1713
+ optimizer: lamb
1714
+ patience: 10000
1715
+ prefetch_factor: 2
1716
+ raytune: *id001
1717
+ seed: 12345
1718
+ slurm_partition: ${project.gpu_partition}
1719
+ slurm_runtime: 168h
1720
+ sort_data: false
1721
+ task_loss_weights: *id002
1722
+ tensorboard_step_freq: 100
1723
+ test_datasets:
1724
+ - name: colliderml_ttbar_nopu_pf
1725
+ splits:
1726
+ - '1'
1727
+ - '2'
1728
+ - '3'
1729
+ - '4'
1730
+ - '5'
1731
+ - '6'
1732
+ - '7'
1733
+ - '8'
1734
+ - '9'
1735
+ - '10'
1736
+ version: 1.5.0
1737
+ - name: colliderml_ttbar_pu200_pf
1738
+ splits:
1739
+ - '1'
1740
+ - '2'
1741
+ - '3'
1742
+ - '4'
1743
+ - '5'
1744
+ - '6'
1745
+ - '7'
1746
+ - '8'
1747
+ - '9'
1748
+ - '10'
1749
+ version: 1.5.0
1750
+ threads: 16
1751
+ train_datasets:
1752
+ pu0:
1753
+ batch_size: 12
1754
+ samples:
1755
+ - name: colliderml_ttbar_nopu_pf
1756
+ splits:
1757
+ - '1'
1758
+ - '2'
1759
+ - '3'
1760
+ - '4'
1761
+ - '5'
1762
+ - '6'
1763
+ - '7'
1764
+ - '8'
1765
+ - '9'
1766
+ - '10'
1767
+ version: 1.5.0
1768
+ pu200:
1769
+ batch_size: 1
1770
+ samples:
1771
+ - name: colliderml_ttbar_pu200_pf
1772
+ splits:
1773
+ - '1'
1774
+ - '2'
1775
+ - '3'
1776
+ - '4'
1777
+ - '5'
1778
+ - '6'
1779
+ - '7'
1780
+ - '8'
1781
+ - '9'
1782
+ - '10'
1783
+ version: 1.5.0
1784
+ val_freq: 10000
1785
+ validation_datasets:
1786
+ pu0:
1787
+ batch_size: 12
1788
+ samples:
1789
+ - name: colliderml_ttbar_nopu_pf
1790
+ splits:
1791
+ - '1'
1792
+ - '2'
1793
+ - '3'
1794
+ - '4'
1795
+ - '5'
1796
+ - '6'
1797
+ - '7'
1798
+ - '8'
1799
+ - '9'
1800
+ - '10'
1801
+ version: 1.5.0
1802
+ pu200:
1803
+ batch_size: 1
1804
+ samples:
1805
+ - name: colliderml_ttbar_pu200_pf
1806
+ splits:
1807
+ - '1'
1808
+ - '2'
1809
+ - '3'
1810
+ - '4'
1811
+ - '5'
1812
+ - '6'
1813
+ - '7'
1814
+ - '8'
1815
+ - '9'
1816
+ - '10'
1817
+ version: 1.5.0
1818
+ pyg-colliderml-pu200-v1:
1819
+ architecture:
1820
+ attention:
1821
+ attention_type: flash
1822
+ head_dim: 16
1823
+ num_convs: 3
1824
+ num_heads: 16
1825
+ heptv2:
1826
+ track_hash_at_calo: true
1827
+ input_encoding: split
1828
+ type: attention
1829
+ backend: pytorch
1830
+ checkpoint_freq: 10000
1831
+ comet: false
1832
+ dataset: colliderml
1833
+ dtype: bfloat16
1834
+ gpu_batch_multiplier: 8
1835
+ gpu_type: l40
1836
+ gpus: 1
1837
+ hyperparameters:
1838
+ batch_size: 1
1839
+ lr: 0.0001
1840
+ load: null
1841
+ lr_schedule: cosinedecay
1842
+ mem_per_gpu_mb: 40000
1843
+ ntest: 100
1844
+ ntrain: null
1845
+ num_steps: 100000
1846
+ num_workers: 2
1847
+ nvalid: null
1848
+ optimizer: lamb
1849
+ patience: 10000
1850
+ prefetch_factor: 2
1851
+ raytune: *id001
1852
+ seed: 12345
1853
+ slurm_partition: ${project.gpu_partition}
1854
+ slurm_runtime: 168h
1855
+ sort_data: false
1856
+ task_loss_weights: *id002
1857
+ tensorboard_step_freq: 100
1858
+ test_datasets:
1859
+ - name: colliderml_ttbar_pu200_pf
1860
+ splits:
1861
+ - '1'
1862
+ - '2'
1863
+ - '3'
1864
+ - '4'
1865
+ - '5'
1866
+ - '6'
1867
+ - '7'
1868
+ - '8'
1869
+ - '9'
1870
+ - '10'
1871
+ version: 1.5.0
1872
+ threads: 16
1873
+ train_datasets:
1874
+ physical:
1875
+ batch_size: 1
1876
+ samples:
1877
+ - name: colliderml_ttbar_pu200_pf
1878
+ splits:
1879
+ - '1'
1880
+ - '2'
1881
+ - '3'
1882
+ - '4'
1883
+ - '5'
1884
+ - '6'
1885
+ - '7'
1886
+ - '8'
1887
+ - '9'
1888
+ - '10'
1889
+ version: 1.5.0
1890
+ val_freq: 10000
1891
+ validation_datasets:
1892
+ physical:
1893
+ batch_size: 1
1894
+ samples:
1895
+ - name: colliderml_ttbar_pu200_pf
1896
+ splits:
1897
+ - '1'
1898
+ - '2'
1899
+ - '3'
1900
+ - '4'
1901
+ - '5'
1902
+ - '6'
1903
+ - '7'
1904
+ - '8'
1905
+ - '9'
1906
+ - '10'
1907
+ version: 1.5.0
1908
+ pyg-colliderml-v1:
1909
+ architecture: *id017
1910
+ backend: pytorch
1911
+ checkpoint_freq: 10000
1912
+ comet: false
1913
+ dataset: colliderml
1914
+ dtype: bfloat16
1915
+ gpu_batch_multiplier: 8
1916
+ gpu_type: l40
1917
+ gpus: 1
1918
+ hyperparameters: *id018
1919
+ load: null
1920
+ lr_schedule: cosinedecay
1921
+ mem_per_gpu_mb: 40000
1922
+ ntest: 100
1923
+ ntrain: null
1924
+ num_steps: 100000
1925
+ num_workers: 2
1926
+ nvalid: null
1927
+ optimizer: lamb
1928
+ patience: 10000
1929
+ prefetch_factor: 2
1930
+ raytune: *id001
1931
+ seed: 12345
1932
+ slurm_partition: ${project.gpu_partition}
1933
+ slurm_runtime: 168h
1934
+ sort_data: false
1935
+ task_loss_weights: *id002
1936
+ tensorboard_step_freq: 100
1937
+ test_datasets:
1938
+ - name: colliderml_ttbar_nopu_pf
1939
+ splits:
1940
+ - '1'
1941
+ - '2'
1942
+ - '3'
1943
+ - '4'
1944
+ - '5'
1945
+ - '6'
1946
+ - '7'
1947
+ - '8'
1948
+ - '9'
1949
+ - '10'
1950
+ version: 1.5.0
1951
+ threads: 16
1952
+ train_datasets:
1953
+ physical:
1954
+ batch_size: 1
1955
+ samples:
1956
+ - name: colliderml_ttbar_nopu_pf
1957
+ splits:
1958
+ - '1'
1959
+ - '2'
1960
+ - '3'
1961
+ - '4'
1962
+ - '5'
1963
+ - '6'
1964
+ - '7'
1965
+ - '8'
1966
+ - '9'
1967
+ - '10'
1968
+ version: 1.5.0
1969
+ val_freq: 10000
1970
+ validation_datasets:
1971
+ physical:
1972
+ batch_size: 1
1973
+ samples:
1974
+ - name: colliderml_ttbar_nopu_pf
1975
+ splits:
1976
+ - '1'
1977
+ - '2'
1978
+ - '3'
1979
+ - '4'
1980
+ - '5'
1981
+ - '6'
1982
+ - '7'
1983
+ - '8'
1984
+ - '9'
1985
+ - '10'
1986
+ version: 1.5.0
1987
+ pyg-idea-pipeline-v1:
1988
+ architecture:
1989
+ heptv2:
1990
+ block_size: 100
1991
+ dropout_ff: 0.0
1992
+ embedding_dim: 256
1993
+ num_convs: 3
1994
+ num_heads: 16
1995
+ track_hash_at_calo: true
1996
+ width: 256
1997
+ input_encoding: split
1998
+ type: heptv2
1999
+ backend: pytorch
2000
+ checkpoint_freq: 10000
2001
+ comet: false
2002
+ dataset: idea
2003
+ dtype: bfloat16
2004
+ gpu_batch_multiplier: 16
2005
+ gpu_type: l40
2006
+ gpus: 1
2007
+ hyperparameters:
2008
+ batch_size: 1
2009
+ lr: 0.0005
2010
+ load: null
2011
+ lr_schedule: cosinedecay
2012
+ mem_per_gpu_mb: 40000
2013
+ ntest: 100
2014
+ ntrain: null
2015
+ num_steps: 100000
2016
+ num_workers: 2
2017
+ nvalid: null
2018
+ optimizer: lamb
2019
+ pad_to_multiple_elements: 100
2020
+ patience: 10000
2021
+ prefetch_factor: 2
2022
+ raytune: *id001
2023
+ seed: 12345
2024
+ slurm_partition: ${project.gpu_partition}
2025
+ slurm_runtime: 168h
2026
+ sort_data: false
2027
+ task_loss_weights: *id002
2028
+ tensorboard_step_freq: 100
2029
+ test_datasets:
2030
+ - name: idea_edm_qq_pf
2031
+ splits:
2032
+ - '1'
2033
+ version: 0.2.1
2034
+ - name: idea_edm_ttbar_pf
2035
+ splits:
2036
+ - '1'
2037
+ version: 0.2.1
2038
+ - name: idea_edm_ww_fullhad_pf
2039
+ splits:
2040
+ - '1'
2041
+ version: 0.2.1
2042
+ threads: 16
2043
+ train_datasets:
2044
+ physical:
2045
+ batch_size: 1
2046
+ samples:
2047
+ - name: idea_edm_qq_pf
2048
+ splits:
2049
+ - '1'
2050
+ version: 0.2.1
2051
+ - name: idea_edm_ttbar_pf
2052
+ splits:
2053
+ - '1'
2054
+ version: 0.2.1
2055
+ - name: idea_edm_ww_fullhad_pf
2056
+ splits:
2057
+ - '1'
2058
+ version: 0.2.1
2059
+ val_freq: 10000
2060
+ validation_datasets:
2061
+ physical:
2062
+ batch_size: 1
2063
+ samples:
2064
+ - name: idea_edm_qq_pf
2065
+ splits:
2066
+ - '1'
2067
+ version: 0.2.1
2068
+ - name: idea_edm_ttbar_pf
2069
+ splits:
2070
+ - '1'
2071
+ version: 0.2.1
2072
+ - name: idea_edm_ww_fullhad_pf
2073
+ splits:
2074
+ - '1'
2075
+ version: 0.2.1
2076
+ pyg-maia-v1:
2077
+ architecture:
2078
+ attention:
2079
+ head_dim: 16
2080
+ num_convs: 3
2081
+ num_heads: 16
2082
+ input_encoding: split
2083
+ type: attention
2084
+ backend: pytorch
2085
+ checkpoint_freq: 10000
2086
+ comet: false
2087
+ dataset: maia
2088
+ dtype: bfloat16
2089
+ gpu_batch_multiplier: 1
2090
+ gpu_type: l40
2091
+ gpus: 1
2092
+ hyperparameters:
2093
+ batch_size: 1
2094
+ lr: 0.0001
2095
+ load: null
2096
+ lr_schedule: cosinedecay
2097
+ mem_per_gpu_mb: 40000
2098
+ ntest: 100
2099
+ ntrain: null
2100
+ num_steps: 100000
2101
+ num_workers: 2
2102
+ nvalid: null
2103
+ optimizer: lamb
2104
+ patience: 10000
2105
+ prefetch_factor: 2
2106
+ raytune: *id001
2107
+ seed: 12345
2108
+ slurm_partition: ${project.gpu_partition}
2109
+ slurm_runtime: 168h
2110
+ sort_data: false
2111
+ task_loss_weights: *id002
2112
+ tensorboard_step_freq: 100
2113
+ test_datasets:
2114
+ - name: maia_edm_ttbar_pf
2115
+ splits:
2116
+ - '10'
2117
+ version: 1.1.0
2118
+ threads: 16
2119
+ train_datasets:
2120
+ physical:
2121
+ batch_size: 1
2122
+ samples:
2123
+ - name: maia_edm_ttbar_pf
2124
+ splits:
2125
+ - '10'
2126
+ version: 1.1.0
2127
+ val_freq: 10000
2128
+ validation_datasets:
2129
+ physical:
2130
+ batch_size: 1
2131
+ samples:
2132
+ - name: maia_edm_ttbar_pf
2133
+ splits:
2134
+ - '10'
2135
+ version: 1.1.0
2136
+ productions:
2137
+ cld:
2138
+ comment: CLD production with Key4Hep
2139
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2140
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2141
+ memory:
2142
+ gen: 4000
2143
+ post: 2000
2144
+ tfds: 16000
2145
+ model: pyg-cld-v1
2146
+ postprocessing:
2147
+ args: {}
2148
+ script: mlpf/data/key4hep/postprocessing.py
2149
+ samples:
2150
+ gun_e_10gev:
2151
+ events_per_job: 100
2152
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2153
+ process_name: gun_e_10gev
2154
+ seed_range:
2155
+ - 424242
2156
+ - 424342
2157
+ gun_mu_10gev:
2158
+ events_per_job: 100
2159
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2160
+ process_name: gun_mu_10gev
2161
+ seed_range:
2162
+ - 600000
2163
+ - 600100
2164
+ gun_pi_10gev:
2165
+ events_per_job: 100
2166
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2167
+ process_name: gun_pi_10gev
2168
+ seed_range:
2169
+ - 700000
2170
+ - 700100
2171
+ qq:
2172
+ events_per_job: 100
2173
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2174
+ process_name: p8_ee_qq_ecm365
2175
+ seed_range:
2176
+ - 500000
2177
+ - 510010
2178
+ ttbar:
2179
+ events_per_job: 100
2180
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2181
+ process_name: p8_ee_ttbar_ecm365
2182
+ seed_range:
2183
+ - 300000
2184
+ - 310010
2185
+ ww_fullhad:
2186
+ events_per_job: 100
2187
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2188
+ process_name: p8_ee_WW_fullhad_ecm365
2189
+ seed_range:
2190
+ - 400000
2191
+ - 410010
2192
+ z_qq:
2193
+ events_per_job: 100
2194
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2195
+ process_name: p8_ee_Z_qq_ecm91
2196
+ seed_range:
2197
+ - 600000
2198
+ - 610010
2199
+ z_tautau:
2200
+ events_per_job: 100
2201
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2202
+ process_name: p8_ee_Z_tautau_ecm91
2203
+ seed_range:
2204
+ - 700000
2205
+ - 710010
2206
+ zh_tautau_240:
2207
+ events_per_job: 100
2208
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2209
+ process_name: p8_ee_ZH_Htautau_ecm240
2210
+ seed_range:
2211
+ - 200000
2212
+ - 200110
2213
+ zh_tautau_365:
2214
+ events_per_job: 100
2215
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2216
+ process_name: p8_ee_ZH_Htautau_ecm365
2217
+ seed_range:
2218
+ - 200000
2219
+ - 200110
2220
+ zz:
2221
+ events_per_job: 100
2222
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2223
+ process_name: p8_ee_ZZ_ecm365
2224
+ seed_range:
2225
+ - 100000
2226
+ - 105010
2227
+ zz_tautau_240:
2228
+ events_per_job: 100
2229
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2230
+ process_name: p8_ee_ZZ_tautau_ecm240
2231
+ seed_range:
2232
+ - 100000
2233
+ - 100110
2234
+ zz_tautau_365:
2235
+ events_per_job: 100
2236
+ gen_script: mlpf/data/key4hep/gen/cld/run_sim.sh
2237
+ process_name: p8_ee_ZZ_tautau_ecm365
2238
+ seed_range:
2239
+ - 100000
2240
+ - 110010
2241
+ slurm_partition: main
2242
+ slurm_runtime: 48h
2243
+ tfds_hit_mapping:
2244
+ qq:
2245
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/qq
2246
+ config_ids:
2247
+ - 1
2248
+ - 2
2249
+ - 3
2250
+ - 4
2251
+ - 5
2252
+ - 6
2253
+ - 7
2254
+ - 8
2255
+ - 9
2256
+ - 10
2257
+ version: 3.2.2
2258
+ ttbar:
2259
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2260
+ config_ids:
2261
+ - 1
2262
+ - 2
2263
+ - 3
2264
+ - 4
2265
+ - 5
2266
+ - 6
2267
+ - 7
2268
+ - 8
2269
+ - 9
2270
+ - 10
2271
+ version: 3.2.2
2272
+ ww_fullhad:
2273
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ww_fullhad
2274
+ config_ids:
2275
+ - 1
2276
+ - 2
2277
+ - 3
2278
+ - 4
2279
+ - 5
2280
+ - 6
2281
+ - 7
2282
+ - 8
2283
+ - 9
2284
+ - 10
2285
+ version: 3.2.2
2286
+ zz:
2287
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/zz
2288
+ config_ids:
2289
+ - 1
2290
+ - 2
2291
+ - 3
2292
+ - 4
2293
+ - 5
2294
+ - 6
2295
+ - 7
2296
+ - 8
2297
+ - 9
2298
+ - 10
2299
+ version: 3.2.2
2300
+ tfds_mapping:
2301
+ qq:
2302
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/qq
2303
+ config_ids:
2304
+ - 1
2305
+ - 2
2306
+ - 3
2307
+ - 4
2308
+ - 5
2309
+ - 6
2310
+ - 7
2311
+ - 8
2312
+ - 9
2313
+ - 10
2314
+ version: 3.3.0
2315
+ ttbar:
2316
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2317
+ config_ids:
2318
+ - 1
2319
+ - 2
2320
+ - 3
2321
+ - 4
2322
+ - 5
2323
+ - 6
2324
+ - 7
2325
+ - 8
2326
+ - 9
2327
+ - 10
2328
+ version: 3.3.0
2329
+ ww_fullhad:
2330
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ww_fullhad
2331
+ config_ids:
2332
+ - 1
2333
+ - 2
2334
+ - 3
2335
+ - 4
2336
+ - 5
2337
+ - 6
2338
+ - 7
2339
+ - 8
2340
+ - 9
2341
+ - 10
2342
+ version: 3.3.0
2343
+ zz:
2344
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/zz
2345
+ config_ids:
2346
+ - 1
2347
+ - 2
2348
+ - 3
2349
+ - 4
2350
+ - 5
2351
+ - 6
2352
+ - 7
2353
+ - 8
2354
+ - 9
2355
+ - 10
2356
+ version: 3.3.0
2357
+ type: key4hep
2358
+ workspace_dir: ${project.paths.storage_root}/cld/v1.2.5_key4hep_2025-05-29
2359
+ cld_clic_colliderml:
2360
+ comment: Joint CLD+CLIC+ColliderML pu0 tracks/clusters
2361
+ model: pyg-cldcliccolliderml-v1
2362
+ source_productions:
2363
+ cld: cld
2364
+ clic: clic
2365
+ colliderml: colliderml
2366
+ type: key4hep
2367
+ cld_ecal_pitch_1p5:
2368
+ cms_energy: 91
2369
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 1.5 mm
2370
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_1p5mm/CLD_o2_v07.xml
2371
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2372
+ dataset_only: true
2373
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2374
+ memory: &id019
2375
+ gen: 8000
2376
+ post: 8000
2377
+ tfds: 8000
2378
+ model: pyg-cld-v1
2379
+ postprocessing: &id020
2380
+ args: {}
2381
+ script: mlpf/data/key4hep/postprocessing.py
2382
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2383
+ samples: &id021
2384
+ z_tautau:
2385
+ events_per_job: 100
2386
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2387
+ process_name: p8_ee_Z_tautau_ecm91
2388
+ seed_range:
2389
+ - 700000
2390
+ - 700100
2391
+ slurm_partition: main
2392
+ slurm_runtime: 48h
2393
+ tfds_hit_mapping: &id022
2394
+ z_tautau:
2395
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/z_tautau
2396
+ config_ids:
2397
+ - 1
2398
+ - 2
2399
+ - 3
2400
+ - 4
2401
+ - 5
2402
+ - 6
2403
+ - 7
2404
+ - 8
2405
+ - 9
2406
+ - 10
2407
+ version: 3.2.2
2408
+ tfds_mapping: &id023
2409
+ z_tautau:
2410
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/z_tautau
2411
+ config_ids:
2412
+ - 1
2413
+ - 2
2414
+ - 3
2415
+ - 4
2416
+ - 5
2417
+ - 6
2418
+ - 7
2419
+ - 8
2420
+ - 9
2421
+ - 10
2422
+ version: 3.3.0
2423
+ type: key4hep
2424
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_1p5mm
2425
+ cld_ecal_pitch_2:
2426
+ cms_energy: 91
2427
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2 mm
2428
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2mm/CLD_o2_v07.xml
2429
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2430
+ dataset_only: true
2431
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2432
+ memory: *id019
2433
+ model: pyg-cld-v1
2434
+ postprocessing: *id020
2435
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2436
+ samples: *id021
2437
+ slurm_partition: main
2438
+ slurm_runtime: 48h
2439
+ tfds_hit_mapping: *id022
2440
+ tfds_mapping: *id023
2441
+ type: key4hep
2442
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2mm
2443
+ cld_ecal_pitch_2p5:
2444
+ cms_energy: 91
2445
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 2.5 mm
2446
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_2p5mm/CLD_o2_v07.xml
2447
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2448
+ dataset_only: true
2449
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2450
+ memory: *id019
2451
+ model: pyg-cld-v1
2452
+ postprocessing: *id020
2453
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2454
+ samples: *id021
2455
+ slurm_partition: main
2456
+ slurm_runtime: 48h
2457
+ tfds_hit_mapping: *id022
2458
+ tfds_mapping: *id023
2459
+ type: key4hep
2460
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_2p5mm
2461
+ cld_ecal_pitch_3:
2462
+ cms_energy: 91
2463
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 3 mm
2464
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_3mm/CLD_o2_v07.xml
2465
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2466
+ dataset_only: true
2467
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2468
+ memory: *id019
2469
+ model: pyg-cld-v1
2470
+ postprocessing: *id020
2471
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2472
+ samples: *id021
2473
+ slurm_partition: main
2474
+ slurm_runtime: 48h
2475
+ tfds_hit_mapping: *id022
2476
+ tfds_mapping: *id023
2477
+ type: key4hep
2478
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_3mm
2479
+ cld_ecal_pitch_4:
2480
+ cms_energy: 91
2481
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 4 mm
2482
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_4mm/CLD_o2_v07.xml
2483
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2484
+ dataset_only: true
2485
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2486
+ memory: *id019
2487
+ model: pyg-cld-v1
2488
+ postprocessing: *id020
2489
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2490
+ samples: *id021
2491
+ slurm_partition: main
2492
+ slurm_runtime: 48h
2493
+ tfds_hit_mapping: *id022
2494
+ tfds_mapping: *id023
2495
+ type: key4hep
2496
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_4mm
2497
+ cld_ecal_pitch_5p1:
2498
+ cms_energy: 91
2499
+ comment: CLD ECAL pitch scan, Z->tautau at 91 GeV, 5.1 mm
2500
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/ecal_5p1mm/CLD_o2_v07.xml
2501
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2502
+ dataset_only: true
2503
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2504
+ memory: *id019
2505
+ model: pyg-cld-v1
2506
+ postprocessing: *id020
2507
+ pythia_card: ${project.paths.project_root}/scripts/cld_ecal_readout/cards/p8_ee_Z_tautau_ecm91_scan.cmd
2508
+ samples: *id021
2509
+ slurm_partition: main
2510
+ slurm_runtime: 48h
2511
+ tfds_hit_mapping: *id022
2512
+ tfds_mapping: *id023
2513
+ type: key4hep
2514
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/ecal_5p1mm
2515
+ cld_hcal_pitch_10:
2516
+ cms_energy: 365
2517
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 10 mm
2518
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_10mm/CLD_o2_v07.xml
2519
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2520
+ dataset_only: true
2521
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2522
+ memory: &id024
2523
+ gen: 12000
2524
+ post: 16000
2525
+ tfds: 16000
2526
+ model: pyg-cld-v1
2527
+ postprocessing: &id025
2528
+ args: {}
2529
+ script: mlpf/data/key4hep/postprocessing.py
2530
+ samples: &id026
2531
+ ttbar:
2532
+ events_per_job: 100
2533
+ gen_script: scripts/cld_ecal_readout/run_sim.sh
2534
+ process_name: p8_ee_ttbar_ecm365
2535
+ seed_range:
2536
+ - 300000
2537
+ - 300100
2538
+ slurm_partition: main
2539
+ slurm_runtime: 48h
2540
+ tfds_hit_mapping: &id027
2541
+ ttbar:
2542
+ builder_path: mlpf/heptfds/cld_pf_edm4hep_hits/ttbar
2543
+ config_ids:
2544
+ - 1
2545
+ - 2
2546
+ - 3
2547
+ - 4
2548
+ - 5
2549
+ - 6
2550
+ - 7
2551
+ - 8
2552
+ - 9
2553
+ - 10
2554
+ version: 3.2.2
2555
+ tfds_mapping: &id028
2556
+ ttbar:
2557
+ builder_path: mlpf/heptfds/cld_pf_edm4hep/ttbar
2558
+ config_ids:
2559
+ - 1
2560
+ - 2
2561
+ - 3
2562
+ - 4
2563
+ - 5
2564
+ - 6
2565
+ - 7
2566
+ - 8
2567
+ - 9
2568
+ - 10
2569
+ version: 3.3.0
2570
+ type: key4hep
2571
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_10mm
2572
+ cld_hcal_pitch_12:
2573
+ cms_energy: 365
2574
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 12 mm
2575
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_12mm/CLD_o2_v07.xml
2576
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2577
+ dataset_only: true
2578
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2579
+ memory: *id024
2580
+ model: pyg-cld-v1
2581
+ postprocessing: *id025
2582
+ samples: *id026
2583
+ slurm_partition: main
2584
+ slurm_runtime: 48h
2585
+ tfds_hit_mapping: *id027
2586
+ tfds_mapping: *id028
2587
+ type: key4hep
2588
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_12mm
2589
+ cld_hcal_pitch_15:
2590
+ cms_energy: 365
2591
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 15 mm
2592
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_15mm/CLD_o2_v07.xml
2593
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2594
+ dataset_only: true
2595
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2596
+ memory: *id024
2597
+ model: pyg-cld-v1
2598
+ postprocessing: *id025
2599
+ samples: *id026
2600
+ slurm_partition: main
2601
+ slurm_runtime: 48h
2602
+ tfds_hit_mapping: *id027
2603
+ tfds_mapping: *id028
2604
+ type: key4hep
2605
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_15mm
2606
+ cld_hcal_pitch_20:
2607
+ cms_energy: 365
2608
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 20 mm
2609
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_20mm/CLD_o2_v07.xml
2610
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2611
+ dataset_only: true
2612
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2613
+ memory: *id024
2614
+ model: pyg-cld-v1
2615
+ postprocessing: *id025
2616
+ samples: *id026
2617
+ slurm_partition: main
2618
+ slurm_runtime: 48h
2619
+ tfds_hit_mapping: *id027
2620
+ tfds_mapping: *id028
2621
+ type: key4hep
2622
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_20mm
2623
+ cld_hcal_pitch_25:
2624
+ cms_energy: 365
2625
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 25 mm
2626
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_25mm/CLD_o2_v07.xml
2627
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2628
+ dataset_only: true
2629
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2630
+ memory: *id024
2631
+ model: pyg-cld-v1
2632
+ postprocessing: *id025
2633
+ samples: *id026
2634
+ slurm_partition: main
2635
+ slurm_runtime: 48h
2636
+ tfds_hit_mapping: *id027
2637
+ tfds_mapping: *id028
2638
+ type: key4hep
2639
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_25mm
2640
+ cld_hcal_pitch_30:
2641
+ cms_energy: 365
2642
+ comment: CLD HCAL pitch scan, ttbar at 365 GeV, 30 mm
2643
+ compact_file: ${project.paths.project_root}/mlpf/data/key4hep/geometry/granularity_scan/hcal_30mm/CLD_o2_v07.xml
2644
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/cld/CLDConfig
2645
+ dataset_only: true
2646
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2647
+ memory: *id024
2648
+ model: pyg-cld-v1
2649
+ postprocessing: *id025
2650
+ samples: *id026
2651
+ slurm_partition: main
2652
+ slurm_runtime: 48h
2653
+ tfds_hit_mapping: *id027
2654
+ tfds_mapping: *id028
2655
+ type: key4hep
2656
+ workspace_dir: ${project.paths.storage_root}/cld/granularity_scan_2025-05-29/hcal_30mm
2657
+ clic:
2658
+ comment: CLIC production with Key4Hep
2659
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/clic
2660
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
2661
+ memory:
2662
+ gen: 4000
2663
+ post: 2000
2664
+ tfds: 16000
2665
+ model: pyg-clic-v1
2666
+ postprocessing:
2667
+ args: {}
2668
+ script: mlpf/data/key4hep/postprocessing.py
2669
+ samples:
2670
+ qq:
2671
+ events_per_job: 100
2672
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2673
+ process_name: p8_ee_qq_ecm380
2674
+ seed_range:
2675
+ - 500000
2676
+ - 510010
2677
+ ttbar:
2678
+ events_per_job: 100
2679
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2680
+ process_name: p8_ee_ttbar_ecm380
2681
+ seed_range:
2682
+ - 300000
2683
+ - 310010
2684
+ ww_fullhad:
2685
+ events_per_job: 100
2686
+ gen_script: mlpf/data/key4hep/gen/clic/run_sim.sh
2687
+ process_name: p8_ee_WW_fullhad_ecm380
2688
+ seed_range:
2689
+ - 400000
2690
+ - 410010
2691
+ slurm_partition: main
2692
+ slurm_runtime: 48h
2693
+ tfds_hit_mapping:
2694
+ qq:
2695
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/qq
2696
+ config_ids:
2697
+ - 1
2698
+ - 2
2699
+ - 3
2700
+ - 4
2701
+ - 5
2702
+ - 6
2703
+ - 7
2704
+ - 8
2705
+ - 9
2706
+ - 10
2707
+ version: 3.2.2
2708
+ ttbar:
2709
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ttbar
2710
+ config_ids:
2711
+ - 1
2712
+ - 2
2713
+ - 3
2714
+ - 4
2715
+ - 5
2716
+ - 6
2717
+ - 7
2718
+ - 8
2719
+ - 9
2720
+ - 10
2721
+ version: 3.2.2
2722
+ ww_fullhad:
2723
+ builder_path: mlpf/heptfds/clic_pf_edm4hep_hits/ww_fullhad
2724
+ config_ids:
2725
+ - 1
2726
+ - 2
2727
+ - 3
2728
+ - 4
2729
+ - 5
2730
+ - 6
2731
+ - 7
2732
+ - 8
2733
+ - 9
2734
+ - 10
2735
+ version: 3.2.2
2736
+ tfds_mapping:
2737
+ qq:
2738
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/qq
2739
+ config_ids:
2740
+ - 1
2741
+ - 2
2742
+ - 3
2743
+ - 4
2744
+ - 5
2745
+ - 6
2746
+ - 7
2747
+ - 8
2748
+ - 9
2749
+ - 10
2750
+ version: 3.3.0
2751
+ ttbar:
2752
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ttbar
2753
+ config_ids:
2754
+ - 1
2755
+ - 2
2756
+ - 3
2757
+ - 4
2758
+ - 5
2759
+ - 6
2760
+ - 7
2761
+ - 8
2762
+ - 9
2763
+ - 10
2764
+ version: 3.3.0
2765
+ ww_fullhad:
2766
+ builder_path: mlpf/heptfds/clic_pf_edm4hep/ww_fullhad
2767
+ config_ids:
2768
+ - 1
2769
+ - 2
2770
+ - 3
2771
+ - 4
2772
+ - 5
2773
+ - 6
2774
+ - 7
2775
+ - 8
2776
+ - 9
2777
+ - 10
2778
+ version: 3.3.0
2779
+ type: key4hep
2780
+ workspace_dir: ${project.paths.storage_root}/clic/v1.2.5_key4hep_2025-05-29
2781
+ cms_run3:
2782
+ comment: Main production with CMSSW_15_0_5
2783
+ config_dir: ${project.paths.project_root}
2784
+ environment:
2785
+ cmssw_dir: ${project.cmssw_dir}
2786
+ cmssw_release: CMSSW_15_0_5
2787
+ scram_arch: el8_amd64_gcc12
2788
+ gen_container: /cvmfs/singularity.opensciencegrid.org/cmssw/cms:rhel8-x86_64
2789
+ memory:
2790
+ gen: 6000
2791
+ post: 4000
2792
+ tfds: 16000
2793
+ train: 16000
2794
+ val: 8000
2795
+ model: pyg-cms-v1
2796
+ postprocessing:
2797
+ args:
2798
+ num_events: -1
2799
+ save_full_graph: false
2800
+ script: mlpf/data/cms/postprocessing2.py
2801
+ samples:
2802
+ qcd_nopu:
2803
+ events_per_job: 100
2804
+ gen_script: mlpf/data/cms/genjob_pu.sh
2805
+ output_subdir: nopu
2806
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2807
+ pu_type: nopu
2808
+ seed_range:
2809
+ - 1000000
2810
+ - 1010010
2811
+ qcd_pu:
2812
+ events_per_job: 100
2813
+ gen_script: mlpf/data/cms/genjob_pu.sh
2814
+ output_subdir: pu55to75
2815
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2816
+ pu_type: pu55to75
2817
+ seed_range:
2818
+ - 300000
2819
+ - 310010
2820
+ qcd_val:
2821
+ copy_step2: true
2822
+ events_per_job: 100
2823
+ gen_script: mlpf/data/cms/genjob_pu.sh
2824
+ output_subdir: pu55to75_val
2825
+ process_name: QCDForPF_13p6TeV_TuneCUETP8M1_cfi
2826
+ pu_type: pu55to75
2827
+ seed_range:
2828
+ - 400000
2829
+ - 401010
2830
+ ttbar_nopu:
2831
+ events_per_job: 100
2832
+ gen_script: mlpf/data/cms/genjob_pu.sh
2833
+ output_subdir: nopu
2834
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2835
+ pu_type: nopu
2836
+ seed_range:
2837
+ - 800000
2838
+ - 810010
2839
+ ttbar_pu:
2840
+ events_per_job: 50
2841
+ gen_script: mlpf/data/cms/genjob_pu.sh
2842
+ output_subdir: pu55to75
2843
+ process_name: TTbar_13p6TeV_TuneCUETP8M1_cfi
2844
+ pu_type: pu55to75
2845
+ seed_range:
2846
+ - 100000
2847
+ - 110010
2848
+ ztt_nopu:
2849
+ events_per_job: 100
2850
+ gen_script: mlpf/data/cms/genjob_pu.sh
2851
+ output_subdir: nopu
2852
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2853
+ pu_type: nopu
2854
+ seed_range:
2855
+ - 1100000
2856
+ - 1110010
2857
+ ztt_pu:
2858
+ events_per_job: 100
2859
+ gen_script: mlpf/data/cms/genjob_pu.sh
2860
+ output_subdir: pu55to75
2861
+ process_name: ZTT_All_hadronic_13p6TeV_TuneCUETP8M1_cfi
2862
+ pu_type: pu55to75
2863
+ seed_range:
2864
+ - 200000
2865
+ - 210010
2866
+ slurm_partition: ${project.cpu_partition}
2867
+ slurm_runtime: 48h
2868
+ tfds_mapping:
2869
+ qcd_nopu:
2870
+ builder_path: mlpf/heptfds/cms_pf/qcd_nopu
2871
+ config_ids:
2872
+ - 1
2873
+ - 2
2874
+ - 3
2875
+ - 4
2876
+ - 5
2877
+ - 6
2878
+ - 7
2879
+ - 8
2880
+ - 9
2881
+ - 10
2882
+ version: 3.2.0
2883
+ qcd_pu:
2884
+ builder_path: mlpf/heptfds/cms_pf/qcd
2885
+ config_ids:
2886
+ - 1
2887
+ - 2
2888
+ - 3
2889
+ - 4
2890
+ - 5
2891
+ - 6
2892
+ - 7
2893
+ - 8
2894
+ - 9
2895
+ - 10
2896
+ version: 3.2.0
2897
+ ttbar_nopu:
2898
+ builder_path: mlpf/heptfds/cms_pf/ttbar_nopu
2899
+ config_ids:
2900
+ - 1
2901
+ - 2
2902
+ - 3
2903
+ - 4
2904
+ - 5
2905
+ - 6
2906
+ - 7
2907
+ - 8
2908
+ - 9
2909
+ - 10
2910
+ version: 3.2.0
2911
+ ttbar_pu:
2912
+ builder_path: mlpf/heptfds/cms_pf/ttbar
2913
+ config_ids:
2914
+ - 1
2915
+ - 2
2916
+ - 3
2917
+ - 4
2918
+ - 5
2919
+ - 6
2920
+ - 7
2921
+ - 8
2922
+ - 9
2923
+ - 10
2924
+ version: 3.2.0
2925
+ ztt_nopu:
2926
+ builder_path: mlpf/heptfds/cms_pf/ztt_nopu
2927
+ config_ids:
2928
+ - 1
2929
+ - 2
2930
+ - 3
2931
+ - 4
2932
+ - 5
2933
+ - 6
2934
+ - 7
2935
+ - 8
2936
+ - 9
2937
+ - 10
2938
+ version: 3.2.0
2939
+ ztt_pu:
2940
+ builder_path: mlpf/heptfds/cms_pf/ztt
2941
+ config_ids:
2942
+ - 1
2943
+ - 2
2944
+ - 3
2945
+ - 4
2946
+ - 5
2947
+ - 6
2948
+ - 7
2949
+ - 8
2950
+ - 9
2951
+ - 10
2952
+ version: 3.2.0
2953
+ type: cms
2954
+ validation:
2955
+ job_types:
2956
+ - pf
2957
+ - mlpf
2958
+ threads: 8
2959
+ use_cuda: false
2960
+ validation_data:
2961
+ job_types:
2962
+ - pf
2963
+ - mlpf
2964
+ samples:
2965
+ jetmet0:
2966
+ input_filelist: data/cms/run3/${project.site_name}/jetmet0.txt
2967
+ output_subdir: Run2024C
2968
+ seed_range:
2969
+ - 1
2970
+ - 100
2971
+ threads: 8
2972
+ use_cuda: false
2973
+ workspace_dir: ${project.paths.storage_root}/cms/20260204_cmssw_15_0_5_117d32
2974
+ colliderml:
2975
+ comment: ColliderML Release 1 ttbar (no pileup), clustered view (tracks + our
2976
+ spatial clusters)
2977
+ download_root: /mnt/ceph/users/ewulff/data/colliderml/CERN__ColliderML-Release-1
2978
+ memory:
2979
+ post: 32000
2980
+ tfds: 32000
2981
+ postprocessing:
2982
+ args: {}
2983
+ script: mlpf/data/colliderml/postprocessing.py
2984
+ samples:
2985
+ ttbar_pu0:
2986
+ source_dir: ${productions.colliderml.download_root}
2987
+ ttbar_pu200:
2988
+ source_dir: ${productions.colliderml.download_root}
2989
+ source_revision: 64c3d2f112df3d5d20979d22da7cfdff13e10c4b
2990
+ tfds_hit_mapping:
2991
+ ttbar_pu0:
2992
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar
2993
+ config_ids:
2994
+ - 1
2995
+ - 2
2996
+ - 3
2997
+ - 4
2998
+ - 5
2999
+ - 6
3000
+ - 7
3001
+ - 8
3002
+ - 9
3003
+ - 10
3004
+ version: 1.3.0
3005
+ ttbar_pu200:
3006
+ builder_path: mlpf/heptfds/colliderml_hits/ttbar_pu200
3007
+ config_ids:
3008
+ - 1
3009
+ - 2
3010
+ - 3
3011
+ - 4
3012
+ - 5
3013
+ - 6
3014
+ - 7
3015
+ - 8
3016
+ - 9
3017
+ - 10
3018
+ version: 1.3.0
3019
+ tfds_mapping:
3020
+ ttbar_pu0:
3021
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar
3022
+ config_ids:
3023
+ - 1
3024
+ - 2
3025
+ - 3
3026
+ - 4
3027
+ - 5
3028
+ - 6
3029
+ - 7
3030
+ - 8
3031
+ - 9
3032
+ - 10
3033
+ version: 1.5.0
3034
+ ttbar_pu200:
3035
+ builder_path: mlpf/heptfds/colliderml_pf/ttbar_pu200
3036
+ config_ids:
3037
+ - 1
3038
+ - 2
3039
+ - 3
3040
+ - 4
3041
+ - 5
3042
+ - 6
3043
+ - 7
3044
+ - 8
3045
+ - 9
3046
+ - 10
3047
+ version: 1.5.0
3048
+ type: colliderml
3049
+ workspace_dir: ${productions.colliderml.workspace_root}/v1_release1_64c3d2f1
3050
+ workspace_root: /mnt/ceph/users/ewulff/mlpf/colliderml
3051
+ idea:
3052
+ comment: IDEA_o1_v03 pipeline validation with truth-seeded proxy tracks
3053
+ config_dir: ${project.paths.project_root}/mlpf/data/key4hep/gen/idea
3054
+ environment:
3055
+ progress_interval: 60
3056
+ gen_container: /cvmfs/unpacked.cern.ch/gitlab-registry.cern.ch/key4hep/k4-deploy/alma9:latest
3057
+ memory:
3058
+ gen: 16000
3059
+ post: 4000
3060
+ tfds: 8000
3061
+ model: pyg-idea-pipeline-v1
3062
+ postprocessing:
3063
+ args: {}
3064
+ script: mlpf/data/key4hep/postprocessing.py
3065
+ samples:
3066
+ gun_e_10gev:
3067
+ events_per_job: 100
3068
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3069
+ process_name: gun_e_10gev
3070
+ seed_range:
3071
+ - 424242
3072
+ - 424342
3073
+ gun_mu_10gev:
3074
+ events_per_job: 100
3075
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3076
+ process_name: gun_mu_10gev
3077
+ seed_range:
3078
+ - 600000
3079
+ - 600100
3080
+ gun_pi_10gev:
3081
+ events_per_job: 100
3082
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3083
+ process_name: gun_pi_10gev
3084
+ seed_range:
3085
+ - 700000
3086
+ - 700100
3087
+ qq:
3088
+ events_per_job: 100
3089
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3090
+ process_name: p8_ee_qq_ecm365
3091
+ seed_range:
3092
+ - 500000
3093
+ - 500100
3094
+ ttbar:
3095
+ events_per_job: 100
3096
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3097
+ process_name: p8_ee_ttbar_ecm365
3098
+ seed_range:
3099
+ - 300000
3100
+ - 300100
3101
+ ww_fullhad:
3102
+ events_per_job: 100
3103
+ gen_script: mlpf/data/key4hep/gen/idea/run_sim.sh
3104
+ process_name: p8_ee_WW_fullhad_ecm365
3105
+ seed_range:
3106
+ - 400000
3107
+ - 400100
3108
+ slurm_partition: main
3109
+ slurm_runtime: 48h
3110
+ tfds_mapping:
3111
+ qq:
3112
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/qq
3113
+ config_ids:
3114
+ - 1
3115
+ version: 0.2.1
3116
+ ttbar:
3117
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ttbar
3118
+ config_ids:
3119
+ - 1
3120
+ version: 0.2.1
3121
+ ww_fullhad:
3122
+ builder_path: mlpf/heptfds/idea_pf_edm4hep/ww_fullhad
3123
+ config_ids:
3124
+ - 1
3125
+ version: 0.2.1
3126
+ type: key4hep
3127
+ workspace_dir: ${project.paths.storage_root}/idea/IDEA_o1_v03_fccconfig_a05a3a9
3128
+ maia:
3129
+ comment: Local MAIA ttbar EDM4hep validation sample
3130
+ config_dir: ${project.paths.project_root}
3131
+ model: pyg-maia-v1
3132
+ type: maia
3133
+ workspace_dir: ${project.paths.project_root}/local_test_data/maia_smoke
3134
+ project:
3135
+ bind_mounts: &id029
3136
+ - /local
3137
+ - /cvmfs
3138
+ - /scratch/local
3139
+ - /scratch/persistent
3140
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3141
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3142
+ cpu_partition: main
3143
+ description: Machine Learning for Particle Flow Reconstruction
3144
+ executor: slurm
3145
+ gpu_partition: gpu
3146
+ name: particleflow
3147
+ paths: &id030
3148
+ project_root: /home/joosep/particleflow
3149
+ scratch_root: /scratch/local/joosep
3150
+ storage_root: /local/joosep/mlpf
3151
+ tmpdir: /scratch/local/joosep/tmp
3152
+ site_name: tallinn
3153
+ sites:
3154
+ local:
3155
+ bind_mounts:
3156
+ - /tmp
3157
+ - /mnt/work
3158
+ cmssw_dir: /home/joosep/particleflow/CMSSW_15_0_5
3159
+ container: https://jpata.web.cern.ch/jpata/particleflow-29042026-de861d.sif
3160
+ cpu_partition: local
3161
+ executor: local
3162
+ gpu_partition: local
3163
+ paths:
3164
+ project_root: /home/joosep/particleflow
3165
+ scratch_root: /tmp/particleflow
3166
+ storage_root: /mnt/work/mlpf/
3167
+ tmpdir: /tmp/particleflow/tmp
3168
+ site_name: local
3169
+ lxplus:
3170
+ bind_mounts:
3171
+ - /afs
3172
+ - /cvmfs
3173
+ - /eos/user/j/jpata
3174
+ - /etc/pki/ca-trust
3175
+ - /etc/tnsnames.ora
3176
+ - /run
3177
+ cmssw_dir: /cvmfs/cms.cern.ch
3178
+ container: /eos/user/j/jpata/www/particleflow-20260330-cd2f54.sif
3179
+ cpu_partition: tomorrow
3180
+ executor: condor
3181
+ gpu_partition: tomorrow
3182
+ paths:
3183
+ project_root: /afs/cern.ch/work/j/jpata/particleflow
3184
+ scratch_root: /tmp
3185
+ storage_root: /eos/user/j/jpata/mlpf
3186
+ tmpdir: /tmp
3187
+ site_name: lxplus
3188
+ tallinn:
3189
+ bind_mounts: *id029
3190
+ cmssw_dir: /scratch/persistent/joosep/CMSSW_15_0_5
3191
+ container: /scratch/persistent/joosep/singularity/particleflow-29042026-de861d.sif
3192
+ cpu_partition: main
3193
+ executor: slurm
3194
+ gpu_partition: gpu
3195
+ paths: *id030
3196
+ site_name: tallinn
3197
+ slurm_account: hepusers
3198
+ slurm_account: hepusers
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_eta.pdf ADDED
Binary file (22 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_eta.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt.pdf ADDED
Binary file (21.1 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.pdf ADDED
Binary file (21.6 kB). View file
 
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_pt_log.png ADDED
fm/v3.2.0+c6879962/pf_fm_experts/cld_hcal_15mm_seed12345_20261114_053319_103794/plots_step_80000/cld_edm_ttbar_pf/jet_res.pdf ADDED
Binary file (25.1 kB). View file