PEScn commited on
Commit
4083a79
·
verified ·
1 Parent(s): a421fc4

Document retained mixU source-family exposure for S1MB

Browse files
Files changed (2) hide show
  1. SHA256SUMS +1 -0
  2. TRAINING_SOURCES.json +1622 -0
SHA256SUMS CHANGED
@@ -4,6 +4,7 @@ e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 FIXED
4
  50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32 LICENSE
5
  ab25a1399625bdaa46d8cd31bf805f4a56e7a3254af7ef1f1e94a02bcf6a1a1c README.md
6
  b5bd4c94126b15f6c158c75909b0361f8019e05c7d7e6c76a8d81d8b64933615 README.zh.md
 
7
  a4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715 chat_template.jinja
8
  d0883072e01861ed0b2d47be3c16c36a8e81c224c7ffaa310c6558fb3f932b05 config.json
9
  2d4464e2ead06bc9bc718c781309ad1e7baded626d66e8dcdc8b469ba185faf0 configuration.json
 
4
  50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32 LICENSE
5
  ab25a1399625bdaa46d8cd31bf805f4a56e7a3254af7ef1f1e94a02bcf6a1a1c README.md
6
  b5bd4c94126b15f6c158c75909b0361f8019e05c7d7e6c76a8d81d8b64933615 README.zh.md
7
+ a210ce25dadbcc9a920e486c832f78c27f9ab6102a89010be4f657ec18679a48 TRAINING_SOURCES.json
8
  a4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715 chat_template.jinja
9
  d0883072e01861ed0b2d47be3c16c36a8e81c224c7ffaa310c6558fb3f932b05 config.json
10
  2d4464e2ead06bc9bc718c781309ad1e7baded626d66e8dcdc8b469ba185faf0 configuration.json
TRAINING_SOURCES.json ADDED
@@ -0,0 +1,1622 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "PelaAI/KnowLine-9B-Gen1",
3
+ "weight_revision": "a421fc438cebe28e95de6951bc8bc440119db969",
4
+ "training_rows": 1143656,
5
+ "training_sha256": "9e01ff4882d28fdc350b08ebb7b70b5cb26e79c6d4d6438a43d7bdbb589ce7cd",
6
+ "parts": {
7
+ "or1d": 873134,
8
+ "Kf_unseen": 241781,
9
+ "additional_injection": 16824,
10
+ "paired_convention_pilots": 11917
11
+ },
12
+ "inherited_source_declaration": "https://huggingface.co/PelaAI/KnowLine-31B-Gen1/blob/986803e4037f7778d24623184729a31202e3d302/README.md",
13
+ "basis": "Retained mixU channel counts checked against prior source-family declarations; this is not a new record-level overlap audit. No prior models overlap counts reused. Source revisions and any undeclared families remain unknown. Pretraining exposure is unknown.",
14
+ "training_data_public": false,
15
+ "channels": {
16
+ "gapo_gsm_tmpl": 38000,
17
+ "gapb_sata_more": 26906,
18
+ "gapb_hard_nli_35b": 17666,
19
+ "gapb_absa_quad": 17501,
20
+ "r_mmlu_aux": 28793,
21
+ "gapb_clinical_nli": 14899,
22
+ "gapo_severity": 14630,
23
+ "cand_agent_gui": 14569,
24
+ "gapo_answer_resp": 14157,
25
+ "gapb_ragtruth_more": 13793,
26
+ "r_medmcqa": 17150,
27
+ "k_winogrande": 15679,
28
+ "gapo_gsm_var": 8303,
29
+ "r_aqua": 14183,
30
+ "gapb_clinical_tmpl": 7855,
31
+ "gapo_bbh_geometric_shapes": 7000,
32
+ "gapo_bbh_logical_deduction": 7000,
33
+ "fix7_chess_lichess": 7000,
34
+ "cand_router_hazard": 5500,
35
+ "cand_router_safety": 5500,
36
+ "cand_router_pii": 5499,
37
+ "openjevdata_commonsense_context": 10221,
38
+ "cand_router_tool_need": 5493,
39
+ "cand_router_hallucination": 5490,
40
+ "k_acos": 9428,
41
+ "openjevdata_knowledge_qa": 9510,
42
+ "cand_rules_threshold": 5000,
43
+ "cand_rules_pointer": 5000,
44
+ "cand_rules_compound": 5000,
45
+ "cand_rules_form": 5000,
46
+ "cand_rules_membership": 5000,
47
+ "cand_rules_presence": 5000,
48
+ "cand_rules_contains": 5000,
49
+ "cand_rules_precedence": 5000,
50
+ "cand_rules_boolean": 5000,
51
+ "cand_rules_select": 5000,
52
+ "openjevdata_deductive_reasoning": 9314,
53
+ "t_pol3_equiphours": 4937,
54
+ "fix7_toolret_apisguru": 4783,
55
+ "cand_router_jailbreak": 4668,
56
+ "gapo_bbh_web_of_lies": 4500,
57
+ "gapo_bbh_navigate": 4500,
58
+ "gapo_bbh_formal_fallacies": 4500,
59
+ "gapo_bbh_table": 4500,
60
+ "gapo_bbh_date": 4500,
61
+ "k_gsm8k": 7309,
62
+ "synth_workflow_docs@v1": 7314,
63
+ "gapo_bbh_bool": 4000,
64
+ "fix7_wino_knowref": 4000,
65
+ "r_sciq": 6811,
66
+ "r_logiqa": 6811,
67
+ "z_humicroedit": 6816,
68
+ "kd_synth_workflow_docs@v1": 3817,
69
+ "kd_synth_policy_exception@v1": 3765,
70
+ "z_cfcolor": 6760,
71
+ "fix7_w2c_gen": 3501,
72
+ "nd2_social_needs": 3354,
73
+ "nd2_critical_path": 3300,
74
+ "nd2_colregs": 3300,
75
+ "nd2_crop_diagnosis": 3300,
76
+ "nd2_volunteer_match": 3300,
77
+ "nd2_wildlife_sign": 3300,
78
+ "nd2_insurance_coverage": 3300,
79
+ "nd2_order_dialogue_state": 3300,
80
+ "nd2_soil_texture": 3300,
81
+ "nd2_manifest_anomaly": 3300,
82
+ "nd2_museum_dating": 3300,
83
+ "nd2_sports_officiating": 3300,
84
+ "nd2_supply_attribution": 3300,
85
+ "nd2_recipe_tags": 3300,
86
+ "nd2_hs_section": 3300,
87
+ "nd2_league_standings": 3300,
88
+ "nd2_ad_compliance": 3300,
89
+ "nd2_machine_failure": 3300,
90
+ "nd2_meter_anomaly": 3300,
91
+ "nd2_nova_group": 3300,
92
+ "nd2_metar_flight_category": 3300,
93
+ "nd2_math_misconception": 3300,
94
+ "nd2_reconciliation": 3300,
95
+ "nd2_cuisine": 3300,
96
+ "nd2_listing_consistency": 3300,
97
+ "nd2_nutrition_claims": 3300,
98
+ "nd2_shelter_outcome": 3300,
99
+ "nd2_plan_select": 3300,
100
+ "nd2_job_seniority": 3300,
101
+ "nd2_nutriscore": 3300,
102
+ "nd2_house_price_pair": 3300,
103
+ "nd2_ntsb_occurrence": 3300,
104
+ "nd2_storm_event_type": 3300,
105
+ "nd2_stellar_class": 3300,
106
+ "nd2_telecom_rca": 3300,
107
+ "nd2_electrical_fault": 3300,
108
+ "nd2_zoning_check": 3300,
109
+ "nd2_incoterms": 3300,
110
+ "nd2_mtg_color": 3300,
111
+ "nd2_revenue_attribution": 3300,
112
+ "nd2_beer_style": 3300,
113
+ "nd2_telecom_standards": 3300,
114
+ "nd2_ab_test": 3300,
115
+ "nd2_worldbank_sector": 3299,
116
+ "nd2_readability_pair": 3298,
117
+ "nd2_aqi": 3297,
118
+ "nd2_mrb_disposition": 3249,
119
+ "z_bpomp": 5591,
120
+ "esci_v2": 5626,
121
+ "nd2_museum_department": 3160,
122
+ "nd2_monster_cr": 3109,
123
+ "fix7_wino_twins": 3038,
124
+ "kd_synth_record_requirements@v1": 2962,
125
+ "openjevdata_probabilistic_reasoning": 5036,
126
+ "synth_record_requirements@v1": 4643,
127
+ "digap_home": 4273,
128
+ "synth_quantitative@v1": 4420,
129
+ "cand_agent_tool": 2306,
130
+ "fix7_toolret_hermes": 2282,
131
+ "kd_kn_cmb": 2094,
132
+ "z_sata": 3608,
133
+ "k_winogrande_fmt": 2834,
134
+ "kd_kn_medmcqa": 2060,
135
+ "kd_g_cail": 2059,
136
+ "kd_kn_race": 2027,
137
+ "kd_g_lcqmc": 2027,
138
+ "gapo_bbh_colored_objects": 2000,
139
+ "gapo_bbh_arith": 2000,
140
+ "kd_g_clinc": 1999,
141
+ "cand_agent_swe": 1988,
142
+ "kd_g_ocnli": 1960,
143
+ "oj11_replay": 2187,
144
+ "t_time_billing": 1796,
145
+ "hf_g_clinc": 2941,
146
+ "oj11_community": 1944,
147
+ "t_tab_count_exec": 1692,
148
+ "synth_policy_exception@v1": 3344,
149
+ "kd_mj_news_huffpost": 1676,
150
+ "kd_g_kuake_qtr": 1675,
151
+ "hf_g_ocnli": 2826,
152
+ "kd_code_contests": 1620,
153
+ "fix7_finentity_contrast": 1611,
154
+ "fix7_apibank_args": 1527,
155
+ "z_toolret": 2665,
156
+ "gapo_bbh_object_counting": 1500,
157
+ "gapo_bbh_word_sorting": 1500,
158
+ "gapo_bbh_dyck": 1500,
159
+ "gapo_bbh_hyperbaton": 1500,
160
+ "kd_g_anli": 1493,
161
+ "z_bright": 2501,
162
+ "fix7_w2c_hermes": 1370,
163
+ "kd_kn_cmmlu": 1363,
164
+ "digap_pop909real": 2394,
165
+ "digap_chess": 2332,
166
+ "h_crux": 2306,
167
+ "h_anli_nli": 2322,
168
+ "digap_pop909": 2314,
169
+ "kd_g_yelp": 1314,
170
+ "k_acos_fmt": 1714,
171
+ "t_tab_count_claim": 1296,
172
+ "kd_kn_cflue": 1294,
173
+ "kd_g_qbqtc": 1293,
174
+ "digap_cladder": 2155,
175
+ "kd_gen_mnli_train": 1271,
176
+ "kd_gen_snli": 1267,
177
+ "kd_fix_cfever_claim": 1248,
178
+ "kd_g_yahoo": 1247,
179
+ "fix7_apibank_next": 1240,
180
+ "kd_synth_deductive@v1": 1236,
181
+ "kd_kn_medqa": 1235,
182
+ "kd_g_cofacts": 1233,
183
+ "kd_synth_quantitative@v1": 1230,
184
+ "kd_gen_code_docstring": 1226,
185
+ "kd_gen_fever": 1226,
186
+ "kd_synth_evidence_validation@v1": 1226,
187
+ "kd_g_chinesesafe": 1225,
188
+ "kd_gen_squad2": 1223,
189
+ "kd_kn_cosmosqa": 1221,
190
+ "kd_gen_glaive_tool_choice": 1219,
191
+ "kd_kn_medqa_zh": 1213,
192
+ "kd_d_amz_zh": 1206,
193
+ "gapo_bbh_temporal": 1200,
194
+ "kd_kn_sciq": 1192,
195
+ "openjevdata_intent_routing": 2242,
196
+ "kd_g_liar2": 1181,
197
+ "kd_gen_helpsteer3": 1181,
198
+ "kd_kn_aqua": 1178,
199
+ "kd_mj_intent_contrast": 1175,
200
+ "hf_g_anli": 2107,
201
+ "j_tool_hardsel": 2042,
202
+ "kd_gen_goemotions": 1164,
203
+ "openjevdata_quantitative_reasoning": 2201,
204
+ "kd_kn_piqa": 1151,
205
+ "kd_kn_logiqa_zh": 1131,
206
+ "kd_cuad": 1112,
207
+ "kd_gen_civil_more": 1103,
208
+ "t_pol3_library": 1100,
209
+ "kd_kn_logiqa_en": 1097,
210
+ "t_pol3_carrental": 1096,
211
+ "kd_d_mtop": 1077,
212
+ "hf_nd_climate_disclosure": 1077,
213
+ "inj2_synth_policy_exception@v1": 1500,
214
+ "hf_nd_situation_emotion": 1060,
215
+ "kd_kn_art": 1057,
216
+ "hf_nd_causal_choice": 1052,
217
+ "kd_di_isarcasm": 1051,
218
+ "hf_nd_zh_idiom_cloze": 1048,
219
+ "kd_g_offenseval": 1047,
220
+ "hf_nd_issue_type": 1046,
221
+ "hf_nd_moral_action": 1042,
222
+ "kd_kn_qasc": 1035,
223
+ "h_isarcasm": 1808,
224
+ "kd_d_se_topic": 1028,
225
+ "hf_nd_employer_review": 1019,
226
+ "hf_nd_wine_review": 1012,
227
+ "hf_nd_action_judgment": 1009,
228
+ "hf_nd_table_fact": 1008,
229
+ "kd_di_when2call": 1008,
230
+ "kd_di_hover": 1004,
231
+ "hf_nd_dialogue_emotion": 1001,
232
+ "hf_nd_dialogue_act": 1001,
233
+ "hf_g_yahoo": 1737,
234
+ "hf_nd_zh_shopping_review": 991,
235
+ "inj2_synth_quantitative@v1": 1400,
236
+ "cand_agent_research": 986,
237
+ "kd_d_mclwic_en": 985,
238
+ "fix7_musr_fault": 983,
239
+ "kd_di_esci": 974,
240
+ "kd_gen_cfever": 971,
241
+ "hf_nd_zh_poem_match": 967,
242
+ "kd_di_sgd": 961,
243
+ "kd_gen_dureader_yesno": 958,
244
+ "cand_agent_tau": 935,
245
+ "h_phish_construct": 1671,
246
+ "kd_kn_boolq": 931,
247
+ "openjevdata_multi_hop": 1810,
248
+ "kof_oracle_v3_paraphrase": 1523,
249
+ "kof_oracle_v3": 1543,
250
+ "z_humicroedit_fmt": 1276,
251
+ "hf_d_se_topic": 1499,
252
+ "kd_gen_shp": 883,
253
+ "kof_hist_v3": 1527,
254
+ "hf_nd_clothing_review": 861,
255
+ "hf_g_tmmluplus": 1466,
256
+ "kd_fix_fever_claim": 858,
257
+ "kd_gen_webgpt": 855,
258
+ "hf_nd_airline_tweet": 852,
259
+ "hf_nd_code_comment": 852,
260
+ "hf_nd_pubhealth_claim": 851,
261
+ "kd_gen_chip_sts": 850,
262
+ "kd_gen_hatexplain": 850,
263
+ "hf_di_banking77": 1462,
264
+ "fix7_finentity_news": 846,
265
+ "hf_nd_ade_report": 843,
266
+ "hf_nd_idiom_usage": 842,
267
+ "hf_nd_covid_misinfo": 841,
268
+ "hf_nd_drug_review_rating": 839,
269
+ "hf_nd_chemprot_relation": 837,
270
+ "hf_nd_sdg_topic": 835,
271
+ "kd_synth_score_rubric@v1": 834,
272
+ "kd_gen_iflytek": 833,
273
+ "kd_gen_qqp_train": 832,
274
+ "kd_gen_toxigen": 831,
275
+ "hf_d_mtop": 1433,
276
+ "kd_gen_aegis_prompt": 826,
277
+ "kd_gen_thucnews": 825,
278
+ "hf_g_wic": 1447,
279
+ "hf_i_tw_exam": 1428,
280
+ "hf_nd_answer_grading": 823,
281
+ "z_cfcolor_fmt": 1139,
282
+ "kd_d_xnli_zh": 822,
283
+ "arena_oracle_v3_paraphrase": 1395,
284
+ "kd_gen_devign": 821,
285
+ "hf_nd_paper_field": 821,
286
+ "hf_g_cail": 1440,
287
+ "hf_di_vast": 1457,
288
+ "arena_hist_v3": 1388,
289
+ "hf_nd_ddi_relation": 813,
290
+ "kd_kn_proofwriter": 812,
291
+ "hf_nd_drug_review_condition": 808,
292
+ "hf_nd_hate_offensive": 808,
293
+ "hf_nd_metaphor_word": 804,
294
+ "hf_g_lcqmc": 1348,
295
+ "hf_nd_rct_sentence_role": 803,
296
+ "hf_g_sst5": 1434,
297
+ "kd_kn_dream": 800,
298
+ "hf_nd_med_abstract_topic": 799,
299
+ "hf_di_hellaswag": 1405,
300
+ "z_toolret_x": 1417,
301
+ "openjevdata_answer_preference": 1465,
302
+ "hf_nd_patent_section": 776,
303
+ "arena_oracle_v3": 1360,
304
+ "z_finentity": 1371,
305
+ "kd_gen_glaive_call_needed": 762,
306
+ "kd_g_beavertails": 761,
307
+ "k_gsm8k_fmt": 1027,
308
+ "hf_di_when2call": 1308,
309
+ "hf_di_hover": 1297,
310
+ "hf_nd_math_difficulty": 728,
311
+ "hf_di_contractnli": 1340,
312
+ "h_sgd": 1290,
313
+ "hf_nd_math_subject": 711,
314
+ "inj2_k_acos": 900,
315
+ "z_bpomp_fmt": 905,
316
+ "openjevdata_reading_comprehension": 1287,
317
+ "hf_d_xnli_zh": 1186,
318
+ "digap_habermas": 1178,
319
+ "kd_gen_tweet_sentiment": 675,
320
+ "fix7_toolret_glaive": 670,
321
+ "hf_g_kuake_qtr": 1154,
322
+ "kd_aes2": 657,
323
+ "kd_gen_tweet_hate": 656,
324
+ "blackjack": 1104,
325
+ "kd_jigsaw_severity": 651,
326
+ "kd_asap_sas": 647,
327
+ "hf_nd_tab_bank_marketing": 645,
328
+ "kd_amazon": 641,
329
+ "hf_di_arc": 1103,
330
+ "kd_d_cdial_bias": 639,
331
+ "hf_di_newyorker": 1113,
332
+ "kd_di_phish_url": 636,
333
+ "web_element": 1054,
334
+ "fix7_musr_ledger": 629,
335
+ "kd_gen_app_reviews": 628,
336
+ "kd_mj_scitail": 624,
337
+ "hf_nd_stress_post": 624,
338
+ "kd_cmexam": 619,
339
+ "hf_di_commonsenseqa": 1089,
340
+ "inj2_z_toolret": 900,
341
+ "kd_mhs": 617,
342
+ "kd_di_phish_email": 616,
343
+ "kd_gen_amazon_polarity": 615,
344
+ "hf_mj_news_huffpost": 1087,
345
+ "chess_move": 1033,
346
+ "fix7_musr_trip": 612,
347
+ "kd_mj_scicite": 612,
348
+ "kd_gen_nlpcc14_sc": 612,
349
+ "kd_mj_fin_topic": 611,
350
+ "kd_mj_argq_stance": 610,
351
+ "kd_mj_tab_adult": 609,
352
+ "hf_i_drcd_choice": 1038,
353
+ "kd_mj_wdc_match": 607,
354
+ "kd_d_xlwic_zh": 605,
355
+ "fix7_musr_alibi": 603,
356
+ "chess_theme": 1016,
357
+ "kd_gen_swsr": 602,
358
+ "arcade_2048": 1037,
359
+ "kd_d_amz_en": 596,
360
+ "kd_helpsteer": 596,
361
+ "kd_gen_climate_fever": 594,
362
+ "inj2_k_gsm8k": 781,
363
+ "kd_gen_imdb": 592,
364
+ "kd_d_bq_dev": 589,
365
+ "synth_deductive@v1": 1142,
366
+ "arcade_sudoku": 1052,
367
+ "kd_gen_healthver": 587,
368
+ "kd_patent": 587,
369
+ "kd_arena140k": 585,
370
+ "kd_gen_chnsenticorp": 581,
371
+ "kd_d_lingnli": 578,
372
+ "kd_mnli": 575,
373
+ "fix7_musr_ballot": 571,
374
+ "synth_evidence_validation@v1": 1162,
375
+ "kd_clone": 569,
376
+ "arcade_dino": 993,
377
+ "hf_kn_cmmlu": 950,
378
+ "inj2_z_bpomp": 700,
379
+ "kd_di_enron_spam": 556,
380
+ "kd_gen_snips": 553,
381
+ "kd_mj_humaid": 553,
382
+ "toolace": 894,
383
+ "hf_kn_medmcqa": 966,
384
+ "hf_kn_cmb": 940,
385
+ "hf_g_qbqtc": 885,
386
+ "openjevdata_option_logic": 989,
387
+ "kd_d_prosocial": 528,
388
+ "fix7_musr_author": 525,
389
+ "h_apibank": 880,
390
+ "hf_g_liar2": 874,
391
+ "openjevdata_temporal_numeric": 1151,
392
+ "hf_kn_race": 896,
393
+ "hf_d_amz_zh": 890,
394
+ "kd_gen_chip_ctc": 510,
395
+ "hf_i_drcd_sentence": 882,
396
+ "kd_d_sohu": 506,
397
+ "kd_mj_tab_churn": 504,
398
+ "kd_fakenews_zh": 502,
399
+ "kd_d_diasafety": 502,
400
+ "hf_g_cofacts": 893,
401
+ "inj3_synth_policy_exception@v1": 700,
402
+ "inj2_z_bright": 697,
403
+ "kd_mj_clickbait": 493,
404
+ "kd_afqmc": 491,
405
+ "hf_g_offenseval": 866,
406
+ "kd_d_casehold": 490,
407
+ "kd_cold": 489,
408
+ "hf_nd_counterfactual_review": 488,
409
+ "hf_g_chinesesafe": 832,
410
+ "kd_d_atec": 485,
411
+ "kd_dbpedia": 484,
412
+ "kd_d_ledgar": 484,
413
+ "h_phish_url": 867,
414
+ "hf_d_lingnli": 832,
415
+ "hf_di_bfcl_w2c": 863,
416
+ "hf_g_yelp": 899,
417
+ "hf_di_openbookqa": 801,
418
+ "hf_di_commonsenseqa_fmt": 602,
419
+ "h_oj11_wanli_bal": 837,
420
+ "kd_d_risawoz": 469,
421
+ "hf_fix_cfever_claim": 855,
422
+ "kd_bq": 465,
423
+ "z_sata_fmt": 625,
424
+ "hf_g_beavertails": 803,
425
+ "arcade_flappy": 861,
426
+ "chess_harness_rich": 773,
427
+ "hf_di_phish_email": 822,
428
+ "hf_kn_medqa": 806,
429
+ "kd_d_scotus": 442,
430
+ "hf_g_kuake_qic": 712,
431
+ "hf_gen_fever": 769,
432
+ "hf_gen_mnli_train": 739,
433
+ "hf_gen_snli": 750,
434
+ "kd_di_bfcl_w2c": 436,
435
+ "hf_kn_aqua": 732,
436
+ "hf_kn_logiqa_zh": 751,
437
+ "h_anli_nli_fmt": 693,
438
+ "chess_harness_ascii": 756,
439
+ "web_op": 756,
440
+ "hf_d_casehold": 691,
441
+ "hf_i_rt_critics": 727,
442
+ "chess_harness_fen": 678,
443
+ "hf_d_mclwic_en": 734,
444
+ "hf_kn_sciq": 744,
445
+ "hf_kn_medqa_zh": 751,
446
+ "kd_d_newsgroups_test": 416,
447
+ "kd_gen_tweet_emotion": 415,
448
+ "kd_sick": 415,
449
+ "kd_kn_ruletaker": 415,
450
+ "shell_exit": 730,
451
+ "hf_j_ops_itsm": 696,
452
+ "patch_resolves": 701,
453
+ "hf_kn_mmlu_aux": 666,
454
+ "hf_d_ledgar": 686,
455
+ "kd_qqp": 406,
456
+ "openjevdata_evidence_validation": 808,
457
+ "hf_gen_chip_ctc": 664,
458
+ "hf_kn_cosmosqa": 725,
459
+ "synth_score_rubric@v1": 821,
460
+ "typed_customer_service": 659,
461
+ "hf_gen_civil_more": 688,
462
+ "hf_kn_cflue": 706,
463
+ "kd_socialiqa": 398,
464
+ "hf_i_amazon_cn": 710,
465
+ "hf_di_arc_fmt": 540,
466
+ "kd_civil_comments": 393,
467
+ "kd_tripadvisor": 391,
468
+ "typed_agent_trace_observability": 703,
469
+ "hf_gen_cfever": 664,
470
+ "inj2_z_finentity": 500,
471
+ "hf_gen_goemotions": 675,
472
+ "hf_kn_gaokao": 655,
473
+ "hf_kn_qasc": 643,
474
+ "hf_kn_piqa": 712,
475
+ "typed_invoice_processing": 663,
476
+ "kd_cefr": 374,
477
+ "hf_gen_dureader_yesno": 643,
478
+ "hf_i_semeval_tweet": 570,
479
+ "hf_gen_helpsteer3": 668,
480
+ "hf_gen_nlpcc_stance": 627,
481
+ "typed_security_incidents": 652,
482
+ "hf_gen_iflytek": 601,
483
+ "hf_kn_logiqa_en": 609,
484
+ "hf_gen_hatexplain": 633,
485
+ "kd_d_ecthr": 348,
486
+ "hf_code_contests": 616,
487
+ "kd_mj_medqpairs": 345,
488
+ "hf_j_aftersales_cfpb_route": 609,
489
+ "hf_kn_art": 623,
490
+ "hf_j_aftersales_abcd_action": 586,
491
+ "hf_gen_tweet_stance": 604,
492
+ "hf_gen_healthver": 587,
493
+ "hf_d_risawoz": 563,
494
+ "inj3_synth_quantitative@v1": 500,
495
+ "hf_gen_code_docstring": 548,
496
+ "hf_gen_thucnews": 564,
497
+ "hf_kn_dream": 613,
498
+ "kd_d_atis": 336,
499
+ "kd_formality": 335,
500
+ "hf_kn_proofwriter": 593,
501
+ "kd_cola": 331,
502
+ "hf_d_newsgroups_test": 549,
503
+ "kd_newsgroups": 328,
504
+ "kd_humicroedit": 327,
505
+ "hf_d_scotus": 576,
506
+ "hf_kn_quail": 578,
507
+ "hf_gen_shp": 573,
508
+ "hf_arena140k": 510,
509
+ "hf_nd_fake_job_post": 325,
510
+ "hf_gen_webgpt": 593,
511
+ "openjevdata_constraint_planning": 628,
512
+ "h_crux_fmt": 416,
513
+ "hf_fix_fever_claim": 586,
514
+ "kd_d_afqmc_dev": 318,
515
+ "hf_di_nli4ct": 544,
516
+ "hf_j_aftersales_abcd_case": 580,
517
+ "hf_j_agentsafe_tab": 580,
518
+ "kd_gen_averitec": 310,
519
+ "inj2_h_crux": 400,
520
+ "openjevdata_code_database": 566,
521
+ "kd_g_sst5": 308,
522
+ "hf_j_aftersales_bitext": 512,
523
+ "hf_di_openbookqa_fmt": 403,
524
+ "openjevdata_emotion_recognition": 506,
525
+ "hf_gen_toxigen": 500,
526
+ "hf_cuad": 509,
527
+ "inj2_openjevdata_deductive_reasoning": 414,
528
+ "hf_gen_squad2": 527,
529
+ "hf_j_aftersales_cfpb_outcome": 554,
530
+ "openjevdata_policy_exception": 781,
531
+ "hf_gen_tweet_sentiment": 510,
532
+ "hf_d_prosocial": 509,
533
+ "hf_jigsaw_severity": 486,
534
+ "hf_mnli": 513,
535
+ "kd_kn_cflue_tf": 284,
536
+ "hf_kn_strategyqa": 467,
537
+ "kd_multirc": 283,
538
+ "hf_gen_climate_fever": 495,
539
+ "hf_gen_averitec": 512,
540
+ "hf_d_amz_en": 470,
541
+ "hf_d_bq_dev": 454,
542
+ "hf_gen_snips": 461,
543
+ "hf_dbpedia": 460,
544
+ "hf_mj_fin_topic": 445,
545
+ "inj2_openjevdata_commonsense_context": 379,
546
+ "kd_gen_tweet_irony": 265,
547
+ "hf_mj_tab_churn": 444,
548
+ "inj2_openjevdata_knowledge_qa": 378,
549
+ "synth_musr@v1": 264,
550
+ "hf_j_ops_statuspage": 442,
551
+ "hf_d_cdial_bias": 467,
552
+ "hf_cmexam": 477,
553
+ "inj2_synth_evidence_validation@v1": 350,
554
+ "kd_d_unfair_tos": 259,
555
+ "hf_gen_glaive_tool_choice": 437,
556
+ "hf_mj_tab_adult": 450,
557
+ "kd_quest": 255,
558
+ "hf_j_agentsafe_llmail": 447,
559
+ "hf_d_atis": 451,
560
+ "hf_mj_humaid": 417,
561
+ "hf_mj_argq_stance": 459,
562
+ "hf_kn_boolq": 473,
563
+ "hf_kn_jecqa": 413,
564
+ "hf_mj_scitail": 443,
565
+ "hf_jigsaw_rules": 401,
566
+ "hf_mj_medqpairs": 447,
567
+ "hf_folio": 411,
568
+ "hf_d_toxicchat": 437,
569
+ "h_sgd_fmt": 376,
570
+ "inj2_synth_score_rubric@v1": 350,
571
+ "kd_phrasebank": 242,
572
+ "hf_j_ops_bgl": 413,
573
+ "hf_gen_swsr": 418,
574
+ "hf_mhs": 403,
575
+ "hf_d_mclwic_zh": 434,
576
+ "inj2_synth_deductive@v1": 349,
577
+ "hf_ellipse": 413,
578
+ "hf_d_xlwic_zh": 428,
579
+ "hf_mj_argq_pair": 424,
580
+ "hf_sick": 423,
581
+ "kd_ellipse": 237,
582
+ "hf_gen_chip_sts": 397,
583
+ "hf_quest": 376,
584
+ "hf_gen_app_reviews": 369,
585
+ "hf_gen_amazon_polarity": 362,
586
+ "hf_asap_sas": 381,
587
+ "openjevdata_score_quality": 401,
588
+ "hf_gen_qqp_train": 411,
589
+ "hf_mj_scicite": 417,
590
+ "hf_gen_devign": 398,
591
+ "hf_kn_pubmedqa": 412,
592
+ "blackjack_count": 391,
593
+ "inj2_h_apibank": 300,
594
+ "inj3_k_acos": 300,
595
+ "hf_mj_wdc_match": 431,
596
+ "hf_fakenews_zh": 426,
597
+ "hf_gen_glaive_call_needed": 415,
598
+ "hf_civil_comments": 408,
599
+ "hf_d_ecthr": 406,
600
+ "hf_helpsteer": 371,
601
+ "hf_afqmc": 349,
602
+ "hf_gen_tweet_emotion": 409,
603
+ "hf_gen_chnsenticorp": 392,
604
+ "hf_clone": 363,
605
+ "hf_socialiqa": 402,
606
+ "h_isarcasm_fmt": 419,
607
+ "hf_j_aftersales_multidogo": 360,
608
+ "hf_aes2": 352,
609
+ "hf_d_afqmc_dev": 363,
610
+ "inj3_z_toolret": 300,
611
+ "inj2_hf_di_bfcl_w2c": 282,
612
+ "hf_j_agentsafe_jb_wild": 322,
613
+ "inj3_hf_mj_news_huffpost": 300,
614
+ "hf_di_ragtruth": 381,
615
+ "hf_gen_imdb": 363,
616
+ "hf_d_sohu": 334,
617
+ "hf_gen_nlpcc14_sc": 370,
618
+ "hf_patent": 366,
619
+ "hf_gen_tweet_hate": 353,
620
+ "inj3_openjevdata_commonsense_context": 300,
621
+ "hf_newsgroups": 367,
622
+ "hf_kn_cflue_tf": 366,
623
+ "hf_gen_tweet_irony": 357,
624
+ "hf_amazon": 351,
625
+ "h_phish_construct_fmt": 355,
626
+ "inj3_openjevdata_knowledge_qa": 292,
627
+ "hf_formality": 354,
628
+ "inj3_k_gsm8k": 266,
629
+ "hf_cefr": 341,
630
+ "hf_humicroedit": 339,
631
+ "hf_gen_fiqa_sentiment": 349,
632
+ "hf_mj_tab_wine": 321,
633
+ "kd_gen_nlpcc_stance": 190,
634
+ "hf_mj_clickbait": 353,
635
+ "z_finentity_fmt": 221,
636
+ "hf_d_diasafety": 339,
637
+ "hf_phrasebank": 320,
638
+ "hf_j_ops_synth_tickets": 326,
639
+ "inj2_h_sgd": 281,
640
+ "inj3_z_bpomp": 250,
641
+ "hf_di_when2call_fmt": 323,
642
+ "hf_tripadvisor": 307,
643
+ "hf_qqp": 294,
644
+ "hf_di_hellaswag_fmt": 240,
645
+ "inj3_openjevdata_deductive_reasoning": 258,
646
+ "hf_d_atec": 333,
647
+ "hf_d_moderation": 299,
648
+ "hf_di_hover_fmt": 316,
649
+ "hf_kn_ruletaker": 276,
650
+ "hf_mj_news_bbc": 302,
651
+ "inj3_hf_di_hover": 213,
652
+ "hf_di_contractnli_fmt": 225,
653
+ "hf_di_vast_fmt": 229,
654
+ "hf_kn_eeval": 283,
655
+ "hf_j_ops_hdfs": 276,
656
+ "hf_bq": 292,
657
+ "inj2_z_cfcolor": 200,
658
+ "inj3_z_finentity": 200,
659
+ "hf_di_newyorker_fmt": 218,
660
+ "inj3_hf_di_contractnli": 191,
661
+ "hf_j_agentsafe_pi_gandalf": 241,
662
+ "hf_d_unfair_tos": 281,
663
+ "kd_di_newyorker": 145,
664
+ "hf_j_agentsafe_creddata": 271,
665
+ "kd_gen_tweet_stance": 143,
666
+ "inj3_synth_evidence_validation@v1": 200,
667
+ "kd_di_contractnli": 139,
668
+ "hf_d_dna_response": 229,
669
+ "hf_gen_scifact": 246,
670
+ "inj3_synth_score_rubric@v1": 200,
671
+ "inj3_synth_deductive@v1": 198,
672
+ "hf_cola": 224,
673
+ "hf_kn_m3ke": 191,
674
+ "hf_di_phish_email_fmt": 184,
675
+ "h_apibank_fmt": 132,
676
+ "h_phish_url_fmt": 187,
677
+ "kd_d_mclwic_zh": 109,
678
+ "inj3_hf_mj_humaid": 150,
679
+ "hf_di_bfcl_w2c_fmt": 210,
680
+ "inj3_hf_mj_scitail": 150,
681
+ "kd_g_kuake_qic": 97,
682
+ "hf_j_agentsafe_pi_deepset": 143,
683
+ "hf_j_agentsafe_ai4privacy": 146,
684
+ "hf_di_banking77_fmt": 123,
685
+ "h_crux_input": 138,
686
+ "typed_customer_service_decisive": 129,
687
+ "hf_di_nli4ct_fmt": 96,
688
+ "inj2_openjevdata_intent_routing": 92,
689
+ "hf_j_agentsafe_jb_jackhhao": 111,
690
+ "inj2_openjevdata_temporal_numeric": 85,
691
+ "inj3_openjevdata_quantitative_reasoning": 78,
692
+ "hf_multirc": 104,
693
+ "kd_g_wic": 59,
694
+ "typed_invoice_processing_decisive": 112,
695
+ "inj3_openjevdata_intent_routing": 69,
696
+ "typed_security_incidents_decisive": 100,
697
+ "kd_mj_tab_wine": 56,
698
+ "inj2_openjevdata_evidence_validation": 63,
699
+ "inj2_openjevdata_quantitative_reasoning": 76,
700
+ "inj2_openjevdata_reading_comprehension": 58,
701
+ "openjevdata_score_rubric": 101,
702
+ "kd_kn_gaokao": 45,
703
+ "inj2_openjevdata_multi_hop": 81,
704
+ "inj3_openjevdata_temporal_numeric": 64,
705
+ "kd_kn_quail": 44,
706
+ "hf_di_ragtruth_fmt": 62,
707
+ "inj3_openjevdata_multi_hop": 57,
708
+ "inj2_openjevdata_answer_preference": 57,
709
+ "inj2_openjevdata_option_logic": 55,
710
+ "kd_kn_strategyqa": 37,
711
+ "typed_agent_trace_observability_decisive": 73,
712
+ "inj3_openjevdata_answer_preference": 39,
713
+ "inj2_openjevdata_policy_exception": 31,
714
+ "inj3_openjevdata_evidence_validation": 29,
715
+ "inj3_openjevdata_reading_comprehension": 35,
716
+ "kd_di_acos": 19,
717
+ "kd_mj_news_bbc": 19,
718
+ "inj2_openjevdata_constraint_planning": 24,
719
+ "inj3_openjevdata_option_logic": 33,
720
+ "inj3_openjevdata_policy_exception": 26,
721
+ "hf_j_ops_hadoop": 21,
722
+ "kd_kn_mmlu_aux": 14,
723
+ "openjevdata_score_intensity": 19,
724
+ "inj2_openjevdata_emotion_recognition": 22,
725
+ "inj3_openjevdata_constraint_planning": 16,
726
+ "inj3_openjevdata_code_database": 13,
727
+ "inj2_openjevdata_code_database": 15,
728
+ "inj3_openjevdata_emotion_recognition": 7,
729
+ "inj2_openjevdata_score_rubric": 7,
730
+ "inj2_openjevdata_probabilistic_reasoning": 6,
731
+ "inj3_openjevdata_score_rubric": 2,
732
+ "inj2_openjevdata_score_quality": 3,
733
+ "inj2_openjevdata_score_intensity": 1,
734
+ "inj3_openjevdata_probabilistic_reasoning": 2,
735
+ "inj3_openjevdata_score_quality": 1
736
+ },
737
+ "s1mb_source_declarations": [
738
+ {
739
+ "benchmark_id": "aqua-rat-choice-test-v1",
740
+ "relationship": "same_source_family",
741
+ "source_description": "AQuA-RAT (deepmind/aqua_rat) train split.",
742
+ "retained_support_channels": {
743
+ "r_aqua": 14183,
744
+ "kd_kn_aqua": 1178,
745
+ "hf_kn_aqua": 732
746
+ },
747
+ "support_channel_rows": 16093,
748
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
749
+ "split": "train"
750
+ },
751
+ {
752
+ "benchmark_id": "arc-choice-test-v1",
753
+ "relationship": "same_source_family",
754
+ "source_description": "ARC (allenai/ai2_arc) train split.",
755
+ "retained_support_channels": {
756
+ "hf_di_arc": 1103,
757
+ "hf_di_arc_fmt": 540
758
+ },
759
+ "support_channel_rows": 1643,
760
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
761
+ "split": "train"
762
+ },
763
+ {
764
+ "benchmark_id": "banking77-choice-test-v1",
765
+ "relationship": "same_source_family",
766
+ "source_description": "BANKING77 (PolyAI/banking77) train split.",
767
+ "retained_support_channels": {
768
+ "hf_di_banking77": 1462,
769
+ "hf_di_banking77_fmt": 123
770
+ },
771
+ "support_channel_rows": 1585,
772
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
773
+ "split": "train"
774
+ },
775
+ {
776
+ "benchmark_id": "civil-comments-noul-test-v1",
777
+ "relationship": "same_source_family",
778
+ "source_description": "Civil Comments (google/civil_comments) train split.",
779
+ "retained_support_channels": {
780
+ "kd_gen_civil_more": 1103,
781
+ "hf_gen_civil_more": 688,
782
+ "kd_civil_comments": 393,
783
+ "hf_civil_comments": 408
784
+ },
785
+ "support_channel_rows": 2592,
786
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
787
+ "split": "train"
788
+ },
789
+ {
790
+ "benchmark_id": "cladder-noul-test-v1",
791
+ "relationship": "related_domain",
792
+ "source_description": "generated CLadder-style causal questions (not drawn from the CLadder release); shared source identity with CLadder is not claimed.",
793
+ "retained_support_channels": {
794
+ "digap_cladder": 2155
795
+ },
796
+ "support_channel_rows": 2155,
797
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
798
+ "split": null
799
+ },
800
+ {
801
+ "benchmark_id": "clinc-choice-test-v1",
802
+ "relationship": "same_source_family",
803
+ "source_description": "CLINC150 (clinc_oos) train split.",
804
+ "retained_support_channels": {
805
+ "kd_g_clinc": 1999,
806
+ "hf_g_clinc": 2941
807
+ },
808
+ "support_channel_rows": 4940,
809
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
810
+ "split": "train"
811
+ },
812
+ {
813
+ "benchmark_id": "contract-nli-choice-test-v1",
814
+ "relationship": "same_source_family",
815
+ "source_description": "ContractNLI train split.",
816
+ "retained_support_channels": {
817
+ "hf_di_contractnli": 1340,
818
+ "hf_di_contractnli_fmt": 225,
819
+ "inj3_hf_di_contractnli": 191,
820
+ "kd_di_contractnli": 139
821
+ },
822
+ "support_channel_rows": 1895,
823
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
824
+ "split": "train"
825
+ },
826
+ {
827
+ "benchmark_id": "dbpedia-choice-test-v1",
828
+ "relationship": "same_source_family",
829
+ "source_description": "DBpedia-14 (fancyzhx/dbpedia_14) train split.",
830
+ "retained_support_channels": {
831
+ "kd_dbpedia": 484,
832
+ "hf_dbpedia": 460
833
+ },
834
+ "support_channel_rows": 944,
835
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
836
+ "split": "train"
837
+ },
838
+ {
839
+ "benchmark_id": "esci-choice-test-v1",
840
+ "relationship": "same_source_family",
841
+ "source_description": "Amazon ESCI train split.",
842
+ "retained_support_channels": {
843
+ "esci_v2": 5626,
844
+ "kd_di_esci": 974
845
+ },
846
+ "support_channel_rows": 6600,
847
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
848
+ "split": "train"
849
+ },
850
+ {
851
+ "benchmark_id": "go-emotions-noul-test-v1",
852
+ "relationship": "same_source_family",
853
+ "source_description": "GoEmotions (google-research-datasets/go_emotions) train split.",
854
+ "retained_support_channels": {
855
+ "kd_gen_goemotions": 1164,
856
+ "hf_gen_goemotions": 675
857
+ },
858
+ "support_channel_rows": 1839,
859
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
860
+ "split": "train"
861
+ },
862
+ {
863
+ "benchmark_id": "gsm8k-choice-test-v1",
864
+ "relationship": "same_source_family",
865
+ "source_description": "GSM8K (openai/gsm8k) train split.",
866
+ "retained_support_channels": {
867
+ "k_gsm8k": 7309,
868
+ "k_gsm8k_fmt": 1027,
869
+ "inj2_k_gsm8k": 781,
870
+ "inj3_k_gsm8k": 266
871
+ },
872
+ "support_channel_rows": 9383,
873
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
874
+ "split": "train"
875
+ },
876
+ {
877
+ "benchmark_id": "laya--typed-decisions-choice-test-v1",
878
+ "relationship": "same_source_family",
879
+ "source_description": "LocalLLaMA/typed-decisions train data (its four workflows).",
880
+ "retained_support_channels": {
881
+ "typed_customer_service": 659,
882
+ "typed_agent_trace_observability": 703,
883
+ "typed_invoice_processing": 663,
884
+ "typed_security_incidents": 652,
885
+ "typed_customer_service_decisive": 129,
886
+ "typed_invoice_processing_decisive": 112,
887
+ "typed_security_incidents_decisive": 100,
888
+ "typed_agent_trace_observability_decisive": 73
889
+ },
890
+ "support_channel_rows": 3091,
891
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
892
+ "split": "train"
893
+ },
894
+ {
895
+ "benchmark_id": "laya--typed-decisions-noul-test-v1",
896
+ "relationship": "same_source_family",
897
+ "source_description": "LocalLLaMA/typed-decisions train data (its four workflows).",
898
+ "retained_support_channels": {
899
+ "typed_customer_service": 659,
900
+ "typed_agent_trace_observability": 703,
901
+ "typed_invoice_processing": 663,
902
+ "typed_security_incidents": 652,
903
+ "typed_customer_service_decisive": 129,
904
+ "typed_invoice_processing_decisive": 112,
905
+ "typed_security_incidents_decisive": 100,
906
+ "typed_agent_trace_observability_decisive": 73
907
+ },
908
+ "support_channel_rows": 3091,
909
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
910
+ "split": "train"
911
+ },
912
+ {
913
+ "benchmark_id": "laya--typed-decisions-score-test-v1",
914
+ "relationship": "same_source_family",
915
+ "source_description": "LocalLLaMA/typed-decisions train data (its four workflows).",
916
+ "retained_support_channels": {
917
+ "typed_customer_service": 659,
918
+ "typed_agent_trace_observability": 703,
919
+ "typed_invoice_processing": 663,
920
+ "typed_security_incidents": 652,
921
+ "typed_customer_service_decisive": 129,
922
+ "typed_invoice_processing_decisive": 112,
923
+ "typed_security_incidents_decisive": 100,
924
+ "typed_agent_trace_observability_decisive": 73
925
+ },
926
+ "support_channel_rows": 3091,
927
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
928
+ "split": "train"
929
+ },
930
+ {
931
+ "benchmark_id": "mtop-choice-test-v1",
932
+ "relationship": "same_source_family",
933
+ "source_description": "MTOP (tasksource/mtop) train split.",
934
+ "retained_support_channels": {
935
+ "kd_d_mtop": 1077,
936
+ "hf_d_mtop": 1433
937
+ },
938
+ "support_channel_rows": 2510,
939
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
940
+ "split": "train"
941
+ },
942
+ {
943
+ "benchmark_id": "open-jev--amount-extraction-control-v1-choice-test-v1",
944
+ "relationship": "same_source_family",
945
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
946
+ "retained_support_channels": {
947
+ "oj11_replay": 2187,
948
+ "oj11_community": 1944
949
+ },
950
+ "support_channel_rows": 4131,
951
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
952
+ "split": "train"
953
+ },
954
+ {
955
+ "benchmark_id": "open-jev--amount-extraction-control-v1-noul-test-v1",
956
+ "relationship": "same_source_family",
957
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
958
+ "retained_support_channels": {
959
+ "oj11_replay": 2187,
960
+ "oj11_community": 1944
961
+ },
962
+ "support_channel_rows": 4131,
963
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
964
+ "split": "train"
965
+ },
966
+ {
967
+ "benchmark_id": "open-jev--browser-control-v1-choice-test-v1",
968
+ "relationship": "same_source_family",
969
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
970
+ "retained_support_channels": {
971
+ "oj11_replay": 2187,
972
+ "oj11_community": 1944
973
+ },
974
+ "support_channel_rows": 4131,
975
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
976
+ "split": "train"
977
+ },
978
+ {
979
+ "benchmark_id": "open-jev--citation-control-v1-choice-test-v1",
980
+ "relationship": "same_source_family",
981
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
982
+ "retained_support_channels": {
983
+ "oj11_replay": 2187,
984
+ "oj11_community": 1944
985
+ },
986
+ "support_channel_rows": 4131,
987
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
988
+ "split": "train"
989
+ },
990
+ {
991
+ "benchmark_id": "open-jev--context-retention-control-v1-noul-test-v1",
992
+ "relationship": "same_source_family",
993
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
994
+ "retained_support_channels": {
995
+ "oj11_replay": 2187,
996
+ "oj11_community": 1944
997
+ },
998
+ "support_channel_rows": 4131,
999
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1000
+ "split": "train"
1001
+ },
1002
+ {
1003
+ "benchmark_id": "open-jev--customer-control-v1-choice-test-v1",
1004
+ "relationship": "same_source_family",
1005
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1006
+ "retained_support_channels": {
1007
+ "oj11_replay": 2187,
1008
+ "oj11_community": 1944
1009
+ },
1010
+ "support_channel_rows": 4131,
1011
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1012
+ "split": "train"
1013
+ },
1014
+ {
1015
+ "benchmark_id": "open-jev--customer-control-v1-noul-test-v1",
1016
+ "relationship": "same_source_family",
1017
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1018
+ "retained_support_channels": {
1019
+ "oj11_replay": 2187,
1020
+ "oj11_community": 1944
1021
+ },
1022
+ "support_channel_rows": 4131,
1023
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1024
+ "split": "train"
1025
+ },
1026
+ {
1027
+ "benchmark_id": "open-jev--customer-control-v1-score-test-v1",
1028
+ "relationship": "same_source_family",
1029
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1030
+ "retained_support_channels": {
1031
+ "oj11_replay": 2187,
1032
+ "oj11_community": 1944
1033
+ },
1034
+ "support_channel_rows": 4131,
1035
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1036
+ "split": "train"
1037
+ },
1038
+ {
1039
+ "benchmark_id": "open-jev--drone-control-v1-choice-test-v1",
1040
+ "relationship": "same_source_family",
1041
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1042
+ "retained_support_channels": {
1043
+ "oj11_replay": 2187,
1044
+ "oj11_community": 1944
1045
+ },
1046
+ "support_channel_rows": 4131,
1047
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1048
+ "split": "train"
1049
+ },
1050
+ {
1051
+ "benchmark_id": "open-jev--drone-control-v1-noul-test-v1",
1052
+ "relationship": "same_source_family",
1053
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1054
+ "retained_support_channels": {
1055
+ "oj11_replay": 2187,
1056
+ "oj11_community": 1944
1057
+ },
1058
+ "support_channel_rows": 4131,
1059
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1060
+ "split": "train"
1061
+ },
1062
+ {
1063
+ "benchmark_id": "open-jev--drone-control-v1-score-test-v1",
1064
+ "relationship": "same_source_family",
1065
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1066
+ "retained_support_channels": {
1067
+ "oj11_replay": 2187,
1068
+ "oj11_community": 1944
1069
+ },
1070
+ "support_channel_rows": 4131,
1071
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1072
+ "split": "train"
1073
+ },
1074
+ {
1075
+ "benchmark_id": "open-jev--email-selection-control-v1-choice-test-v1",
1076
+ "relationship": "same_source_family",
1077
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1078
+ "retained_support_channels": {
1079
+ "oj11_replay": 2187,
1080
+ "oj11_community": 1944
1081
+ },
1082
+ "support_channel_rows": 4131,
1083
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1084
+ "split": "train"
1085
+ },
1086
+ {
1087
+ "benchmark_id": "open-jev--email-selection-control-v1-noul-test-v1",
1088
+ "relationship": "same_source_family",
1089
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1090
+ "retained_support_channels": {
1091
+ "oj11_replay": 2187,
1092
+ "oj11_community": 1944
1093
+ },
1094
+ "support_channel_rows": 4131,
1095
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1096
+ "split": "train"
1097
+ },
1098
+ {
1099
+ "benchmark_id": "open-jev--entity-alignment-control-v1-noul-test-v1",
1100
+ "relationship": "same_source_family",
1101
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1102
+ "retained_support_channels": {
1103
+ "oj11_replay": 2187,
1104
+ "oj11_community": 1944
1105
+ },
1106
+ "support_channel_rows": 4131,
1107
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1108
+ "split": "train"
1109
+ },
1110
+ {
1111
+ "benchmark_id": "open-jev--entity-alignment-control-v1-score-test-v1",
1112
+ "relationship": "same_source_family",
1113
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1114
+ "retained_support_channels": {
1115
+ "oj11_replay": 2187,
1116
+ "oj11_community": 1944
1117
+ },
1118
+ "support_channel_rows": 4131,
1119
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1120
+ "split": "train"
1121
+ },
1122
+ {
1123
+ "benchmark_id": "open-jev--ir-control-v1-choice-test-v1",
1124
+ "relationship": "same_source_family",
1125
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1126
+ "retained_support_channels": {
1127
+ "oj11_replay": 2187,
1128
+ "oj11_community": 1944
1129
+ },
1130
+ "support_channel_rows": 4131,
1131
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1132
+ "split": "train"
1133
+ },
1134
+ {
1135
+ "benchmark_id": "open-jev--ir-control-v1-noul-test-v1",
1136
+ "relationship": "same_source_family",
1137
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1138
+ "retained_support_channels": {
1139
+ "oj11_replay": 2187,
1140
+ "oj11_community": 1944
1141
+ },
1142
+ "support_channel_rows": 4131,
1143
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1144
+ "split": "train"
1145
+ },
1146
+ {
1147
+ "benchmark_id": "open-jev--ir-control-v1-score-test-v1",
1148
+ "relationship": "same_source_family",
1149
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1150
+ "retained_support_channels": {
1151
+ "oj11_replay": 2187,
1152
+ "oj11_community": 1944
1153
+ },
1154
+ "support_channel_rows": 4131,
1155
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1156
+ "split": "train"
1157
+ },
1158
+ {
1159
+ "benchmark_id": "open-jev--mailroom-control-v1-choice-test-v1",
1160
+ "relationship": "same_source_family",
1161
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1162
+ "retained_support_channels": {
1163
+ "oj11_replay": 2187,
1164
+ "oj11_community": 1944
1165
+ },
1166
+ "support_channel_rows": 4131,
1167
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1168
+ "split": "train"
1169
+ },
1170
+ {
1171
+ "benchmark_id": "open-jev--mailroom-control-v1-noul-test-v1",
1172
+ "relationship": "same_source_family",
1173
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1174
+ "retained_support_channels": {
1175
+ "oj11_replay": 2187,
1176
+ "oj11_community": 1944
1177
+ },
1178
+ "support_channel_rows": 4131,
1179
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1180
+ "split": "train"
1181
+ },
1182
+ {
1183
+ "benchmark_id": "open-jev--painting-geometry-v1-choice-test-v1",
1184
+ "relationship": "same_source_family",
1185
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1186
+ "retained_support_channels": {
1187
+ "oj11_replay": 2187,
1188
+ "oj11_community": 1944
1189
+ },
1190
+ "support_channel_rows": 4131,
1191
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1192
+ "split": "train"
1193
+ },
1194
+ {
1195
+ "benchmark_id": "open-jev--painting-geometry-v1-noul-test-v1",
1196
+ "relationship": "same_source_family",
1197
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1198
+ "retained_support_channels": {
1199
+ "oj11_replay": 2187,
1200
+ "oj11_community": 1944
1201
+ },
1202
+ "support_channel_rows": 4131,
1203
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1204
+ "split": "train"
1205
+ },
1206
+ {
1207
+ "benchmark_id": "open-jev--painting-geometry-v1-score-test-v1",
1208
+ "relationship": "same_source_family",
1209
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1210
+ "retained_support_channels": {
1211
+ "oj11_replay": 2187,
1212
+ "oj11_community": 1944
1213
+ },
1214
+ "support_channel_rows": 4131,
1215
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1216
+ "split": "train"
1217
+ },
1218
+ {
1219
+ "benchmark_id": "open-jev--phone-extraction-control-v1-choice-test-v1",
1220
+ "relationship": "same_source_family",
1221
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1222
+ "retained_support_channels": {
1223
+ "oj11_replay": 2187,
1224
+ "oj11_community": 1944
1225
+ },
1226
+ "support_channel_rows": 4131,
1227
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1228
+ "split": "train"
1229
+ },
1230
+ {
1231
+ "benchmark_id": "open-jev--phone-extraction-control-v1-noul-test-v1",
1232
+ "relationship": "same_source_family",
1233
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1234
+ "retained_support_channels": {
1235
+ "oj11_replay": 2187,
1236
+ "oj11_community": 1944
1237
+ },
1238
+ "support_channel_rows": 4131,
1239
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1240
+ "split": "train"
1241
+ },
1242
+ {
1243
+ "benchmark_id": "open-jev--reasoning-control-v1-choice-test-v1",
1244
+ "relationship": "same_source_family",
1245
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1246
+ "retained_support_channels": {
1247
+ "oj11_replay": 2187,
1248
+ "oj11_community": 1944
1249
+ },
1250
+ "support_channel_rows": 4131,
1251
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1252
+ "split": "train"
1253
+ },
1254
+ {
1255
+ "benchmark_id": "open-jev--reasoning-control-v1-noul-test-v1",
1256
+ "relationship": "same_source_family",
1257
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1258
+ "retained_support_channels": {
1259
+ "oj11_replay": 2187,
1260
+ "oj11_community": 1944
1261
+ },
1262
+ "support_channel_rows": 4131,
1263
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1264
+ "split": "train"
1265
+ },
1266
+ {
1267
+ "benchmark_id": "open-jev--reasoning-control-v1-score-test-v1",
1268
+ "relationship": "same_source_family",
1269
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1270
+ "retained_support_channels": {
1271
+ "oj11_replay": 2187,
1272
+ "oj11_community": 1944
1273
+ },
1274
+ "support_channel_rows": 4131,
1275
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1276
+ "split": "train"
1277
+ },
1278
+ {
1279
+ "benchmark_id": "open-jev--silent-failure-control-v1-noul-test-v1",
1280
+ "relationship": "same_source_family",
1281
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1282
+ "retained_support_channels": {
1283
+ "oj11_replay": 2187,
1284
+ "oj11_community": 1944
1285
+ },
1286
+ "support_channel_rows": 4131,
1287
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1288
+ "split": "train"
1289
+ },
1290
+ {
1291
+ "benchmark_id": "open-jev--snake-v1-choice-test-v1",
1292
+ "relationship": "same_source_family",
1293
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1294
+ "retained_support_channels": {
1295
+ "oj11_replay": 2187,
1296
+ "oj11_community": 1944
1297
+ },
1298
+ "support_channel_rows": 4131,
1299
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1300
+ "split": "train"
1301
+ },
1302
+ {
1303
+ "benchmark_id": "open-jev--snake-v1-noul-test-v1",
1304
+ "relationship": "same_source_family",
1305
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1306
+ "retained_support_channels": {
1307
+ "oj11_replay": 2187,
1308
+ "oj11_community": 1944
1309
+ },
1310
+ "support_channel_rows": 4131,
1311
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1312
+ "split": "train"
1313
+ },
1314
+ {
1315
+ "benchmark_id": "open-jev--sponsor-segment-control-v1-choice-test-v1",
1316
+ "relationship": "same_source_family",
1317
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1318
+ "retained_support_channels": {
1319
+ "oj11_replay": 2187,
1320
+ "oj11_community": 1944
1321
+ },
1322
+ "support_channel_rows": 4131,
1323
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1324
+ "split": "train"
1325
+ },
1326
+ {
1327
+ "benchmark_id": "open-jev--tic-tac-toe-v1-choice-test-v1",
1328
+ "relationship": "same_source_family",
1329
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1330
+ "retained_support_channels": {
1331
+ "oj11_replay": 2187,
1332
+ "oj11_community": 1944
1333
+ },
1334
+ "support_channel_rows": 4131,
1335
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1336
+ "split": "train"
1337
+ },
1338
+ {
1339
+ "benchmark_id": "open-jev--vizdoom-basic-v1-noul-test-v1",
1340
+ "relationship": "same_source_family",
1341
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1342
+ "retained_support_channels": {
1343
+ "oj11_replay": 2187,
1344
+ "oj11_community": 1944
1345
+ },
1346
+ "support_channel_rows": 4131,
1347
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1348
+ "split": "train"
1349
+ },
1350
+ {
1351
+ "benchmark_id": "open-jev--vizdoom-basic-v1-score-test-v1",
1352
+ "relationship": "same_source_family",
1353
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1354
+ "retained_support_channels": {
1355
+ "oj11_replay": 2187,
1356
+ "oj11_community": 1944
1357
+ },
1358
+ "support_channel_rows": 4131,
1359
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1360
+ "split": "train"
1361
+ },
1362
+ {
1363
+ "benchmark_id": "open-jev--workflow-controls-v1--agent-trace-observability-noul-test-v1",
1364
+ "relationship": "same_source_family",
1365
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1366
+ "retained_support_channels": {
1367
+ "oj11_replay": 2187,
1368
+ "oj11_community": 1944
1369
+ },
1370
+ "support_channel_rows": 4131,
1371
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1372
+ "split": "train"
1373
+ },
1374
+ {
1375
+ "benchmark_id": "open-jev--workflow-controls-v1--customer-service-noul-test-v1",
1376
+ "relationship": "same_source_family",
1377
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1378
+ "retained_support_channels": {
1379
+ "oj11_replay": 2187,
1380
+ "oj11_community": 1944
1381
+ },
1382
+ "support_channel_rows": 4131,
1383
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1384
+ "split": "train"
1385
+ },
1386
+ {
1387
+ "benchmark_id": "open-jev--workflow-controls-v1--invoice-processing-noul-test-v1",
1388
+ "relationship": "same_source_family",
1389
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1390
+ "retained_support_channels": {
1391
+ "oj11_replay": 2187,
1392
+ "oj11_community": 1944
1393
+ },
1394
+ "support_channel_rows": 4131,
1395
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1396
+ "split": "train"
1397
+ },
1398
+ {
1399
+ "benchmark_id": "open-jev--workflow-controls-v1--security-incidents-noul-test-v1",
1400
+ "relationship": "same_source_family",
1401
+ "source_description": "Open-Jev 1.1 training data (the Open-Jev control families).",
1402
+ "retained_support_channels": {
1403
+ "oj11_replay": 2187,
1404
+ "oj11_community": 1944
1405
+ },
1406
+ "support_channel_rows": 4131,
1407
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1408
+ "split": "train"
1409
+ },
1410
+ {
1411
+ "benchmark_id": "openbookqa-choice-test-v1",
1412
+ "relationship": "same_source_family",
1413
+ "source_description": "OpenBookQA (allenai/openbookqa) train split.",
1414
+ "retained_support_channels": {
1415
+ "hf_di_openbookqa": 801,
1416
+ "hf_di_openbookqa_fmt": 403
1417
+ },
1418
+ "support_channel_rows": 1204,
1419
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1420
+ "split": "train"
1421
+ },
1422
+ {
1423
+ "benchmark_id": "ruletaker-noul-test-v1",
1424
+ "relationship": "same_source_family",
1425
+ "source_description": "RuleTaker / ProofWriter (tasksource/ruletaker, tasksource/proofwriter) train splits.",
1426
+ "retained_support_channels": {
1427
+ "kd_kn_proofwriter": 812,
1428
+ "kd_kn_ruletaker": 415,
1429
+ "hf_kn_proofwriter": 593,
1430
+ "hf_kn_ruletaker": 276
1431
+ },
1432
+ "support_channel_rows": 2096,
1433
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1434
+ "split": "train"
1435
+ },
1436
+ {
1437
+ "benchmark_id": "sgd-choice-test-v1",
1438
+ "relationship": "same_source_family",
1439
+ "source_description": "Schema-Guided Dialogue (dstc8-schema-guided-dialogue) train split.",
1440
+ "retained_support_channels": {
1441
+ "kd_di_sgd": 961,
1442
+ "h_sgd": 1290,
1443
+ "h_sgd_fmt": 376,
1444
+ "inj2_h_sgd": 281
1445
+ },
1446
+ "support_channel_rows": 2908,
1447
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1448
+ "split": "train"
1449
+ },
1450
+ {
1451
+ "benchmark_id": "snli-choice-test-v1",
1452
+ "relationship": "same_source_family",
1453
+ "source_description": "SNLI (stanfordnlp/snli) train split.",
1454
+ "retained_support_channels": {
1455
+ "kd_gen_snli": 1267,
1456
+ "hf_gen_snli": 750
1457
+ },
1458
+ "support_channel_rows": 2017,
1459
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1460
+ "split": "train"
1461
+ },
1462
+ {
1463
+ "benchmark_id": "argument-quality-choice-test-v1",
1464
+ "relationship": "same_source_family",
1465
+ "source_description": "IBM-ArgQ-Rank-30k (ibm-research/argument_quality_ranking_30k) train split.",
1466
+ "retained_support_channels": {
1467
+ "kd_mj_argq_stance": 610,
1468
+ "hf_mj_argq_stance": 459,
1469
+ "hf_mj_argq_pair": 424
1470
+ },
1471
+ "support_channel_rows": 1493,
1472
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1473
+ "split": "train"
1474
+ },
1475
+ {
1476
+ "benchmark_id": "argument-quality-noul-test-v1",
1477
+ "relationship": "same_source_family",
1478
+ "source_description": "IBM-ArgQ-Rank-30k (ibm-research/argument_quality_ranking_30k) train split.",
1479
+ "retained_support_channels": {
1480
+ "kd_mj_argq_stance": 610,
1481
+ "hf_mj_argq_stance": 459,
1482
+ "hf_mj_argq_pair": 424
1483
+ },
1484
+ "support_channel_rows": 1493,
1485
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1486
+ "split": "train"
1487
+ },
1488
+ {
1489
+ "benchmark_id": "scicite-choice-test-v1",
1490
+ "relationship": "same_source_family",
1491
+ "source_description": "SciCite (allenai/scicite) train split.",
1492
+ "retained_support_channels": {
1493
+ "kd_mj_scicite": 612,
1494
+ "hf_mj_scicite": 417
1495
+ },
1496
+ "support_channel_rows": 1029,
1497
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1498
+ "split": "train"
1499
+ },
1500
+ {
1501
+ "benchmark_id": "scitail-noul-test-v1",
1502
+ "relationship": "same_source_family",
1503
+ "source_description": "SciTail (allenai/scitail, snli_format) train split.",
1504
+ "retained_support_channels": {
1505
+ "kd_mj_scitail": 624,
1506
+ "hf_mj_scitail": 443,
1507
+ "inj3_hf_mj_scitail": 150
1508
+ },
1509
+ "support_channel_rows": 1217,
1510
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1511
+ "split": "train"
1512
+ },
1513
+ {
1514
+ "benchmark_id": "patent-similarity-score-test-v1",
1515
+ "relationship": "same_source_family",
1516
+ "source_description": "Google patent phrase similarity train.csv (the source of tasksource/patent-phrase-similarity).",
1517
+ "retained_support_channels": {
1518
+ "kd_patent": 587,
1519
+ "hf_patent": 366
1520
+ },
1521
+ "support_channel_rows": 953,
1522
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1523
+ "split": "train"
1524
+ },
1525
+ {
1526
+ "benchmark_id": "aegis2-noul-test-v1",
1527
+ "relationship": "same_source_family",
1528
+ "source_description": "Aegis 2.0 safety/routing sources inherited through or1d. The earlier source declaration covered train and validation; retained per-split counts have not been reconstructed for mixU.",
1529
+ "retained_support_channels": {
1530
+ "cand_router_hazard": 5500,
1531
+ "cand_router_safety": 5500,
1532
+ "kd_gen_aegis_prompt": 826
1533
+ },
1534
+ "support_channel_rows": 11826,
1535
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1536
+ "split": null
1537
+ },
1538
+ {
1539
+ "benchmark_id": "laya--enron-spam-noul-test-v1",
1540
+ "relationship": "same_source_family",
1541
+ "source_description": "Enron-Spam (SetFit/enron_spam) train split.",
1542
+ "retained_support_channels": {
1543
+ "kd_di_enron_spam": 556
1544
+ },
1545
+ "support_channel_rows": 556,
1546
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1547
+ "split": "train"
1548
+ },
1549
+ {
1550
+ "benchmark_id": "hh-rlhf-choice-test-v1",
1551
+ "relationship": "same_source_family",
1552
+ "source_description": "BeaverTails (PKU-Alignment/BeaverTails 30k_train) and Aegis 2.0 train-split prompts, which reuse Anthropic HH-RLHF red-team prompts.",
1553
+ "retained_support_channels": {
1554
+ "kd_gen_aegis_prompt": 826,
1555
+ "kd_g_beavertails": 761,
1556
+ "hf_g_beavertails": 803
1557
+ },
1558
+ "support_channel_rows": 2390,
1559
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1560
+ "split": "train"
1561
+ },
1562
+ {
1563
+ "benchmark_id": "synthetic-relevance--nanocoir-noul-test-v1",
1564
+ "relationship": "related_domain",
1565
+ "source_description": "DeepMind CodeContests training problems; related code-retrieval domain only, not established CoIR source identity.",
1566
+ "retained_support_channels": {
1567
+ "kd_code_contests": 1620,
1568
+ "hf_code_contests": 616
1569
+ },
1570
+ "support_channel_rows": 2236,
1571
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1572
+ "split": null
1573
+ },
1574
+ {
1575
+ "benchmark_id": "synthetic-relevance--nanocoir-score-test-v1",
1576
+ "relationship": "related_domain",
1577
+ "source_description": "DeepMind CodeContests training problems; related code-retrieval domain only, not established CoIR source identity.",
1578
+ "retained_support_channels": {
1579
+ "kd_code_contests": 1620,
1580
+ "hf_code_contests": 616
1581
+ },
1582
+ "support_channel_rows": 2236,
1583
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1584
+ "split": null
1585
+ },
1586
+ {
1587
+ "benchmark_id": "few-nerd-choice-test-v1",
1588
+ "relationship": "same_source_family",
1589
+ "source_description": "Few-NERD supervised source sentences recast into PII-redaction routing in the inherited or1d component; exact retained upstream split membership not re-audited.",
1590
+ "retained_support_channels": {
1591
+ "cand_router_pii": 5499
1592
+ },
1593
+ "support_channel_rows": 5499,
1594
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1595
+ "split": null
1596
+ },
1597
+ {
1598
+ "benchmark_id": "gretel-pii-choice-test-v1",
1599
+ "relationship": "related_domain",
1600
+ "source_description": "yes/no PII-redaction questions built from Gretel's synthetic financial documents (gretelai/synthetic_pii_finance_multilingual), a different Gretel dataset from the gretelai/gretel-pii-masking-en-v1 data behind this benchmark; shared source identity is not claimed.",
1601
+ "retained_support_channels": {
1602
+ "cand_router_pii": 5499
1603
+ },
1604
+ "support_channel_rows": 5499,
1605
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1606
+ "split": null
1607
+ },
1608
+ {
1609
+ "benchmark_id": "massive-choice-test-v1",
1610
+ "relationship": "same_source_family",
1611
+ "source_description": "OpenJevData-140k intent-routing source family; its source notices list MASSIVE. Exact MASSIVE split/locales and retained item identities are unknown.",
1612
+ "retained_support_channels": {
1613
+ "openjevdata_intent_routing": 2242,
1614
+ "inj2_openjevdata_intent_routing": 92,
1615
+ "inj3_openjevdata_intent_routing": 69
1616
+ },
1617
+ "support_channel_rows": 2403,
1618
+ "support_count_scope": "Rows in supporting mixed channels; not necessarily all from this upstream source",
1619
+ "split": null
1620
+ }
1621
+ ]
1622
+ }