wuff-mann commited on
Commit
3beebc3
·
verified ·
1 Parent(s): c6f9f0b

Formal bilingual Phase-3B 20260911T034504Z — FORMAL_BILINGUAL_CONTINUATION_PHASE3B_R1_VALUE_NOT_PROMOTABLE_HOLD

Browse files
Files changed (14) hide show
  1. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/README_FORMAL_BILINGUAL_PHASE3B_R1.md +29 -0
  2. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_bilingual_phase3b_r1_summary.json +1872 -0
  3. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_en_zh.csv +97 -0
  4. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_q2.csv +97 -0
  5. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_zh_en.csv +73 -0
  6. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_zh_zh.csv +73 -0
  7. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_en_zh.csv +97 -0
  8. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_q2.csv +97 -0
  9. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_zh_en.csv +73 -0
  10. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_zh_zh.csv +73 -0
  11. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_causality.csv +13 -0
  12. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_replay.csv +769 -0
  13. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_training.csv +0 -0
  14. experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/hf_write_probe.txt +1 -0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/README_FORMAL_BILINGUAL_PHASE3B_R1.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # MANN-GPT Formal Bilingual Continuation Phase-3B-R1 — Seq2048 H3072
2
+
3
+ Run: 20260911T034504Z
4
+ Architecture freeze: v6-mature-20260910
5
+ Stable parent: Formal Phase-3A-R3 / 20260910T135045Z
6
+
7
+ Training:
8
+ - updates: 3072
9
+ - seq: 2048
10
+ - grad accumulation: 1
11
+ - tokens/update: 2048
12
+ - scope: NEIGHBOR23_25
13
+ - tail LR: 5e-06
14
+ - reader frozen: True
15
+ - optimizer resumed: True
16
+ - replay teacher: qualified Phase-3A-R3 parent
17
+ - train ranges: {"EN": ["4083:4851@2048", "4951:5412@2048"], "ZH": ["4128:4896@2048", "4996:5457@2048"], "CODE": ["2188:2572@2048", "2652:2882@2048"]}
18
+
19
+ Promotion:
20
+ - value: False
21
+ - Q2 deconfounded: True
22
+ - DTN: True
23
+ - strict causality: True
24
+ - structural safety: True
25
+ - deconfounded Global Memory: True
26
+ - qualified: False
27
+
28
+ Verdict:
29
+ FORMAL_BILINGUAL_CONTINUATION_PHASE3B_R1_VALUE_NOT_PROMOTABLE_HOLD
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_bilingual_phase3b_r1_summary.json ADDED
@@ -0,0 +1,1872 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "run_id": "20260911T034504Z",
3
+ "stage": "formal-bilingual-continuation-phase3b-r1-seq2048-h3072",
4
+ "architecture_freeze": "v6-mature-20260910",
5
+ "parent": {
6
+ "phase3a_r3_run": "20260910T135045Z",
7
+ "sidecar_sha256": "b7218920916bee1f071eeebbd51c285145d98ba023cf2ecb8f54d2a6c57c2dbf",
8
+ "optimizer_sha256": "5de46e986123f303a1fa5d328492f8a1516dec223ac9dfde62bd144749fff4dd",
9
+ "verdict": "FORMAL_BILINGUAL_CONTINUATION_PHASE3A_R3_SEQ1536_H2112_QUALIFIED_PROMOTE_PHASE3B_SEQ2048_RAMP"
10
+ },
11
+ "data": {
12
+ "train_ranges": {
13
+ "EN": [
14
+ "4083:4851@2048",
15
+ "4951:5412@2048"
16
+ ],
17
+ "ZH": [
18
+ "4128:4896@2048",
19
+ "4996:5457@2048"
20
+ ],
21
+ "CODE": [
22
+ "2188:2572@2048",
23
+ "2652:2882@2048"
24
+ ]
25
+ },
26
+ "domain_counts": {
27
+ "EN": 1229,
28
+ "ZH": 1229,
29
+ "CODE": 614
30
+ },
31
+ "zh_new_id_fraction": 0.6780716776847839,
32
+ "context_preflight": {
33
+ "seq_len": 2048,
34
+ "loss_finite": true,
35
+ "grad_ok": true,
36
+ "optimizer_state_bytes": 368363820,
37
+ "optimizer_state_gib": 0.3430655412375927,
38
+ "backward_peak_allocated_gb": 9.774742126464844,
39
+ "step_peak_allocated_gb": 5.395020008087158,
40
+ "step_state_devices": {
41
+ "cuda:0": 189
42
+ },
43
+ "post_step_state_devices": {
44
+ "cpu": 189
45
+ },
46
+ "gpu_vram_gb": 22.0343017578125,
47
+ "policy": "CPU AdamW moments during forward/backward; CUDA only for optimizer.step"
48
+ },
49
+ "tokens_per_update": 2048
50
+ },
51
+ "q2_ruler_calibration": {
52
+ "positive": {
53
+ "label": "PHASE3A_R3_SELF_POSITIVE",
54
+ "own_gain": 0.12199967344963575,
55
+ "base_full_nll": 8.06357891112566,
56
+ "candidate_full_nll": 8.06357891112566,
57
+ "full_relative_change": 0.0,
58
+ "candidate_target_penalty": 0.1872285356124248,
59
+ "candidate_specificity_abs": 0.22389915585517883,
60
+ "target_delta": 0.0,
61
+ "specificity_delta": 0.0,
62
+ "by_len_gain": {
63
+ "1024": 0.1386586672807771,
64
+ "1536": 0.10557065230892543,
65
+ "2048": 0.1229383521894124
66
+ },
67
+ "legacy_target_attribution": 0.1671014465111034,
68
+ "legacy_specificity_normalized": 0.19982997086226487,
69
+ "by_len_ok": true,
70
+ "ok": true
71
+ },
72
+ "gm_disabled_negative": {
73
+ "label": "GM_DISABLED_NEGATIVE",
74
+ "own_gain": 0.0,
75
+ "base_full_nll": 8.06357891112566,
76
+ "candidate_full_nll": 9.184027234713236,
77
+ "full_relative_change": 0.13895174040420763,
78
+ "candidate_target_penalty": 0.0,
79
+ "candidate_specificity_abs": 0.0,
80
+ "target_delta": -0.1872285356124248,
81
+ "specificity_delta": -0.22389915585517883,
82
+ "by_len_gain": {
83
+ "1024": 0.0,
84
+ "1536": 0.0,
85
+ "2048": 0.0
86
+ },
87
+ "legacy_target_attribution": -Infinity,
88
+ "legacy_specificity_normalized": -Infinity,
89
+ "by_len_ok": false,
90
+ "ok": false
91
+ },
92
+ "identity_erased_negative": {
93
+ "label": "TARGET_IDENTITY_ERASED_NEGATIVE",
94
+ "own_gain": 0.12199967344963575,
95
+ "base_full_nll": 8.06357891112566,
96
+ "candidate_full_nll": 8.06357891112566,
97
+ "full_relative_change": 0.0,
98
+ "candidate_target_penalty": 0.0,
99
+ "candidate_specificity_abs": 0.0,
100
+ "target_delta": -0.1872285356124248,
101
+ "specificity_delta": -0.22389915585517883,
102
+ "by_len_gain": {
103
+ "1024": 0.1386586672807771,
104
+ "1536": 0.10557065230892543,
105
+ "2048": 0.1229383521894124
106
+ },
107
+ "legacy_target_attribution": 0.0,
108
+ "legacy_specificity_normalized": 0.0,
109
+ "by_len_ok": true,
110
+ "ok": false
111
+ },
112
+ "calibrated": true,
113
+ "legacy_parent_ratio_ok": false
114
+ },
115
+ "parent_memory_self": {
116
+ "label": "FORMAL_P3A_PARENT_SELF_DECONFOUNDED",
117
+ "detail": {
118
+ "ZH_ZH": {
119
+ "mode": "ZH_ZH",
120
+ "n": 72,
121
+ "base_full_nll": 6.737897131178114,
122
+ "candidate_full_nll": 6.737897131178114,
123
+ "full_relative_change": 0.0,
124
+ "candidate_own_gain": 0.03984405878032601,
125
+ "candidate_target": 0.05802322758568658,
126
+ "candidate_specificity": 0.03330142630471124,
127
+ "target_delta_mean": 0.0,
128
+ "specificity_delta_mean": 0.0,
129
+ "panel_cluster_target_ci95": [
130
+ 0.0,
131
+ 0.0
132
+ ],
133
+ "panel_cluster_specificity_ci95": [
134
+ 0.0,
135
+ 0.0
136
+ ],
137
+ "point_replication_count": 5,
138
+ "replication_ok": true,
139
+ "families": {
140
+ "A": {
141
+ "base_full_nll": 6.574517316288418,
142
+ "candidate_full_nll": 6.574517316288418,
143
+ "full_relative_change": 0.0,
144
+ "candidate_own_gain": 0.03012783621714483,
145
+ "candidate_target": 0.04118392202589247,
146
+ "candidate_specificity": 0.024899840354919434,
147
+ "target_delta": 0.0,
148
+ "specificity_delta": 0.0,
149
+ "gate": true
150
+ },
151
+ "B": {
152
+ "base_full_nll": 6.90127694606781,
153
+ "candidate_full_nll": 6.90127694606781,
154
+ "full_relative_change": 0.0,
155
+ "candidate_own_gain": 0.04892088503013592,
156
+ "candidate_target": 0.07486253314548069,
157
+ "candidate_specificity": 0.04170301225450304,
158
+ "target_delta": 0.0,
159
+ "specificity_delta": 0.0,
160
+ "gate": true
161
+ }
162
+ },
163
+ "panel_detail": [
164
+ {
165
+ "panel_id": 0,
166
+ "candidate_own_gain": 0.04620502589139611,
167
+ "full_relative_change": 0.0,
168
+ "candidate_target": 0.07410256067911784,
169
+ "candidate_specificity": 0.04372088114420573,
170
+ "target_delta_mean": 0.0,
171
+ "specificity_delta_mean": 0.0,
172
+ "point_gate": true
173
+ },
174
+ {
175
+ "panel_id": 1,
176
+ "candidate_own_gain": 0.06539826878079918,
177
+ "full_relative_change": 0.0,
178
+ "candidate_target": 0.10219200452168782,
179
+ "candidate_specificity": 0.05860706170399984,
180
+ "target_delta_mean": 0.0,
181
+ "specificity_delta_mean": 0.0,
182
+ "point_gate": true
183
+ },
184
+ {
185
+ "panel_id": 2,
186
+ "candidate_own_gain": 0.024093224235639244,
187
+ "full_relative_change": 0.0,
188
+ "candidate_target": 0.02005449930826823,
189
+ "candidate_specificity": 0.010899782180786133,
190
+ "target_delta_mean": 0.0,
191
+ "specificity_delta_mean": 0.0,
192
+ "point_gate": true
193
+ },
194
+ {
195
+ "panel_id": 3,
196
+ "candidate_own_gain": 0.04895291249063923,
197
+ "full_relative_change": 0.0,
198
+ "candidate_target": 0.08063280582427979,
199
+ "candidate_specificity": 0.05485610167185465,
200
+ "target_delta_mean": 0.0,
201
+ "specificity_delta_mean": 0.0,
202
+ "point_gate": true
203
+ },
204
+ {
205
+ "panel_id": 4,
206
+ "candidate_own_gain": 0.034813892595219914,
207
+ "full_relative_change": 0.0,
208
+ "candidate_target": 0.05928373336791992,
209
+ "candidate_specificity": 0.030636827150980633,
210
+ "target_delta_mean": 0.0,
211
+ "specificity_delta_mean": 0.0,
212
+ "point_gate": true
213
+ },
214
+ {
215
+ "panel_id": 5,
216
+ "candidate_own_gain": 0.021085834931993452,
217
+ "full_relative_change": 0.0,
218
+ "candidate_target": 0.011873761812845865,
219
+ "candidate_specificity": 0.0010879039764404297,
220
+ "target_delta_mean": 0.0,
221
+ "specificity_delta_mean": 0.0,
222
+ "point_gate": false
223
+ }
224
+ ],
225
+ "primary_gate": true
226
+ },
227
+ "ZH_EN": {
228
+ "mode": "ZH_EN",
229
+ "n": 72,
230
+ "base_full_nll": 5.9530688060654535,
231
+ "candidate_full_nll": 5.9530688060654535,
232
+ "full_relative_change": 0.0,
233
+ "candidate_own_gain": 0.1894640181551821,
234
+ "candidate_target": 0.33599919743008083,
235
+ "candidate_specificity": 0.23352709743711683,
236
+ "target_delta_mean": 0.0,
237
+ "specificity_delta_mean": 0.0,
238
+ "panel_cluster_target_ci95": [
239
+ 0.0,
240
+ 0.0
241
+ ],
242
+ "panel_cluster_specificity_ci95": [
243
+ 0.0,
244
+ 0.0
245
+ ],
246
+ "point_replication_count": 5,
247
+ "replication_ok": true,
248
+ "families": {
249
+ "A": {
250
+ "base_full_nll": 5.744940254423353,
251
+ "candidate_full_nll": 5.744940254423353,
252
+ "full_relative_change": 0.0,
253
+ "candidate_own_gain": 0.2065684815364459,
254
+ "candidate_target": 0.3784845934973823,
255
+ "candidate_specificity": 0.2690862880812751,
256
+ "target_delta": 0.0,
257
+ "specificity_delta": 0.0,
258
+ "gate": true
259
+ },
260
+ "B": {
261
+ "base_full_nll": 6.161197357707554,
262
+ "candidate_full_nll": 6.161197357707554,
263
+ "full_relative_change": 0.0,
264
+ "candidate_own_gain": 0.17283711213958297,
265
+ "candidate_target": 0.2935138013627794,
266
+ "candidate_specificity": 0.1979679067929586,
267
+ "target_delta": 0.0,
268
+ "specificity_delta": 0.0,
269
+ "gate": true
270
+ }
271
+ },
272
+ "panel_detail": [
273
+ {
274
+ "panel_id": 0,
275
+ "candidate_own_gain": 0.19023791052764213,
276
+ "full_relative_change": 0.0,
277
+ "candidate_target": 0.20298012097676596,
278
+ "candidate_specificity": 0.05123456319173177,
279
+ "target_delta_mean": 0.0,
280
+ "specificity_delta_mean": 0.0,
281
+ "point_gate": true
282
+ },
283
+ {
284
+ "panel_id": 1,
285
+ "candidate_own_gain": 0.15549919389877345,
286
+ "full_relative_change": 0.0,
287
+ "candidate_target": 0.3842848539352417,
288
+ "candidate_specificity": 0.35466333230336505,
289
+ "target_delta_mean": 0.0,
290
+ "specificity_delta_mean": 0.0,
291
+ "point_gate": true
292
+ },
293
+ {
294
+ "panel_id": 2,
295
+ "candidate_own_gain": 0.22893886182271805,
296
+ "full_relative_change": 0.0,
297
+ "candidate_target": 0.16730165481567383,
298
+ "candidate_specificity": -0.01770504315694173,
299
+ "target_delta_mean": 0.0,
300
+ "specificity_delta_mean": 0.0,
301
+ "point_gate": false
302
+ },
303
+ {
304
+ "panel_id": 3,
305
+ "candidate_own_gain": 0.17041919659567684,
306
+ "full_relative_change": 0.0,
307
+ "candidate_target": 0.20745537678400675,
308
+ "candidate_specificity": 0.11276690165201823,
309
+ "target_delta_mean": 0.0,
310
+ "specificity_delta_mean": 0.0,
311
+ "point_gate": true
312
+ },
313
+ {
314
+ "panel_id": 4,
315
+ "candidate_own_gain": 0.15277281338086626,
316
+ "full_relative_change": 0.0,
317
+ "candidate_target": 0.1730648080507914,
318
+ "candidate_specificity": 0.05425906181335449,
319
+ "target_delta_mean": 0.0,
320
+ "specificity_delta_mean": 0.0,
321
+ "point_gate": true
322
+ },
323
+ {
324
+ "panel_id": 5,
325
+ "candidate_own_gain": 0.24151036649691768,
326
+ "full_relative_change": 0.0,
327
+ "candidate_target": 0.8809083700180054,
328
+ "candidate_specificity": 0.8459437688191732,
329
+ "target_delta_mean": 0.0,
330
+ "specificity_delta_mean": 0.0,
331
+ "point_gate": true
332
+ }
333
+ ],
334
+ "primary_gate": true
335
+ },
336
+ "EN_ZH": {
337
+ "mode": "EN_ZH",
338
+ "n": 96,
339
+ "base_full_nll": 7.000802204012871,
340
+ "candidate_full_nll": 7.000802204012871,
341
+ "full_relative_change": 0.0,
342
+ "candidate_own_gain": 0.03801036547078819,
343
+ "candidate_target": 0.05821750561396281,
344
+ "candidate_specificity": 0.041564762592315674,
345
+ "target_delta_mean": 0.0,
346
+ "specificity_delta_mean": 0.0,
347
+ "panel_cluster_target_ci95": [
348
+ 0.0,
349
+ 0.0
350
+ ],
351
+ "panel_cluster_specificity_ci95": [
352
+ 0.0,
353
+ 0.0
354
+ ],
355
+ "point_replication_count": 6,
356
+ "replication_ok": true,
357
+ "families": {
358
+ "A": {
359
+ "base_full_nll": 6.727785795927048,
360
+ "candidate_full_nll": 6.727785795927048,
361
+ "full_relative_change": 0.0,
362
+ "candidate_own_gain": 0.039147895357552066,
363
+ "candidate_target": 0.057473172744115196,
364
+ "candidate_specificity": 0.04297110438346863,
365
+ "target_delta": 0.0,
366
+ "specificity_delta": 0.0,
367
+ "gate": true
368
+ },
369
+ "B": {
370
+ "base_full_nll": 7.273818612098694,
371
+ "candidate_full_nll": 7.273818612098694,
372
+ "full_relative_change": 0.0,
373
+ "candidate_own_gain": 0.03695582763482932,
374
+ "candidate_target": 0.058961838483810425,
375
+ "candidate_specificity": 0.04015842080116272,
376
+ "target_delta": 0.0,
377
+ "specificity_delta": 0.0,
378
+ "gate": true
379
+ }
380
+ },
381
+ "panel_detail": [
382
+ {
383
+ "panel_id": 0,
384
+ "candidate_own_gain": 0.03238171082990597,
385
+ "full_relative_change": 0.0,
386
+ "candidate_target": 0.05948418378829956,
387
+ "candidate_specificity": 0.05025601387023926,
388
+ "target_delta_mean": 0.0,
389
+ "specificity_delta_mean": 0.0,
390
+ "point_gate": true
391
+ },
392
+ {
393
+ "panel_id": 1,
394
+ "candidate_own_gain": 0.021438714579863242,
395
+ "full_relative_change": 0.0,
396
+ "candidate_target": 0.06467747688293457,
397
+ "candidate_specificity": 0.04589620232582092,
398
+ "target_delta_mean": 0.0,
399
+ "specificity_delta_mean": 0.0,
400
+ "point_gate": true
401
+ },
402
+ {
403
+ "panel_id": 2,
404
+ "candidate_own_gain": 0.043118281637328525,
405
+ "full_relative_change": 0.0,
406
+ "candidate_target": 0.057001084089279175,
407
+ "candidate_specificity": 0.05774986743927002,
408
+ "target_delta_mean": 0.0,
409
+ "specificity_delta_mean": 0.0,
410
+ "point_gate": true
411
+ },
412
+ {
413
+ "panel_id": 3,
414
+ "candidate_own_gain": 0.02164609046711795,
415
+ "full_relative_change": 0.0,
416
+ "candidate_target": 0.02337023615837097,
417
+ "candidate_specificity": 0.012913763523101807,
418
+ "target_delta_mean": 0.0,
419
+ "specificity_delta_mean": 0.0,
420
+ "point_gate": true
421
+ },
422
+ {
423
+ "panel_id": 4,
424
+ "candidate_own_gain": 0.04128705824520381,
425
+ "full_relative_change": 0.0,
426
+ "candidate_target": 0.0462154746055603,
427
+ "candidate_specificity": 0.027180522680282593,
428
+ "target_delta_mean": 0.0,
429
+ "specificity_delta_mean": 0.0,
430
+ "point_gate": true
431
+ },
432
+ {
433
+ "panel_id": 5,
434
+ "candidate_own_gain": 0.06960334136294949,
435
+ "full_relative_change": 0.0,
436
+ "candidate_target": 0.09855657815933228,
437
+ "candidate_specificity": 0.05539220571517944,
438
+ "target_delta_mean": 0.0,
439
+ "specificity_delta_mean": 0.0,
440
+ "point_gate": true
441
+ }
442
+ ],
443
+ "primary_gate": true
444
+ }
445
+ },
446
+ "primary_all": true,
447
+ "replication_all": true,
448
+ "ok": true
449
+ },
450
+ "parent_q2": {
451
+ "n": 96,
452
+ "beta0_nll": 9.184027234713236,
453
+ "full_nll": 8.06357891112566,
454
+ "target_ko_nll": 8.250807446738085,
455
+ "control_ko_nll": 8.026908290882906,
456
+ "gain_abs": 1.120448323587576,
457
+ "gain": 0.12199967344963575,
458
+ "target_penalty": 0.1872285356124248,
459
+ "specificity_abs": 0.22389915585517883,
460
+ "target_attribution": 0.1671014465111034,
461
+ "specificity_normalized": 0.19982997086226487,
462
+ "by_len": {
463
+ "1024": {
464
+ "gain": 0.1386586672807771
465
+ },
466
+ "1536": {
467
+ "gain": 0.10557065230892543
468
+ },
469
+ "2048": {
470
+ "gain": 0.1229383521894124
471
+ }
472
+ }
473
+ },
474
+ "branch": {
475
+ "branch": "FORMAL_BILINGUAL_CONTINUATION_PHASE3B_R1_SEQ2048_H3072",
476
+ "finite_ok": true,
477
+ "grad_ok": true,
478
+ "gradient_audit": {
479
+ "L23_selector": {
480
+ "mean_norm": 0.0023870191919519762,
481
+ "max_norm": 0.017350954934954643,
482
+ "nonzero_tensors": 14,
483
+ "tensor_count": 14
484
+ },
485
+ "L23_qk": {
486
+ "mean_norm": 0.11377793177962303,
487
+ "max_norm": 0.12214695662260056,
488
+ "nonzero_tensors": 2,
489
+ "tensor_count": 2
490
+ },
491
+ "L23_propagation": {
492
+ "mean_norm": 0.2658262334764004,
493
+ "max_norm": 0.6598690152168274,
494
+ "nonzero_tensors": 5,
495
+ "tensor_count": 5
496
+ },
497
+ "L24_selector": {
498
+ "mean_norm": 0.009486529997177837,
499
+ "max_norm": 0.040702495723962784,
500
+ "nonzero_tensors": 14,
501
+ "tensor_count": 14
502
+ },
503
+ "L24_qk": {
504
+ "mean_norm": 0.5493256896734238,
505
+ "max_norm": 0.62007737159729,
506
+ "nonzero_tensors": 2,
507
+ "tensor_count": 2
508
+ },
509
+ "L24_propagation": {
510
+ "mean_norm": 0.5801075400784612,
511
+ "max_norm": 1.1554580926895142,
512
+ "nonzero_tensors": 5,
513
+ "tensor_count": 5
514
+ },
515
+ "L25_selector": {
516
+ "mean_norm": 0.0017684324617692124,
517
+ "max_norm": 0.008035688661038876,
518
+ "nonzero_tensors": 14,
519
+ "tensor_count": 14
520
+ },
521
+ "L25_qk": {
522
+ "mean_norm": 0.31673695147037506,
523
+ "max_norm": 0.5067300796508789,
524
+ "nonzero_tensors": 2,
525
+ "tensor_count": 2
526
+ },
527
+ "L25_propagation": {
528
+ "mean_norm": 0.3084631386213005,
529
+ "max_norm": 0.7992029190063477,
530
+ "nonzero_tensors": 5,
531
+ "tensor_count": 5
532
+ }
533
+ },
534
+ "protected_diff": {
535
+ "reader_q": 0.0,
536
+ "reader_k": 0.0,
537
+ "source_writer": 0.0,
538
+ "embedding_sample": 0.0,
539
+ "v_proj": {
540
+ "23": 0.0,
541
+ "24": 0.0,
542
+ "25": 0.0
543
+ }
544
+ },
545
+ "protected_ok": true,
546
+ "dtn_param_maxdiff": 0.0,
547
+ "dtn_params_exact": true,
548
+ "phase_audits": [
549
+ {
550
+ "update": 192,
551
+ "phase": 1,
552
+ "opt_weighted": 0.0002740737433732036,
553
+ "real_composite": 4.566960979092644e-07,
554
+ "min_real_improvement": -0.0008596096796329983,
555
+ "target_hinge_rate_to_date": 0.375,
556
+ "specificity_hinge_rate_to_date": 0.4166666666666667
557
+ },
558
+ {
559
+ "update": 384,
560
+ "phase": 2,
561
+ "opt_weighted": 0.0004919200496455129,
562
+ "real_composite": 0.0004301324148465116,
563
+ "min_real_improvement": -0.0002506247983662303,
564
+ "target_hinge_rate_to_date": 0.4166666666666667,
565
+ "specificity_hinge_rate_to_date": 0.4479166666666667
566
+ },
567
+ {
568
+ "update": 576,
569
+ "phase": 3,
570
+ "opt_weighted": 0.000775631012419192,
571
+ "real_composite": 0.0003495431999963978,
572
+ "min_real_improvement": -0.00012329874061787428,
573
+ "target_hinge_rate_to_date": 0.4166666666666667,
574
+ "specificity_hinge_rate_to_date": 0.4097222222222222
575
+ },
576
+ {
577
+ "update": 768,
578
+ "phase": 4,
579
+ "opt_weighted": 0.000986594547308866,
580
+ "real_composite": 0.0002500741242305674,
581
+ "min_real_improvement": -0.0011349460755704544,
582
+ "target_hinge_rate_to_date": 0.4114583333333333,
583
+ "specificity_hinge_rate_to_date": 0.4166666666666667
584
+ },
585
+ {
586
+ "update": 960,
587
+ "phase": 5,
588
+ "opt_weighted": 0.0012640393970891543,
589
+ "real_composite": 0.0003729482010393453,
590
+ "min_real_improvement": -0.0018804544588459226,
591
+ "target_hinge_rate_to_date": 0.3875,
592
+ "specificity_hinge_rate_to_date": 0.37916666666666665
593
+ },
594
+ {
595
+ "update": 1152,
596
+ "phase": 6,
597
+ "opt_weighted": 0.0015152407822008362,
598
+ "real_composite": 0.0008422267060254851,
599
+ "min_real_improvement": -0.002204943866320704,
600
+ "target_hinge_rate_to_date": 0.3819444444444444,
601
+ "specificity_hinge_rate_to_date": 0.375
602
+ },
603
+ {
604
+ "update": 1344,
605
+ "phase": 7,
606
+ "opt_weighted": 0.0016051431435139026,
607
+ "real_composite": 0.00014431273551471395,
608
+ "min_real_improvement": -0.004507432567947319,
609
+ "target_hinge_rate_to_date": 0.375,
610
+ "specificity_hinge_rate_to_date": 0.38095238095238093
611
+ },
612
+ {
613
+ "update": 1536,
614
+ "phase": 8,
615
+ "opt_weighted": 0.0019259779661658701,
616
+ "real_composite": -1.510160040532339e-05,
617
+ "min_real_improvement": -0.00475232792437969,
618
+ "target_hinge_rate_to_date": 0.3828125,
619
+ "specificity_hinge_rate_to_date": 0.3958333333333333
620
+ },
621
+ {
622
+ "update": 1728,
623
+ "phase": 9,
624
+ "opt_weighted": 0.0022736388873182715,
625
+ "real_composite": 0.00021837052668471555,
626
+ "min_real_improvement": -0.00406973009148938,
627
+ "target_hinge_rate_to_date": 0.38425925925925924,
628
+ "specificity_hinge_rate_to_date": 0.38657407407407407
629
+ },
630
+ {
631
+ "update": 1920,
632
+ "phase": 10,
633
+ "opt_weighted": 0.0026044728009631413,
634
+ "real_composite": 0.0004918732756989256,
635
+ "min_real_improvement": -0.004940944367934597,
636
+ "target_hinge_rate_to_date": 0.3645833333333333,
637
+ "specificity_hinge_rate_to_date": 0.375
638
+ },
639
+ {
640
+ "update": 2112,
641
+ "phase": 11,
642
+ "opt_weighted": 0.002902241995699036,
643
+ "real_composite": 0.0011051478554760655,
644
+ "min_real_improvement": -0.003551684714585338,
645
+ "target_hinge_rate_to_date": 0.36742424242424243,
646
+ "specificity_hinge_rate_to_date": 0.36553030303030304
647
+ },
648
+ {
649
+ "update": 2304,
650
+ "phase": 12,
651
+ "opt_weighted": 0.003099461178743849,
652
+ "real_composite": 0.0014448414503931675,
653
+ "min_real_improvement": -0.0034605050992108093,
654
+ "target_hinge_rate_to_date": 0.3767361111111111,
655
+ "specificity_hinge_rate_to_date": 0.3663194444444444
656
+ },
657
+ {
658
+ "update": 2496,
659
+ "phase": 13,
660
+ "opt_weighted": 0.003199899990132533,
661
+ "real_composite": 0.0008891165063839748,
662
+ "min_real_improvement": -0.0042842754456471205,
663
+ "target_hinge_rate_to_date": 0.3717948717948718,
664
+ "specificity_hinge_rate_to_date": 0.3733974358974359
665
+ },
666
+ {
667
+ "update": 2688,
668
+ "phase": 14,
669
+ "opt_weighted": 0.003443964887668268,
670
+ "real_composite": 0.0013602850393786368,
671
+ "min_real_improvement": -0.0030456569305155456,
672
+ "target_hinge_rate_to_date": 0.37202380952380953,
673
+ "specificity_hinge_rate_to_date": 0.3705357142857143
674
+ },
675
+ {
676
+ "update": 2880,
677
+ "phase": 15,
678
+ "opt_weighted": 0.0034279068293527155,
679
+ "real_composite": 0.0018730188515313564,
680
+ "min_real_improvement": -0.0019928466736750332,
681
+ "target_hinge_rate_to_date": 0.36666666666666664,
682
+ "specificity_hinge_rate_to_date": 0.37222222222222223
683
+ },
684
+ {
685
+ "update": 3072,
686
+ "phase": 16,
687
+ "opt_weighted": 0.0038012256916448313,
688
+ "real_composite": 0.001791767217190066,
689
+ "min_real_improvement": -0.0019296121019132771,
690
+ "target_hinge_rate_to_date": 0.3684895833333333,
691
+ "specificity_hinge_rate_to_date": 0.3697916666666667
692
+ }
693
+ ],
694
+ "phase_stable": true,
695
+ "final_opt_post": {
696
+ "EN": 3.9940248330434165,
697
+ "ZH": 6.234068671862285,
698
+ "CODE": 1.4819416006406148
699
+ },
700
+ "final_opt_relative": {
701
+ "EN": 0.001983910058004521,
702
+ "ZH": 0.006013956906785322,
703
+ "CODE": 0.0030103945286444685
704
+ },
705
+ "final_opt_weighted": 0.0038012256916448313,
706
+ "real": {
707
+ "general": 5.081929524739583,
708
+ "en_stream": 3.9627663493156433,
709
+ "zh": 6.206226170063019,
710
+ "code": 2.017342428366343,
711
+ "reasoning": 4.202990233898163,
712
+ "long_en": 3.967146635055542,
713
+ "long_zh": 6.485197305679321,
714
+ "code_stream": 1.2835952838261921
715
+ },
716
+ "real_relative": {
717
+ "general": -0.000433838854945725,
718
+ "en_stream": 0.0021854971250197803,
719
+ "zh": 0.006853909271450417,
720
+ "code": 0.0003906391192981273,
721
+ "reasoning": -0.00045130718358133744,
722
+ "long_en": 0.0022822840144915762,
723
+ "long_zh": 0.006413945415791718,
724
+ "code_stream": 0.0016495649746981677
725
+ },
726
+ "real_composite": 0.0019138875120947656,
727
+ "dtn_profile": {
728
+ "domain_nll": {
729
+ "EN": {
730
+ "0": 4.681806325912476,
731
+ "1": 4.851890563964844,
732
+ "2": 4.2352049350738525,
733
+ "3": 4.1866947412490845
734
+ },
735
+ "ZH": {
736
+ "0": 6.768380522727966,
737
+ "1": 6.594183683395386,
738
+ "2": 6.280936360359192,
739
+ "3": 6.264288425445557
740
+ },
741
+ "CODE": {
742
+ "0": 2.5781867504119873,
743
+ "1": 2.5622042417526245,
744
+ "2": 2.03616139292717,
745
+ "3": 1.9861930906772614
746
+ },
747
+ "REASON": {
748
+ "0": 4.573995232582092,
749
+ "1": 4.651333928108215,
750
+ "2": 4.135881066322327,
751
+ "3": 4.072716653347015
752
+ }
753
+ },
754
+ "mean_d2_over_d1": 0.12268317690521824,
755
+ "mean_d3_over_d2": 0.013479332199097211,
756
+ "mean_d3_gain_vs_no_dtn": 0.12985980075808884,
757
+ "router_distribution": [
758
+ 0.17098832860953522,
759
+ 0.0005135254804214333,
760
+ 0.2946166096691392,
761
+ 0.5256388727727653,
762
+ 0.0012870482295629267,
763
+ 0.006955615237575833
764
+ ],
765
+ "router_entropy_norm": 0.5844032548194465,
766
+ "router_max_share": 0.5256388727727653,
767
+ "output_scale": 0.9994887113571167
768
+ },
769
+ "target_hinge_rate": 0.3684895833333333,
770
+ "specificity_hinge_rate": 0.3697916666666667,
771
+ "optimizer_resume_audit": {
772
+ "state_count": 63,
773
+ "selected_param_count": 63,
774
+ "min_step": 4608.0,
775
+ "max_step": 4608.0
776
+ },
777
+ "optimizer_vram_policy": "cpu_moments_during_forward_backward_cuda_only_for_step",
778
+ "optimizer_state_bytes": 368363820,
779
+ "optimizer_state_devices_final": {
780
+ "cpu": 189
781
+ },
782
+ "state_path": "/content/mann_formal_bilingual_phase3b_20260911T034504Z/branch_states/FORMAL_PHASE3B_R1_SEQ2048_H3072.pt",
783
+ "optimizer_path": "/content/mann_formal_bilingual_phase3b_20260911T034504Z/branch_states/FORMAL_PHASE3B_R1_SEQ2048_H3072_optimizer.pt"
784
+ },
785
+ "adjudication": {
786
+ "candidate": {
787
+ "real": {
788
+ "general": 5.081929524739583,
789
+ "en_stream": 3.9627663493156433,
790
+ "zh": 6.206226170063019,
791
+ "code": 2.017342428366343,
792
+ "reasoning": 4.202990233898163,
793
+ "long_en": 3.967146635055542,
794
+ "long_zh": 6.485197305679321,
795
+ "code_stream": 1.2835952838261921
796
+ },
797
+ "q2": {
798
+ "n": 96,
799
+ "beta0_nll": 9.090663631757101,
800
+ "full_nll": 7.917149451871713,
801
+ "target_ko_nll": 8.106545766194662,
802
+ "control_ko_nll": 7.878582701086998,
803
+ "gain_abs": 1.1735141798853883,
804
+ "gain": 0.12909004528402776,
805
+ "target_penalty": 0.18939631432294934,
806
+ "specificity_abs": 0.22796306510766406,
807
+ "target_attribution": 0.16139243783270416,
808
+ "specificity_normalized": 0.19425676230851183,
809
+ "by_len": {
810
+ "1024": {
811
+ "gain": 0.1474320735567864
812
+ },
813
+ "1536": {
814
+ "gain": 0.11008750004838665
815
+ },
816
+ "2048": {
817
+ "gain": 0.1311460978277645
818
+ }
819
+ }
820
+ },
821
+ "dtn_profile": {
822
+ "domain_nll": {
823
+ "EN": {
824
+ "0": 4.681806325912476,
825
+ "1": 4.851890563964844,
826
+ "2": 4.2352049350738525,
827
+ "3": 4.1866947412490845
828
+ },
829
+ "ZH": {
830
+ "0": 6.768380522727966,
831
+ "1": 6.594183683395386,
832
+ "2": 6.280936360359192,
833
+ "3": 6.264288425445557
834
+ },
835
+ "CODE": {
836
+ "0": 2.5781867504119873,
837
+ "1": 2.5622042417526245,
838
+ "2": 2.03616139292717,
839
+ "3": 1.9861930906772614
840
+ },
841
+ "REASON": {
842
+ "0": 4.573995232582092,
843
+ "1": 4.651333928108215,
844
+ "2": 4.135881066322327,
845
+ "3": 4.072716653347015
846
+ }
847
+ },
848
+ "mean_d2_over_d1": 0.12268317690521824,
849
+ "mean_d3_over_d2": 0.013479332199097211,
850
+ "mean_d3_gain_vs_no_dtn": 0.12985980075808884,
851
+ "router_distribution": [
852
+ 0.17098832860953522,
853
+ 0.0005135254804214333,
854
+ 0.2946166096691392,
855
+ 0.5256388727727653,
856
+ 0.0012870482295629267,
857
+ 0.006955615237575833
858
+ ],
859
+ "router_entropy_norm": 0.5844032548194465,
860
+ "router_max_share": 0.5256388727727653,
861
+ "output_scale": 0.9994887113571167
862
+ }
863
+ },
864
+ "old_vs_parent_diagnostic": {
865
+ "label": "FORMAL_P3B_R1_CAND_VS_P3A_R3_OLD_DIAGNOSTIC",
866
+ "detail": {
867
+ "ZH_ZH": {
868
+ "mode": "ZH_ZH",
869
+ "n": 72,
870
+ "gain_delta": 0.003817434371584792,
871
+ "candidate_target": 0.06549638509750366,
872
+ "candidate_specificity": 0.05128541919920179,
873
+ "target_delta_mean": 0.007473157511817085,
874
+ "specificity_delta_mean": 0.01798399289449056,
875
+ "example_target_ci95": [
876
+ -0.002547607984807756,
877
+ 0.017672750850518542
878
+ ],
879
+ "example_specificity_ci95": [
880
+ 0.009548867411083647,
881
+ 0.026682495243019525
882
+ ],
883
+ "panel_cluster_target_ci95": [
884
+ -0.007464190324147542,
885
+ 0.025722503662109375
886
+ ],
887
+ "panel_cluster_specificity_ci95": [
888
+ 0.00731654299630059,
889
+ 0.030458165539635554
890
+ ],
891
+ "panel_target_means": [
892
+ -0.017896453539530437,
893
+ 0.0484769344329834,
894
+ 0.00839853286743164,
895
+ -0.00014468034108479819,
896
+ -0.007892847061157227,
897
+ 0.013897458712259928
898
+ ],
899
+ "panel_specificity_means": [
900
+ -0.0020980040232340493,
901
+ 0.046238064765930176,
902
+ 0.019729097684224445,
903
+ 0.013141592343648275,
904
+ 0.008670488993326822,
905
+ 0.022222717603047688
906
+ ],
907
+ "point_replication_count": 6,
908
+ "point_replication_required": 4,
909
+ "replication_ok": true,
910
+ "families": {
911
+ "A": {
912
+ "base_gain": 0.03012783621714483,
913
+ "candidate_gain": 0.03250185982317791,
914
+ "gain_delta": 0.0023740236060330773,
915
+ "base_target": 0.04118392202589247,
916
+ "candidate_target": 0.04570333162943522,
917
+ "target_delta": 0.0045194096035427525,
918
+ "base_specificity": 0.024899840354919434,
919
+ "candidate_specificity": 0.041913138495551214,
920
+ "specificity_delta": 0.01701329814063178,
921
+ "gate": true
922
+ },
923
+ "B": {
924
+ "base_gain": 0.04892088503013592,
925
+ "candidate_gain": 0.053999447953451636,
926
+ "gain_delta": 0.005078562923315717,
927
+ "base_target": 0.07486253314548069,
928
+ "candidate_target": 0.0852894385655721,
929
+ "target_delta": 0.010426905420091406,
930
+ "base_specificity": 0.04170301225450304,
931
+ "candidate_specificity": 0.06065769990285238,
932
+ "specificity_delta": 0.018954687648349337,
933
+ "gate": true
934
+ }
935
+ },
936
+ "panel_detail": [
937
+ {
938
+ "panel_id": 0,
939
+ "gain_delta": 0.0011706977117381528,
940
+ "candidate_target": 0.0562061071395874,
941
+ "candidate_specificity": 0.04162287712097168,
942
+ "target_delta_mean": -0.017896453539530437,
943
+ "specificity_delta_mean": -0.0020980040232340493,
944
+ "point_gate": true,
945
+ "legacy_target_ci95": [
946
+ -0.03668886621793111,
947
+ -0.0006009548902511606
948
+ ],
949
+ "legacy_specificity_ci95": [
950
+ -0.021294455726941424,
951
+ 0.01565609375635783
952
+ ]
953
+ },
954
+ {
955
+ "panel_id": 1,
956
+ "gain_delta": 0.009885679003264924,
957
+ "candidate_target": 0.15066893895467123,
958
+ "candidate_specificity": 0.10484512646993001,
959
+ "target_delta_mean": 0.0484769344329834,
960
+ "specificity_delta_mean": 0.046238064765930176,
961
+ "point_gate": true,
962
+ "legacy_target_ci95": [
963
+ 0.02030968169371287,
964
+ 0.07806441485881806
965
+ ],
966
+ "legacy_specificity_ci95": [
967
+ 0.024170989791552223,
968
+ 0.0687352438767751
969
+ ]
970
+ },
971
+ {
972
+ "panel_id": 2,
973
+ "gain_delta": 0.004203434022351571,
974
+ "candidate_target": 0.02845303217569987,
975
+ "candidate_specificity": 0.03062887986501058,
976
+ "target_delta_mean": 0.00839853286743164,
977
+ "specificity_delta_mean": 0.019729097684224445,
978
+ "point_gate": true,
979
+ "legacy_target_ci95": [
980
+ -0.005622739593187968,
981
+ 0.02569196919600168
982
+ ],
983
+ "legacy_specificity_ci95": [
984
+ 0.0014458626508712781,
985
+ 0.03892473181088765
986
+ ]
987
+ },
988
+ {
989
+ "panel_id": 3,
990
+ "gain_delta": -0.0035656083420453275,
991
+ "candidate_target": 0.08048812548319499,
992
+ "candidate_specificity": 0.06799769401550293,
993
+ "target_delta_mean": -0.00014468034108479819,
994
+ "specificity_delta_mean": 0.013141592343648275,
995
+ "point_gate": true,
996
+ "legacy_target_ci95": [
997
+ -0.026783522963523865,
998
+ 0.0254952182372411
999
+ ],
1000
+ "legacy_specificity_ci95": [
1001
+ -0.006724343697230021,
1002
+ 0.031917953491210925
1003
+ ]
1004
+ },
1005
+ {
1006
+ "panel_id": 4,
1007
+ "gain_delta": 0.0020260286364156763,
1008
+ "candidate_target": 0.051390886306762695,
1009
+ "candidate_specificity": 0.03930731614430746,
1010
+ "target_delta_mean": -0.007892847061157227,
1011
+ "specificity_delta_mean": 0.008670488993326822,
1012
+ "point_gate": true,
1013
+ "legacy_target_ci95": [
1014
+ -0.026056925455729168,
1015
+ 0.008822900056838986
1016
+ ],
1017
+ "legacy_specificity_ci95": [
1018
+ -0.008240937193234762,
1019
+ 0.025399681925773614
1020
+ ]
1021
+ },
1022
+ {
1023
+ "panel_id": 5,
1024
+ "gain_delta": 0.009494779908434024,
1025
+ "candidate_target": 0.025771220525105793,
1026
+ "candidate_specificity": 0.023310621579488117,
1027
+ "target_delta_mean": 0.013897458712259928,
1028
+ "specificity_delta_mean": 0.022222717603047688,
1029
+ "point_gate": true,
1030
+ "legacy_target_ci95": [
1031
+ -0.004916614294052124,
1032
+ 0.03402072588602702
1033
+ ],
1034
+ "legacy_specificity_ci95": [
1035
+ 0.0036361267169316615,
1036
+ 0.04168992638587952
1037
+ ]
1038
+ }
1039
+ ],
1040
+ "primary_gate": true
1041
+ },
1042
+ "ZH_EN": {
1043
+ "mode": "ZH_EN",
1044
+ "n": 72,
1045
+ "gain_delta": 0.04623568066177036,
1046
+ "candidate_target": 0.3804735276434157,
1047
+ "candidate_specificity": 0.24657265014118618,
1048
+ "target_delta_mean": 0.04447433021333483,
1049
+ "specificity_delta_mean": 0.01304555270406935,
1050
+ "example_target_ci95": [
1051
+ 0.02899748310446739,
1052
+ 0.06150235931078592
1053
+ ],
1054
+ "example_specificity_ci95": [
1055
+ -0.006581033186780082,
1056
+ 0.03256884134478039
1057
+ ],
1058
+ "panel_cluster_target_ci95": [
1059
+ 0.024514797661039565,
1060
+ 0.06826899449030557
1061
+ ],
1062
+ "panel_cluster_specificity_ci95": [
1063
+ -0.014596949021021524,
1064
+ 0.04138273994127909
1065
+ ],
1066
+ "panel_target_means": [
1067
+ 0.03848807017008463,
1068
+ 0.06698761383692424,
1069
+ 0.026739617188771565,
1070
+ 0.017892658710479736,
1071
+ 0.023037890593210857,
1072
+ 0.09370013078053792
1073
+ ],
1074
+ "panel_specificity_means": [
1075
+ 0.014475305875142416,
1076
+ 0.04053610563278198,
1077
+ -0.004928410053253174,
1078
+ -0.04073824485143026,
1079
+ -0.0009746551513671875,
1080
+ 0.06990321477254231
1081
+ ],
1082
+ "point_replication_count": 4,
1083
+ "point_replication_required": 4,
1084
+ "replication_ok": true,
1085
+ "families": {
1086
+ "A": {
1087
+ "base_gain": 0.2065684815364459,
1088
+ "candidate_gain": 0.25718387458507785,
1089
+ "gain_delta": 0.05061539304863194,
1090
+ "base_target": 0.3784845934973823,
1091
+ "candidate_target": 0.4266500340567695,
1092
+ "target_delta": 0.04816544055938721,
1093
+ "base_specificity": 0.2690862880812751,
1094
+ "candidate_specificity": 0.2818116611904568,
1095
+ "specificity_delta": 0.012725373109181704,
1096
+ "gate": true
1097
+ },
1098
+ "B": {
1099
+ "base_gain": 0.17283711213958297,
1100
+ "candidate_gain": 0.2149049185960642,
1101
+ "gain_delta": 0.04206780645648123,
1102
+ "base_target": 0.2935138013627794,
1103
+ "candidate_target": 0.33429702123006183,
1104
+ "target_delta": 0.04078321986728245,
1105
+ "base_specificity": 0.1979679067929586,
1106
+ "candidate_specificity": 0.21133363909191555,
1107
+ "specificity_delta": 0.013365732298956962,
1108
+ "gate": true
1109
+ }
1110
+ },
1111
+ "panel_detail": [
1112
+ {
1113
+ "panel_id": 0,
1114
+ "gain_delta": 0.05782884285809661,
1115
+ "candidate_target": 0.24146819114685059,
1116
+ "candidate_specificity": 0.06570986906687419,
1117
+ "target_delta_mean": 0.03848807017008463,
1118
+ "specificity_delta_mean": 0.014475305875142416,
1119
+ "point_gate": true,
1120
+ "legacy_target_ci95": [
1121
+ 0.005323651432991028,
1122
+ 0.07622352143128712
1123
+ ],
1124
+ "legacy_specificity_ci95": [
1125
+ -0.014849717418352762,
1126
+ 0.04466002782185871
1127
+ ]
1128
+ },
1129
+ {
1130
+ "panel_id": 1,
1131
+ "gain_delta": 0.05177187656349022,
1132
+ "candidate_target": 0.45127246777216595,
1133
+ "candidate_specificity": 0.39519943793614704,
1134
+ "target_delta_mean": 0.06698761383692424,
1135
+ "specificity_delta_mean": 0.04053610563278198,
1136
+ "point_gate": true,
1137
+ "legacy_target_ci95": [
1138
+ 0.026505993803342183,
1139
+ 0.11912546356519063
1140
+ ],
1141
+ "legacy_specificity_ci95": [
1142
+ 0.01340165138244629,
1143
+ 0.07609781771898265
1144
+ ]
1145
+ },
1146
+ {
1147
+ "panel_id": 2,
1148
+ "gain_delta": 0.04446595848665286,
1149
+ "candidate_target": 0.1940412720044454,
1150
+ "candidate_specificity": -0.022633453210194904,
1151
+ "target_delta_mean": 0.026739617188771565,
1152
+ "specificity_delta_mean": -0.004928410053253174,
1153
+ "point_gate": false,
1154
+ "legacy_target_ci95": [
1155
+ 0.004801121354103088,
1156
+ 0.04905244906743366
1157
+ ],
1158
+ "legacy_specificity_ci95": [
1159
+ -0.0647161473830541,
1160
+ 0.04673538704713185
1161
+ ]
1162
+ },
1163
+ {
1164
+ "panel_id": 3,
1165
+ "gain_delta": 0.04951283074398835,
1166
+ "candidate_target": 0.22534803549448648,
1167
+ "candidate_specificity": 0.07202865680058797,
1168
+ "target_delta_mean": 0.017892658710479736,
1169
+ "specificity_delta_mean": -0.04073824485143026,
1170
+ "point_gate": false,
1171
+ "legacy_target_ci95": [
1172
+ -0.002614508072535196,
1173
+ 0.03705762128035227
1174
+ ],
1175
+ "legacy_specificity_ci95": [
1176
+ -0.07853756745656332,
1177
+ -0.0033825824658075994
1178
+ ]
1179
+ },
1180
+ {
1181
+ "panel_id": 4,
1182
+ "gain_delta": 0.0203325663189394,
1183
+ "candidate_target": 0.1961026986440023,
1184
+ "candidate_specificity": 0.053284406661987305,
1185
+ "target_delta_mean": 0.023037890593210857,
1186
+ "specificity_delta_mean": -0.0009746551513671875,
1187
+ "point_gate": true,
1188
+ "legacy_target_ci95": [
1189
+ -0.0017216995358467096,
1190
+ 0.047258029381434113
1191
+ ],
1192
+ "legacy_specificity_ci95": [
1193
+ -0.03596077660719554,
1194
+ 0.031358484427134195
1195
+ ]
1196
+ },
1197
+ {
1198
+ "panel_id": 5,
1199
+ "gain_delta": 0.05335178718190445,
1200
+ "candidate_target": 0.9746085007985433,
1201
+ "candidate_specificity": 0.9158469835917155,
1202
+ "target_delta_mean": 0.09370013078053792,
1203
+ "specificity_delta_mean": 0.06990321477254231,
1204
+ "point_gate": true,
1205
+ "legacy_target_ci95": [
1206
+ 0.043214563528696695,
1207
+ 0.15051211416721338
1208
+ ],
1209
+ "legacy_specificity_ci95": [
1210
+ 0.016624276836713154,
1211
+ 0.12988197704156237
1212
+ ]
1213
+ }
1214
+ ],
1215
+ "primary_gate": true
1216
+ },
1217
+ "EN_ZH": {
1218
+ "mode": "EN_ZH",
1219
+ "n": 96,
1220
+ "gain_delta": 0.007485849666097735,
1221
+ "candidate_target": 0.07339854290088017,
1222
+ "candidate_specificity": 0.051707759499549866,
1223
+ "target_delta_mean": 0.015181037286917368,
1224
+ "specificity_delta_mean": 0.010142996907234192,
1225
+ "example_target_ci95": [
1226
+ 0.0068094111979007735,
1227
+ 0.023351011673609416
1228
+ ],
1229
+ "example_specificity_ci95": [
1230
+ 0.0022034735729297003,
1231
+ 0.017517954918245475
1232
+ ],
1233
+ "panel_cluster_target_ci95": [
1234
+ 0.006898750861485799,
1235
+ 0.021422329048315685
1236
+ ],
1237
+ "panel_cluster_specificity_ci95": [
1238
+ -0.002400733530521393,
1239
+ 0.022176635762055714
1240
+ ],
1241
+ "panel_target_means": [
1242
+ -0.003773927688598633,
1243
+ 0.018737763166427612,
1244
+ 0.018995821475982666,
1245
+ 0.026334822177886963,
1246
+ 0.01606909930706024,
1247
+ 0.014722645282745361
1248
+ ],
1249
+ "panel_specificity_means": [
1250
+ -0.01366385817527771,
1251
+ 0.026628553867340088,
1252
+ 0.02599853277206421,
1253
+ 0.019309580326080322,
1254
+ 0.008496060967445374,
1255
+ -0.005910888314247131
1256
+ ],
1257
+ "point_replication_count": 6,
1258
+ "point_replication_required": 4,
1259
+ "replication_ok": true,
1260
+ "families": {
1261
+ "A": {
1262
+ "base_gain": 0.039147895357552066,
1263
+ "candidate_gain": 0.05153552506762786,
1264
+ "gain_delta": 0.012387629710075794,
1265
+ "base_target": 0.057473172744115196,
1266
+ "candidate_target": 0.07838699718316396,
1267
+ "target_delta": 0.02091382443904876,
1268
+ "base_specificity": 0.04297110438346863,
1269
+ "candidate_specificity": 0.05270524819691976,
1270
+ "specificity_delta": 0.009734143813451133,
1271
+ "gate": true
1272
+ },
1273
+ "B": {
1274
+ "base_gain": 0.03695582763482932,
1275
+ "candidate_gain": 0.03996818562884985,
1276
+ "gain_delta": 0.0030123579940205328,
1277
+ "base_target": 0.058961838483810425,
1278
+ "candidate_target": 0.06841008861859639,
1279
+ "target_delta": 0.009448250134785965,
1280
+ "base_specificity": 0.04015842080116272,
1281
+ "candidate_specificity": 0.05071027080217997,
1282
+ "specificity_delta": 0.01055185000101725,
1283
+ "gate": true
1284
+ }
1285
+ },
1286
+ "panel_detail": [
1287
+ {
1288
+ "panel_id": 0,
1289
+ "gain_delta": -0.00011352235121285525,
1290
+ "candidate_target": 0.05571025609970093,
1291
+ "candidate_specificity": 0.03659215569496155,
1292
+ "target_delta_mean": -0.003773927688598633,
1293
+ "specificity_delta_mean": -0.01366385817527771,
1294
+ "point_gate": true,
1295
+ "legacy_target_ci95": [
1296
+ -0.028366909176111222,
1297
+ 0.018816736340522756
1298
+ ],
1299
+ "legacy_specificity_ci95": [
1300
+ -0.03884902223944664,
1301
+ 0.005850633233785628
1302
+ ]
1303
+ },
1304
+ {
1305
+ "panel_id": 1,
1306
+ "gain_delta": 0.007372639365938852,
1307
+ "candidate_target": 0.08341524004936218,
1308
+ "candidate_specificity": 0.07252475619316101,
1309
+ "target_delta_mean": 0.018737763166427612,
1310
+ "specificity_delta_mean": 0.026628553867340088,
1311
+ "point_gate": true,
1312
+ "legacy_target_ci95": [
1313
+ 0.006475359946489335,
1314
+ 0.03126830980181694
1315
+ ],
1316
+ "legacy_specificity_ci95": [
1317
+ 0.015103788673877717,
1318
+ 0.03779461160302162
1319
+ ]
1320
+ },
1321
+ {
1322
+ "panel_id": 2,
1323
+ "gain_delta": 0.0014599648417886607,
1324
+ "candidate_target": 0.07599690556526184,
1325
+ "candidate_specificity": 0.08374840021133423,
1326
+ "target_delta_mean": 0.018995821475982666,
1327
+ "specificity_delta_mean": 0.02599853277206421,
1328
+ "point_gate": true,
1329
+ "legacy_target_ci95": [
1330
+ -0.004894039779901505,
1331
+ 0.04222585409879684
1332
+ ],
1333
+ "legacy_specificity_ci95": [
1334
+ 0.008628686517477037,
1335
+ 0.04334390461444854
1336
+ ]
1337
+ },
1338
+ {
1339
+ "panel_id": 3,
1340
+ "gain_delta": 0.011331352188085054,
1341
+ "candidate_target": 0.049705058336257935,
1342
+ "candidate_specificity": 0.03222334384918213,
1343
+ "target_delta_mean": 0.026334822177886963,
1344
+ "specificity_delta_mean": 0.019309580326080322,
1345
+ "point_gate": true,
1346
+ "legacy_target_ci95": [
1347
+ 0.007268186658620835,
1348
+ 0.05148636102676389
1349
+ ],
1350
+ "legacy_specificity_ci95": [
1351
+ 0.0053455159068107605,
1352
+ 0.036429470032453524
1353
+ ]
1354
+ },
1355
+ {
1356
+ "panel_id": 4,
1357
+ "gain_delta": 0.011756299120513576,
1358
+ "candidate_target": 0.062284573912620544,
1359
+ "candidate_specificity": 0.035676583647727966,
1360
+ "target_delta_mean": 0.01606909930706024,
1361
+ "specificity_delta_mean": 0.008496060967445374,
1362
+ "point_gate": true,
1363
+ "legacy_target_ci95": [
1364
+ 0.0025138799101114273,
1365
+ 0.031466767191886895
1366
+ ],
1367
+ "legacy_specificity_ci95": [
1368
+ 0.0009853746742010117,
1369
+ 0.01580255851149559
1370
+ ]
1371
+ },
1372
+ {
1373
+ "panel_id": 5,
1374
+ "gain_delta": 0.011705209169660835,
1375
+ "candidate_target": 0.11327922344207764,
1376
+ "candidate_specificity": 0.04948131740093231,
1377
+ "target_delta_mean": 0.014722645282745361,
1378
+ "specificity_delta_mean": -0.005910888314247131,
1379
+ "point_gate": true,
1380
+ "legacy_target_ci95": [
1381
+ -0.004307673871517181,
1382
+ 0.03372161239385604
1383
+ ],
1384
+ "legacy_specificity_ci95": [
1385
+ -0.02779782451689243,
1386
+ 0.016113350912928575
1387
+ ]
1388
+ }
1389
+ ],
1390
+ "primary_gate": true
1391
+ }
1392
+ },
1393
+ "primary_all": true,
1394
+ "replication_all": true,
1395
+ "ok": true
1396
+ },
1397
+ "deconfounded_vs_parent": {
1398
+ "label": "FORMAL_P3B_R1_CAND_VS_P3A_R3_DECONFOUNDED",
1399
+ "detail": {
1400
+ "ZH_ZH": {
1401
+ "mode": "ZH_ZH",
1402
+ "n": 72,
1403
+ "base_full_nll": 6.737897131178114,
1404
+ "candidate_full_nll": 6.4170464343494835,
1405
+ "full_relative_change": -0.04761881794602733,
1406
+ "candidate_own_gain": 0.0436614931519108,
1407
+ "candidate_target": 0.06549638509750366,
1408
+ "candidate_specificity": 0.05128541919920179,
1409
+ "target_delta_mean": 0.007473157511817085,
1410
+ "specificity_delta_mean": 0.01798399289449056,
1411
+ "panel_cluster_target_ci95": [
1412
+ -0.007464190324147542,
1413
+ 0.025722503662109375
1414
+ ],
1415
+ "panel_cluster_specificity_ci95": [
1416
+ 0.006972445382012262,
1417
+ 0.030458165539635554
1418
+ ],
1419
+ "point_replication_count": 6,
1420
+ "replication_ok": true,
1421
+ "families": {
1422
+ "A": {
1423
+ "base_full_nll": 6.574517316288418,
1424
+ "candidate_full_nll": 6.243793977631463,
1425
+ "full_relative_change": -0.05030382045501426,
1426
+ "candidate_own_gain": 0.03250185982317791,
1427
+ "candidate_target": 0.04570333162943522,
1428
+ "candidate_specificity": 0.041913138495551214,
1429
+ "target_delta": 0.0045194096035427525,
1430
+ "specificity_delta": 0.01701329814063178,
1431
+ "gate": true
1432
+ },
1433
+ "B": {
1434
+ "base_full_nll": 6.90127694606781,
1435
+ "candidate_full_nll": 6.590298891067505,
1436
+ "full_relative_change": -0.04506094414563284,
1437
+ "candidate_own_gain": 0.053999447953451636,
1438
+ "candidate_target": 0.0852894385655721,
1439
+ "candidate_specificity": 0.06065769990285238,
1440
+ "target_delta": 0.010426905420091406,
1441
+ "specificity_delta": 0.018954687648349337,
1442
+ "gate": true
1443
+ }
1444
+ },
1445
+ "panel_detail": [
1446
+ {
1447
+ "panel_id": 0,
1448
+ "candidate_own_gain": 0.047375723603134266,
1449
+ "full_relative_change": -0.05091141163144613,
1450
+ "candidate_target": 0.0562061071395874,
1451
+ "candidate_specificity": 0.04162287712097168,
1452
+ "target_delta_mean": -0.017896453539530437,
1453
+ "specificity_delta_mean": -0.0020980040232340493,
1454
+ "point_gate": true
1455
+ },
1456
+ {
1457
+ "panel_id": 1,
1458
+ "candidate_own_gain": 0.07528394778406411,
1459
+ "full_relative_change": -0.06642184230748736,
1460
+ "candidate_target": 0.15066893895467123,
1461
+ "candidate_specificity": 0.10484512646993001,
1462
+ "target_delta_mean": 0.0484769344329834,
1463
+ "specificity_delta_mean": 0.046238064765930176,
1464
+ "point_gate": true
1465
+ },
1466
+ {
1467
+ "panel_id": 2,
1468
+ "candidate_own_gain": 0.028296658257990815,
1469
+ "full_relative_change": -0.060181713825177785,
1470
+ "candidate_target": 0.02845303217569987,
1471
+ "candidate_specificity": 0.03062887986501058,
1472
+ "target_delta_mean": 0.00839853286743164,
1473
+ "specificity_delta_mean": 0.019729097684224445,
1474
+ "point_gate": true
1475
+ },
1476
+ {
1477
+ "panel_id": 3,
1478
+ "candidate_own_gain": 0.045387304148593904,
1479
+ "full_relative_change": -0.043448492959016954,
1480
+ "candidate_target": 0.08048812548319499,
1481
+ "candidate_specificity": 0.06799769401550293,
1482
+ "target_delta_mean": -0.00014468034108479819,
1483
+ "specificity_delta_mean": 0.013141592343648275,
1484
+ "point_gate": true
1485
+ },
1486
+ {
1487
+ "panel_id": 4,
1488
+ "candidate_own_gain": 0.03683992123163559,
1489
+ "full_relative_change": -0.03163618531371356,
1490
+ "candidate_target": 0.051390886306762695,
1491
+ "candidate_specificity": 0.03930731614430746,
1492
+ "target_delta_mean": -0.007892847061157227,
1493
+ "specificity_delta_mean": 0.008670488993326822,
1494
+ "point_gate": true
1495
+ },
1496
+ {
1497
+ "panel_id": 5,
1498
+ "candidate_own_gain": 0.030580614840427477,
1499
+ "full_relative_change": -0.03464896188555858,
1500
+ "candidate_target": 0.025771220525105793,
1501
+ "candidate_specificity": 0.023310621579488117,
1502
+ "target_delta_mean": 0.013897458712259928,
1503
+ "specificity_delta_mean": 0.022222717603047688,
1504
+ "point_gate": true
1505
+ }
1506
+ ],
1507
+ "primary_gate": true
1508
+ },
1509
+ "ZH_EN": {
1510
+ "mode": "ZH_EN",
1511
+ "n": 72,
1512
+ "base_full_nll": 5.9530688060654535,
1513
+ "candidate_full_nll": 5.265246931049559,
1514
+ "full_relative_change": -0.11554072318382881,
1515
+ "candidate_own_gain": 0.23569969881695246,
1516
+ "candidate_target": 0.3804735276434157,
1517
+ "candidate_specificity": 0.24657265014118618,
1518
+ "target_delta_mean": 0.04447433021333483,
1519
+ "specificity_delta_mean": 0.01304555270406935,
1520
+ "panel_cluster_target_ci95": [
1521
+ 0.024514797661039565,
1522
+ 0.06770929363038805
1523
+ ],
1524
+ "panel_cluster_specificity_ci95": [
1525
+ -0.014596949021021524,
1526
+ 0.04138273994127909
1527
+ ],
1528
+ "point_replication_count": 4,
1529
+ "replication_ok": true,
1530
+ "families": {
1531
+ "A": {
1532
+ "base_full_nll": 5.744940254423353,
1533
+ "candidate_full_nll": 5.033801800674862,
1534
+ "full_relative_change": -0.12378517830554386,
1535
+ "candidate_own_gain": 0.25718387458507785,
1536
+ "candidate_target": 0.4266500340567695,
1537
+ "candidate_specificity": 0.2818116611904568,
1538
+ "target_delta": 0.04816544055938721,
1539
+ "specificity_delta": 0.012725373109181704,
1540
+ "gate": true
1541
+ },
1542
+ "B": {
1543
+ "base_full_nll": 6.161197357707554,
1544
+ "candidate_full_nll": 5.496692061424255,
1545
+ "full_relative_change": -0.10785327229487521,
1546
+ "candidate_own_gain": 0.2149049185960642,
1547
+ "candidate_target": 0.33429702123006183,
1548
+ "candidate_specificity": 0.21133363909191555,
1549
+ "target_delta": 0.04078321986728245,
1550
+ "specificity_delta": 0.013365732298956962,
1551
+ "gate": true
1552
+ }
1553
+ },
1554
+ "panel_detail": [
1555
+ {
1556
+ "panel_id": 0,
1557
+ "candidate_own_gain": 0.24806675338573875,
1558
+ "full_relative_change": -0.14510415064653956,
1559
+ "candidate_target": 0.24146819114685059,
1560
+ "candidate_specificity": 0.06570986906687419,
1561
+ "target_delta_mean": 0.03848807017008463,
1562
+ "specificity_delta_mean": 0.014475305875142416,
1563
+ "point_gate": true
1564
+ },
1565
+ {
1566
+ "panel_id": 1,
1567
+ "candidate_own_gain": 0.20727107046226367,
1568
+ "full_relative_change": -0.12766853572898812,
1569
+ "candidate_target": 0.45127246777216595,
1570
+ "candidate_specificity": 0.39519943793614704,
1571
+ "target_delta_mean": 0.06698761383692424,
1572
+ "specificity_delta_mean": 0.04053610563278198,
1573
+ "point_gate": true
1574
+ },
1575
+ {
1576
+ "panel_id": 2,
1577
+ "candidate_own_gain": 0.2734048203093709,
1578
+ "full_relative_change": -0.10720527769759589,
1579
+ "candidate_target": 0.1940412720044454,
1580
+ "candidate_specificity": -0.022633453210194904,
1581
+ "target_delta_mean": 0.026739617188771565,
1582
+ "specificity_delta_mean": -0.004928410053253174,
1583
+ "point_gate": false
1584
+ },
1585
+ {
1586
+ "panel_id": 3,
1587
+ "candidate_own_gain": 0.2199320273396652,
1588
+ "full_relative_change": -0.13391310631829811,
1589
+ "candidate_target": 0.22534803549448648,
1590
+ "candidate_specificity": 0.07202865680058797,
1591
+ "target_delta_mean": 0.017892658710479736,
1592
+ "specificity_delta_mean": -0.04073824485143026,
1593
+ "point_gate": false
1594
+ },
1595
+ {
1596
+ "panel_id": 4,
1597
+ "candidate_own_gain": 0.17310537969980566,
1598
+ "full_relative_change": -0.05444761127570594,
1599
+ "candidate_target": 0.1961026986440023,
1600
+ "candidate_specificity": 0.053284406661987305,
1601
+ "target_delta_mean": 0.023037890593210857,
1602
+ "specificity_delta_mean": -0.0009746551513671875,
1603
+ "point_gate": true
1604
+ },
1605
+ {
1606
+ "panel_id": 5,
1607
+ "candidate_own_gain": 0.2948621536788221,
1608
+ "full_relative_change": -0.12350967171689363,
1609
+ "candidate_target": 0.9746085007985433,
1610
+ "candidate_specificity": 0.9158469835917155,
1611
+ "target_delta_mean": 0.09370013078053792,
1612
+ "specificity_delta_mean": 0.06990321477254231,
1613
+ "point_gate": true
1614
+ }
1615
+ ],
1616
+ "primary_gate": true
1617
+ },
1618
+ "EN_ZH": {
1619
+ "mode": "EN_ZH",
1620
+ "n": 96,
1621
+ "base_full_nll": 7.000802204012871,
1622
+ "candidate_full_nll": 6.507285945117474,
1623
+ "full_relative_change": -0.07049424401856588,
1624
+ "candidate_own_gain": 0.045496215136885926,
1625
+ "candidate_target": 0.07339854290088017,
1626
+ "candidate_specificity": 0.051707759499549866,
1627
+ "target_delta_mean": 0.015181037286917368,
1628
+ "specificity_delta_mean": 0.010142996907234192,
1629
+ "panel_cluster_target_ci95": [
1630
+ 0.0068557411432266235,
1631
+ 0.021422329048315685
1632
+ ],
1633
+ "panel_cluster_specificity_ci95": [
1634
+ -0.0030719712376594543,
1635
+ 0.022071632246176403
1636
+ ],
1637
+ "point_replication_count": 6,
1638
+ "replication_ok": true,
1639
+ "families": {
1640
+ "A": {
1641
+ "base_full_nll": 6.727785795927048,
1642
+ "candidate_full_nll": 6.180308774113655,
1643
+ "full_relative_change": -0.08137551319556446,
1644
+ "candidate_own_gain": 0.05153552506762786,
1645
+ "candidate_target": 0.07838699718316396,
1646
+ "candidate_specificity": 0.05270524819691976,
1647
+ "target_delta": 0.02091382443904876,
1648
+ "specificity_delta": 0.009734143813451133,
1649
+ "gate": true
1650
+ },
1651
+ "B": {
1652
+ "base_full_nll": 7.273818612098694,
1653
+ "candidate_full_nll": 6.834263116121292,
1654
+ "full_relative_change": -0.0604298126497518,
1655
+ "candidate_own_gain": 0.03996818562884985,
1656
+ "candidate_target": 0.06841008861859639,
1657
+ "candidate_specificity": 0.05071027080217997,
1658
+ "target_delta": 0.009448250134785965,
1659
+ "specificity_delta": 0.01055185000101725,
1660
+ "gate": true
1661
+ }
1662
+ },
1663
+ "panel_detail": [
1664
+ {
1665
+ "panel_id": 0,
1666
+ "candidate_own_gain": 0.032268188478693116,
1667
+ "full_relative_change": -0.07247434506022614,
1668
+ "candidate_target": 0.05571025609970093,
1669
+ "candidate_specificity": 0.03659215569496155,
1670
+ "target_delta_mean": -0.003773927688598633,
1671
+ "specificity_delta_mean": -0.01366385817527771,
1672
+ "point_gate": true
1673
+ },
1674
+ {
1675
+ "panel_id": 1,
1676
+ "candidate_own_gain": 0.028811353945802094,
1677
+ "full_relative_change": -0.07741196739813626,
1678
+ "candidate_target": 0.08341524004936218,
1679
+ "candidate_specificity": 0.07252475619316101,
1680
+ "target_delta_mean": 0.018737763166427612,
1681
+ "specificity_delta_mean": 0.026628553867340088,
1682
+ "point_gate": true
1683
+ },
1684
+ {
1685
+ "panel_id": 2,
1686
+ "candidate_own_gain": 0.044578246479117185,
1687
+ "full_relative_change": -0.07240993664053064,
1688
+ "candidate_target": 0.07599690556526184,
1689
+ "candidate_specificity": 0.08374840021133423,
1690
+ "target_delta_mean": 0.018995821475982666,
1691
+ "specificity_delta_mean": 0.02599853277206421,
1692
+ "point_gate": true
1693
+ },
1694
+ {
1695
+ "panel_id": 3,
1696
+ "candidate_own_gain": 0.032977442655203006,
1697
+ "full_relative_change": -0.08107808992822678,
1698
+ "candidate_target": 0.049705058336257935,
1699
+ "candidate_specificity": 0.03222334384918213,
1700
+ "target_delta_mean": 0.026334822177886963,
1701
+ "specificity_delta_mean": 0.019309580326080322,
1702
+ "point_gate": true
1703
+ },
1704
+ {
1705
+ "panel_id": 4,
1706
+ "candidate_own_gain": 0.053043357365717386,
1707
+ "full_relative_change": -0.04887103384384985,
1708
+ "candidate_target": 0.062284573912620544,
1709
+ "candidate_specificity": 0.035676583647727966,
1710
+ "target_delta_mean": 0.01606909930706024,
1711
+ "specificity_delta_mean": 0.008496060967445374,
1712
+ "point_gate": true
1713
+ },
1714
+ {
1715
+ "panel_id": 5,
1716
+ "candidate_own_gain": 0.08130855053261032,
1717
+ "full_relative_change": -0.07146789877146358,
1718
+ "candidate_target": 0.11327922344207764,
1719
+ "candidate_specificity": 0.04948131740093231,
1720
+ "target_delta_mean": 0.014722645282745361,
1721
+ "specificity_delta_mean": -0.005910888314247131,
1722
+ "point_gate": true
1723
+ }
1724
+ ],
1725
+ "primary_gate": true
1726
+ }
1727
+ },
1728
+ "primary_all": true,
1729
+ "replication_all": true,
1730
+ "ok": true
1731
+ },
1732
+ "q2_deconfounded": {
1733
+ "label": "FORMAL_P3B_R1_CAND_VS_P3A_R3_Q2_DECONFOUNDED",
1734
+ "own_gain": 0.12909004528402776,
1735
+ "base_full_nll": 8.06357891112566,
1736
+ "candidate_full_nll": 7.917149451871713,
1737
+ "full_relative_change": -0.018159363338270597,
1738
+ "candidate_target_penalty": 0.18939631432294934,
1739
+ "candidate_specificity_abs": 0.22796306510766406,
1740
+ "target_delta": 0.002167778710524537,
1741
+ "specificity_delta": 0.004063909252485232,
1742
+ "by_len_gain": {
1743
+ "1024": 0.1474320735567864,
1744
+ "1536": 0.11008750004838665,
1745
+ "2048": 0.1311460978277645
1746
+ },
1747
+ "legacy_target_attribution": 0.16139243783270416,
1748
+ "legacy_specificity_normalized": 0.19425676230851183,
1749
+ "by_len_ok": true,
1750
+ "ok": true
1751
+ },
1752
+ "q2_legacy_ratio_diagnostic": {
1753
+ "gain_retention_ok": true,
1754
+ "target_attribution_ok": false,
1755
+ "specificity_normalized_ok": true,
1756
+ "ok": false
1757
+ },
1758
+ "real_relative": {
1759
+ "general": -0.000433838854945725,
1760
+ "en_stream": 0.0021854971250197803,
1761
+ "zh": 0.006853909271450417,
1762
+ "code": 0.0003906391192981273,
1763
+ "reasoning": -0.00045130718358133744,
1764
+ "long_en": 0.0022822840144915762,
1765
+ "long_zh": 0.006413945415791718,
1766
+ "code_stream": 0.0016495649746981677
1767
+ },
1768
+ "real_composite": 0.0019138875120947656,
1769
+ "value_ok": false,
1770
+ "q2_ok": true,
1771
+ "dtn_structure_ok": true,
1772
+ "strict_causality_ok": true,
1773
+ "structural_safety_ok": true,
1774
+ "deconfounded_memory_ok": true,
1775
+ "qualified": false,
1776
+ "causality": [
1777
+ {
1778
+ "kind": "OLD",
1779
+ "seq_len": 512,
1780
+ "max_abs_prefix_logit_diff": 0.0,
1781
+ "mean_abs_prefix_logit_diff": 0.0
1782
+ },
1783
+ {
1784
+ "kind": "OLD",
1785
+ "seq_len": 1024,
1786
+ "max_abs_prefix_logit_diff": 0.0,
1787
+ "mean_abs_prefix_logit_diff": 0.0
1788
+ },
1789
+ {
1790
+ "kind": "OLD",
1791
+ "seq_len": 1536,
1792
+ "max_abs_prefix_logit_diff": 0.0,
1793
+ "mean_abs_prefix_logit_diff": 0.0
1794
+ },
1795
+ {
1796
+ "kind": "OLD",
1797
+ "seq_len": 2048,
1798
+ "max_abs_prefix_logit_diff": 0.0,
1799
+ "mean_abs_prefix_logit_diff": 0.0
1800
+ },
1801
+ {
1802
+ "kind": "CHINESE",
1803
+ "seq_len": 512,
1804
+ "max_abs_prefix_logit_diff": 0.0,
1805
+ "mean_abs_prefix_logit_diff": 0.0
1806
+ },
1807
+ {
1808
+ "kind": "CHINESE",
1809
+ "seq_len": 1024,
1810
+ "max_abs_prefix_logit_diff": 0.0,
1811
+ "mean_abs_prefix_logit_diff": 0.0
1812
+ },
1813
+ {
1814
+ "kind": "CHINESE",
1815
+ "seq_len": 1536,
1816
+ "max_abs_prefix_logit_diff": 0.0,
1817
+ "mean_abs_prefix_logit_diff": 0.0
1818
+ },
1819
+ {
1820
+ "kind": "CHINESE",
1821
+ "seq_len": 2048,
1822
+ "max_abs_prefix_logit_diff": 0.0,
1823
+ "mean_abs_prefix_logit_diff": 0.0
1824
+ },
1825
+ {
1826
+ "kind": "MIXED",
1827
+ "seq_len": 512,
1828
+ "max_abs_prefix_logit_diff": 0.0,
1829
+ "mean_abs_prefix_logit_diff": 0.0
1830
+ },
1831
+ {
1832
+ "kind": "MIXED",
1833
+ "seq_len": 1024,
1834
+ "max_abs_prefix_logit_diff": 0.0,
1835
+ "mean_abs_prefix_logit_diff": 0.0
1836
+ },
1837
+ {
1838
+ "kind": "MIXED",
1839
+ "seq_len": 1536,
1840
+ "max_abs_prefix_logit_diff": 0.0,
1841
+ "mean_abs_prefix_logit_diff": 0.0
1842
+ },
1843
+ {
1844
+ "kind": "MIXED",
1845
+ "seq_len": 2048,
1846
+ "max_abs_prefix_logit_diff": 0.0,
1847
+ "mean_abs_prefix_logit_diff": 0.0
1848
+ }
1849
+ ]
1850
+ },
1851
+ "gates": {
1852
+ "phase3a_r3_parent_verdict_exact": true,
1853
+ "phase3a_r3_parent_loadback_ok": true,
1854
+ "q2_ruler_calibrated": true,
1855
+ "context_preflight_ok": true,
1856
+ "phase3b_parent_valid": true,
1857
+ "branch_run": true,
1858
+ "optimizer_resumed": true,
1859
+ "value_ok": false,
1860
+ "q2_ok": true,
1861
+ "dtn_structure_ok": true,
1862
+ "strict_causality_ok": true,
1863
+ "structural_safety_ok": true,
1864
+ "deconfounded_memory_ok": true,
1865
+ "qualified": false,
1866
+ "loadback_ok": null
1867
+ },
1868
+ "sidecar_sha256": null,
1869
+ "optimizer_sha256": null,
1870
+ "loadback_maxdiff": null,
1871
+ "VERDICT": "FORMAL_BILINGUAL_CONTINUATION_PHASE3B_R1_VALUE_NOT_PROMOTABLE_HOLD"
1872
+ }
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_en_zh.csv ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,7.678217887878418,7.46396541595459,0.06457233428955078,-0.019425392150878906,0.08399772644042969,1.0,1.0
3
+ 0,A,5.452549934387207,5.3381123542785645,0.09281778335571289,-0.036951541900634766,0.12976932525634766,1.0,1.0
4
+ 0,A,6.240480899810791,5.86515998840332,-0.0016422271728515625,0.011396408081054688,-0.01303863525390625,0.0,0.0
5
+ 0,A,5.732546806335449,5.933196067810059,0.12087345123291016,-0.04400014877319336,0.16487360000610352,1.0,1.0
6
+ 0,A,6.298272132873535,6.24806022644043,0.046721458435058594,0.04829263687133789,-0.0015711784362792969,1.0,0.0
7
+ 0,A,7.491131782531738,7.480237007141113,0.08556127548217773,0.014319419860839844,0.07124185562133789,1.0,1.0
8
+ 0,A,6.69389533996582,6.633288860321045,0.0006175041198730469,-0.01850271224975586,0.019120216369628906,1.0,1.0
9
+ 0,A,6.589087009429932,6.248635292053223,0.07155561447143555,0.02684497833251953,0.044710636138916016,1.0,1.0
10
+ 0,B,6.616510391235352,6.557046890258789,0.006217002868652344,0.0038471221923828125,0.0023698806762695312,1.0,1.0
11
+ 0,B,7.481973648071289,6.881326675415039,0.2677121162414551,0.014667034149169922,0.25304508209228516,1.0,1.0
12
+ 0,B,7.255301475524902,6.400547981262207,0.031158447265625,0.17830467224121094,-0.14714622497558594,1.0,0.0
13
+ 0,B,6.553749084472656,6.630605697631836,0.03830718994140625,-0.07030153274536133,0.10860872268676758,1.0,1.0
14
+ 0,B,7.3160481452941895,7.40040397644043,0.005306243896484375,-0.0079345703125,0.013240814208984375,1.0,1.0
15
+ 0,B,6.85899019241333,6.317178726196289,0.037438392639160156,0.05499839782714844,-0.01756000518798828,1.0,0.0
16
+ 0,B,7.292280197143555,7.105258464813232,0.0014901161193847656,-0.04417276382446289,0.045662879943847656,1.0,1.0
17
+ 0,B,7.884747505187988,7.389040946960449,0.08304023742675781,0.03626871109008789,0.04677152633666992,1.0,1.0
18
+ 1,A,5.947569847106934,5.385305404663086,0.04633617401123047,0.07881784439086914,-0.03248167037963867,1.0,0.0
19
+ 1,A,6.397292137145996,6.339799404144287,0.13395214080810547,0.022853851318359375,0.1110982894897461,1.0,1.0
20
+ 1,A,9.076704025268555,9.155862808227539,0.0005826950073242188,-0.001369476318359375,0.0019521713256835938,1.0,1.0
21
+ 1,A,9.550105094909668,9.272150039672852,0.13364028930664062,0.01784229278564453,0.1157979965209961,1.0,1.0
22
+ 1,A,6.30735969543457,6.347892761230469,0.04815053939819336,0.03820991516113281,0.009940624237060547,1.0,1.0
23
+ 1,A,7.729748725891113,7.300844669342041,0.1696019172668457,0.04746103286743164,0.12214088439941406,1.0,1.0
24
+ 1,A,7.141384124755859,7.340757369995117,-0.0008749961853027344,-0.03224897384643555,0.03137397766113281,0.0,1.0
25
+ 1,A,6.422872543334961,6.207391738891602,0.09424686431884766,0.027240753173828125,0.06700611114501953,1.0,1.0
26
+ 1,B,6.419175624847412,6.22465705871582,0.0251922607421875,-0.014435291290283203,0.0396275520324707,1.0,1.0
27
+ 1,B,7.38688850402832,7.335507392883301,0.06978321075439453,-0.0015802383422851562,0.07136344909667969,1.0,1.0
28
+ 1,B,7.62694787979126,7.3934407234191895,0.05201387405395508,0.020865917205810547,0.03114795684814453,1.0,1.0
29
+ 1,B,6.7632856369018555,6.467791557312012,0.022744178771972656,0.004199028015136719,0.018545150756835938,1.0,1.0
30
+ 1,B,9.125236511230469,9.062200546264648,0.03247261047363281,0.019539833068847656,0.012932777404785156,1.0,1.0
31
+ 1,B,6.525033473968506,6.209102630615234,0.08874893188476562,0.06253242492675781,0.026216506958007812,1.0,1.0
32
+ 1,B,10.459067344665527,10.265989303588867,0.10541057586669922,0.017406463623046875,0.08800411224365234,1.0,1.0
33
+ 1,B,9.074939727783203,9.030388832092285,0.012838363647460938,-0.006834983825683594,0.01967334747314453,1.0,1.0
34
+ 2,A,5.317070007324219,4.621892929077148,0.13053226470947266,-0.019850730895996094,0.15038299560546875,1.0,1.0
35
+ 2,A,8.094897270202637,7.8205485343933105,0.1340808868408203,0.022320270538330078,0.11176061630249023,1.0,1.0
36
+ 2,A,5.128754615783691,5.007360458374023,-0.029725074768066406,0.030565261840820312,-0.06029033660888672,0.0,0.0
37
+ 2,A,7.09544563293457,6.50754451751709,0.0731954574584961,-0.008225440979003906,0.0814208984375,1.0,1.0
38
+ 2,A,6.306672096252441,5.306008338928223,0.04069948196411133,-0.006548404693603516,0.047247886657714844,1.0,1.0
39
+ 2,A,7.5393829345703125,8.067914962768555,1.71661376953125e-05,-0.1913919448852539,0.19140911102294922,1.0,1.0
40
+ 2,A,6.6106743812561035,6.6024699211120605,0.017751216888427734,-0.01141214370727539,0.029163360595703125,1.0,1.0
41
+ 2,A,5.966578960418701,5.765558242797852,0.04972267150878906,0.0065326690673828125,0.04319000244140625,1.0,1.0
42
+ 2,B,6.656954765319824,6.190498352050781,0.006591796875,0.011243820190429688,-0.0046520233154296875,1.0,0.0
43
+ 2,B,6.798083305358887,6.602506637573242,0.000110626220703125,0.0009641647338867188,-0.0008535385131835938,1.0,0.0
44
+ 2,B,7.10511589050293,6.74705171585083,0.015330791473388672,-0.009139060974121094,0.024469852447509766,1.0,1.0
45
+ 2,B,6.867838382720947,6.343501091003418,0.04455089569091797,0.054032325744628906,-0.009481430053710938,1.0,0.0
46
+ 2,B,9.47555923461914,9.33703899383545,0.12190914154052734,0.047229766845703125,0.07467937469482422,1.0,1.0
47
+ 2,B,7.167082786560059,6.9640631675720215,0.13329124450683594,-0.0031995773315429688,0.1364908218383789,1.0,1.0
48
+ 2,B,8.99799919128418,8.66627311706543,0.0698690414428711,0.024852752685546875,0.04501628875732422,1.0,1.0
49
+ 2,B,9.275179862976074,8.920185089111328,0.10408973693847656,0.040045738220214844,0.06404399871826172,1.0,1.0
50
+ 3,A,6.609012603759766,6.342267036437988,0.01928997039794922,0.037392616271972656,-0.018102645874023438,1.0,0.0
51
+ 3,A,7.082230091094971,6.677297592163086,-0.012838363647460938,-0.020959854125976562,0.008121490478515625,0.0,1.0
52
+ 3,A,6.9056596755981445,6.351950645446777,0.016850948333740234,0.04604673385620117,-0.029195785522460938,1.0,0.0
53
+ 3,A,5.002518653869629,5.010200023651123,0.05466413497924805,0.04609060287475586,0.008573532104492188,1.0,1.0
54
+ 3,A,9.673751831054688,9.616987228393555,0.05697822570800781,-0.0024204254150390625,0.059398651123046875,1.0,1.0
55
+ 3,A,9.132783889770508,8.997415542602539,0.037451744079589844,0.023906707763671875,0.013545036315917969,1.0,1.0
56
+ 3,A,6.615786552429199,6.466383934020996,-0.014359474182128906,-0.01901102066040039,0.004651546478271484,0.0,1.0
57
+ 3,A,7.905846118927002,7.5411481857299805,0.036293983459472656,0.040772438049316406,-0.00447845458984375,1.0,0.0
58
+ 3,B,6.414668083190918,6.13961124420166,0.08511543273925781,0.021963119506835938,0.06315231323242188,1.0,1.0
59
+ 3,B,6.544261932373047,6.62485408782959,-0.05024290084838867,-0.013133525848388672,-0.037109375,0.0,0.0
60
+ 3,B,6.808510780334473,6.798374176025391,0.003963947296142578,-0.009405136108398438,0.013369083404541016,1.0,1.0
61
+ 3,B,7.757488250732422,7.623953342437744,0.039189815521240234,0.017314434051513672,0.021875381469726562,1.0,1.0
62
+ 3,B,6.956271648406982,6.834560394287109,0.059413909912109375,0.013451099395751953,0.04596281051635742,1.0,1.0
63
+ 3,B,9.534561157226562,9.42819881439209,0.0489959716796875,0.0066890716552734375,0.04230690002441406,1.0,1.0
64
+ 3,B,7.217948913574219,7.338128089904785,-0.003025054931640625,-0.025101184844970703,0.022076129913330078,0.0,1.0
65
+ 3,B,6.659966945648193,6.501213073730469,-0.003818511962890625,0.0037078857421875,-0.007526397705078125,0.0,0.0
66
+ 4,A,7.169363021850586,6.972837448120117,0.030511856079101562,0.01006174087524414,0.020450115203857422,1.0,1.0
67
+ 4,A,6.289265155792236,5.71426248550415,0.027493953704833984,0.05801534652709961,-0.030521392822265625,1.0,0.0
68
+ 4,A,7.050048828125,6.357890605926514,0.10403156280517578,0.09320735931396484,0.010824203491210938,1.0,1.0
69
+ 4,A,10.148063659667969,9.679438591003418,0.12281608581542969,0.049590110778808594,0.0732259750366211,1.0,1.0
70
+ 4,A,10.203150749206543,10.158278465270996,0.03126716613769531,0.0006723403930664062,0.030594825744628906,1.0,1.0
71
+ 4,A,9.198715209960938,9.317821502685547,-0.005623817443847656,-0.00453948974609375,-0.0010843276977539062,0.0,0.0
72
+ 4,A,5.287933826446533,4.516967296600342,0.08409500122070312,0.01053619384765625,0.07355880737304688,1.0,1.0
73
+ 4,A,6.650965690612793,6.7133049964904785,-0.0061321258544921875,-0.03223466873168945,0.026102542877197266,0.0,1.0
74
+ 4,B,7.344989776611328,6.902171611785889,0.029166698455810547,0.008011817932128906,0.02115488052368164,1.0,1.0
75
+ 4,B,6.812551021575928,6.400391578674316,0.008919715881347656,-0.00871419906616211,0.017633914947509766,1.0,1.0
76
+ 4,B,8.334236145019531,7.967215061187744,0.008607864379882812,0.016575336456298828,-0.007967472076416016,1.0,0.0
77
+ 4,B,8.620461463928223,8.474953651428223,0.03068065643310547,0.017465591430664062,0.013215065002441406,1.0,1.0
78
+ 4,B,6.27403450012207,6.223618030548096,-0.008331775665283203,-0.00013017654418945312,-0.00820159912109375,0.0,0.0
79
+ 4,B,6.983731269836426,6.498831748962402,0.14422178268432617,0.03406572341918945,0.11015605926513672,1.0,1.0
80
+ 4,B,8.868389129638672,8.760887145996094,0.09459400177001953,-0.0039501190185546875,0.09854412078857422,1.0,1.0
81
+ 4,B,8.093832015991211,7.578939437866211,0.04312896728515625,0.05592632293701172,-0.012797355651855469,1.0,0.0
82
+ 5,A,7.3377299308776855,6.6741790771484375,0.013226985931396484,0.07961225509643555,-0.06638526916503906,1.0,0.0
83
+ 5,A,5.269268989562988,4.074185371398926,0.14132356643676758,0.044884681701660156,0.09643888473510742,1.0,1.0
84
+ 5,A,7.009085655212402,6.511165618896484,0.028441429138183594,0.053784847259521484,-0.02534341812133789,1.0,0.0
85
+ 5,A,5.029563903808594,4.627500534057617,0.08101177215576172,0.0855264663696289,-0.0045146942138671875,1.0,0.0
86
+ 5,A,6.081977367401123,5.800189971923828,-0.0011911392211914062,-0.011307716369628906,0.0101165771484375,0.0,1.0
87
+ 5,A,7.8191375732421875,7.772547721862793,0.0413517951965332,0.030762195587158203,0.010589599609375,1.0,1.0
88
+ 5,A,5.959965229034424,5.625284194946289,0.10215950012207031,0.04722881317138672,0.054930686950683594,1.0,1.0
89
+ 5,A,7.850454330444336,7.154256820678711,0.2466106414794922,0.025710582733154297,0.2209000587463379,1.0,1.0
90
+ 5,B,8.958024024963379,8.667196273803711,0.11043357849121094,0.03315925598144531,0.07727432250976562,1.0,1.0
91
+ 5,B,7.993702411651611,7.722697734832764,0.03972339630126953,-0.004483699798583984,0.044207096099853516,1.0,1.0
92
+ 5,B,6.409242153167725,5.612635135650635,0.12479734420776367,0.0474700927734375,0.07732725143432617,1.0,1.0
93
+ 5,B,6.496814250946045,5.177661895751953,0.5187540054321289,0.16882038116455078,0.3499336242675781,1.0,1.0
94
+ 5,B,7.555140495300293,7.362888336181641,0.07226276397705078,0.009675979614257812,0.06258678436279297,1.0,1.0
95
+ 5,B,8.32861614227295,7.744071960449219,0.0016064643859863281,0.09716463088989258,-0.09555816650390625,1.0,0.0
96
+ 5,B,7.656891822814941,7.759779930114746,0.009038925170898438,-0.02195882797241211,0.030997753143310547,1.0,1.0
97
+ 5,B,6.932984352111816,6.558855056762695,0.04735422134399414,0.004580020904541016,0.042774200439453125,1.0,1.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_q2.csv ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seq_len,beta0_nll,full_nll,target_ko_nll,control_ko_nll
2
+ 1024,11.681079864501953,10.064379692077637,10.406393051147461,10.068502426147461
3
+ 1024,11.946613311767578,11.791950225830078,11.970440864562988,11.755873680114746
4
+ 1024,6.893057346343994,6.887356758117676,6.973759651184082,6.972630500793457
5
+ 1024,8.17722225189209,7.678732872009277,7.730384826660156,7.6296234130859375
6
+ 1024,7.430453777313232,6.9600911140441895,7.504617214202881,6.921084403991699
7
+ 1024,9.141239166259766,6.702821731567383,7.865261554718018,6.644792556762695
8
+ 1024,9.369712829589844,7.189952373504639,7.382763862609863,7.163773059844971
9
+ 1024,6.429317474365234,5.141022205352783,5.58845329284668,5.194845199584961
10
+ 1024,10.54366683959961,9.46331787109375,9.732038497924805,9.52609920501709
11
+ 1024,8.565290451049805,7.093481063842773,7.248098373413086,7.391826629638672
12
+ 1024,7.137778282165527,6.071161270141602,6.200719833374023,5.993310451507568
13
+ 1024,8.903650283813477,7.7621049880981445,8.0597562789917,7.813544750213623
14
+ 1024,9.960745811462402,9.056946754455566,9.365105628967285,9.082834243774414
15
+ 1024,10.669346809387207,8.625165939331055,8.835415840148926,8.522163391113281
16
+ 1024,7.972833633422852,5.102642059326172,4.950107574462891,5.00430965423584
17
+ 1024,8.75225830078125,7.4854302406311035,7.552045822143555,7.670525550842285
18
+ 1024,10.385374069213867,10.0960111618042,10.143210411071777,10.114904403686523
19
+ 1024,8.86821174621582,7.688052654266357,7.912784099578857,7.758638381958008
20
+ 1024,7.541798114776611,7.442835330963135,7.441481590270996,7.469773292541504
21
+ 1024,7.8579816818237305,6.316995143890381,6.518033027648926,6.423412322998047
22
+ 1024,7.93845272064209,7.300617218017578,7.23155403137207,7.355414390563965
23
+ 1024,9.987911224365234,9.117842674255371,9.20525074005127,8.888387680053711
24
+ 1024,7.924813747406006,6.311807632446289,6.528756141662598,6.253674507141113
25
+ 1024,7.9573073387146,6.018032550811768,5.9701738357543945,5.858170032501221
26
+ 1024,6.863306999206543,5.518589973449707,5.502043724060059,5.42186164855957
27
+ 1024,8.9175386428833,7.601015090942383,7.602419853210449,7.409663200378418
28
+ 1024,10.468033790588379,9.567885398864746,9.614399909973145,9.509234428405762
29
+ 1024,7.932055473327637,5.838249683380127,5.584637641906738,5.576749801635742
30
+ 1024,10.818845748901367,9.724992752075195,10.424306869506836,9.335984230041504
31
+ 1024,11.59780216217041,9.614324569702148,9.598760604858398,9.902355194091797
32
+ 1024,7.243391513824463,6.225881576538086,6.570094108581543,6.231611251831055
33
+ 1024,10.244147300720215,8.988358497619629,8.84627628326416,8.943971633911133
34
+ 1536,9.713953971862793,9.055341720581055,9.185951232910156,9.17008113861084
35
+ 1536,7.800434112548828,6.680333137512207,7.190445423126221,6.715548038482666
36
+ 1536,6.590101718902588,4.264629364013672,4.250024795532227,4.253407955169678
37
+ 1536,11.557890892028809,10.305682182312012,10.988985061645508,10.324501037597656
38
+ 1536,5.1359686851501465,4.577482223510742,4.398597717285156,4.688590049743652
39
+ 1536,10.009629249572754,8.932173728942871,9.260717391967773,8.907286643981934
40
+ 1536,10.615607261657715,8.525501251220703,8.54292106628418,8.065901756286621
41
+ 1536,11.608150482177734,10.921051025390625,11.187727928161621,11.04547119140625
42
+ 1536,10.56220531463623,9.196867942810059,9.2256498336792,8.961638450622559
43
+ 1536,9.353755950927734,9.987512588500977,9.816813468933105,10.05256462097168
44
+ 1536,12.129623413085938,11.775016784667969,11.875500679016113,11.726434707641602
45
+ 1536,10.825029373168945,10.299775123596191,10.303926467895508,10.193717956542969
46
+ 1536,6.567159175872803,6.246837139129639,6.371642589569092,5.943008899688721
47
+ 1536,8.827934265136719,6.803562164306641,7.941763877868652,6.713677406311035
48
+ 1536,10.555887222290039,10.714151382446289,10.750764846801758,10.739191055297852
49
+ 1536,10.983989715576172,10.079268455505371,10.04088020324707,10.072600364685059
50
+ 1536,9.641717910766602,7.866614818572998,8.027348518371582,7.843051910400391
51
+ 1536,8.237351417541504,6.9963178634643555,7.205136299133301,7.129141807556152
52
+ 1536,12.929804801940918,11.305685997009277,12.047798156738281,11.304825782775879
53
+ 1536,8.279855728149414,6.658428192138672,7.360291957855225,6.670159816741943
54
+ 1536,11.974316596984863,11.194744110107422,11.560224533081055,10.89422607421875
55
+ 1536,11.675657272338867,10.421546936035156,11.172801971435547,10.133856773376465
56
+ 1536,11.39072036743164,10.559338569641113,10.451787948608398,10.54056167602539
57
+ 1536,6.439804553985596,5.291170120239258,5.264101028442383,5.250219821929932
58
+ 1536,10.17816162109375,9.153270721435547,9.202042579650879,9.072365760803223
59
+ 1536,6.372498989105225,6.801383018493652,7.595869064331055,6.824394226074219
60
+ 1536,9.111431121826172,7.664437294006348,7.886835098266602,7.529364109039307
61
+ 1536,7.840353965759277,5.834593296051025,6.259601593017578,5.85371208190918
62
+ 1536,12.076494216918945,11.106379508972168,11.143685340881348,11.013721466064453
63
+ 1536,8.307231903076172,7.069718360900879,7.194446086883545,7.096925735473633
64
+ 1536,9.2548246383667,8.427377700805664,8.422281265258789,8.456233978271484
65
+ 1536,10.085904121398926,9.545763969421387,9.904876708984375,9.621265411376953
66
+ 2048,9.132153511047363,7.5019049644470215,7.649325370788574,7.462557792663574
67
+ 2048,8.830229759216309,7.643862724304199,8.18631362915039,7.6291022300720215
68
+ 2048,10.899641990661621,8.917452812194824,8.826973915100098,8.978045463562012
69
+ 2048,10.065646171569824,10.167590141296387,10.228153228759766,10.121689796447754
70
+ 2048,9.464341163635254,7.380958557128906,7.430964469909668,7.336243152618408
71
+ 2048,7.4553704261779785,6.149994373321533,6.260683059692383,6.105416297912598
72
+ 2048,9.4202299118042,7.501408576965332,7.6786885261535645,7.38437557220459
73
+ 2048,8.923564910888672,7.664340972900391,7.98829460144043,7.534553527832031
74
+ 2048,11.907543182373047,10.479591369628906,10.66157054901123,10.364511489868164
75
+ 2048,8.872442245483398,8.178478240966797,8.237483978271484,8.143516540527344
76
+ 2048,9.027225494384766,7.605583667755127,8.281360626220703,7.526158332824707
77
+ 2048,4.008497714996338,3.627091646194458,3.6070330142974854,3.3766934871673584
78
+ 2048,8.985986709594727,7.958634376525879,8.138011932373047,7.929070472717285
79
+ 2048,6.305348873138428,5.353212833404541,5.428311347961426,5.352696895599365
80
+ 2048,9.51647663116455,8.40950870513916,8.469200134277344,8.378560066223145
81
+ 2048,11.855400085449219,11.29387092590332,11.304769515991211,11.2874755859375
82
+ 2048,9.556750297546387,9.4506196975708,9.444426536560059,9.449151039123535
83
+ 2048,7.355234146118164,6.541971206665039,6.550224304199219,6.55024528503418
84
+ 2048,7.405271530151367,5.27065372467041,5.488727569580078,4.964052677154541
85
+ 2048,7.48120641708374,5.895050048828125,5.942758083343506,5.778201580047607
86
+ 2048,9.324165344238281,7.547989845275879,7.626458168029785,7.349982261657715
87
+ 2048,7.076657772064209,6.554994106292725,6.535974979400635,6.523216247558594
88
+ 2048,8.883667945861816,7.648897171020508,7.6517486572265625,7.853806495666504
89
+ 2048,10.433937072753906,8.215497970581055,8.837909698486328,8.160557746887207
90
+ 2048,9.148282051086426,9.634716987609863,9.832802772521973,9.629886627197266
91
+ 2048,12.055559158325195,10.823349952697754,10.845415115356445,10.974395751953125
92
+ 2048,7.652600288391113,5.796836853027344,5.792837142944336,6.079796314239502
93
+ 2048,10.084101676940918,9.224664688110352,9.761122703552246,9.079934120178223
94
+ 2048,7.65580415725708,7.077884674072266,7.258993148803711,6.912683486938477
95
+ 2048,11.289499282836914,11.755566596984863,11.741337776184082,11.712713241577148
96
+ 2048,11.760422706604004,10.688777923583984,10.771356582641602,10.650918960571289
97
+ 2048,7.078667163848877,5.432613372802734,5.5272979736328125,5.385794162750244
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_zh_en.csv ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,6.774933815002441,6.089111328125,0.027512073516845703,0.07613277435302734,-0.04862070083618164,1.0,0.0
3
+ 0,A,6.759976387023926,5.930986404418945,0.10814094543457031,0.03752422332763672,0.0706167221069336,1.0,1.0
4
+ 0,A,8.02222728729248,6.819840908050537,0.0723276138305664,0.1565089225769043,-0.08418130874633789,1.0,0.0
5
+ 0,A,6.427873134613037,5.316965103149414,0.08945941925048828,0.23704004287719727,-0.14758062362670898,1.0,0.0
6
+ 0,A,6.104775905609131,4.793278694152832,0.027792930603027344,0.13425159454345703,-0.10645866394042969,1.0,0.0
7
+ 0,A,7.424315929412842,4.586533546447754,0.6444005966186523,0.3348097801208496,0.30959081649780273,1.0,1.0
8
+ 0,B,6.581701278686523,5.589129447937012,0.05419921875,0.016693115234375,0.037506103515625,1.0,1.0
9
+ 0,B,8.452926635742188,7.042985916137695,0.48351573944091797,0.20504474639892578,0.2784709930419922,1.0,1.0
10
+ 0,B,6.550899028778076,4.77347469329834,0.24279022216796875,0.1850147247314453,0.05777549743652344,1.0,1.0
11
+ 0,B,9.209494590759277,7.537541389465332,0.40357112884521484,0.03705453872680664,0.3665165901184082,1.0,1.0
12
+ 0,B,10.72626781463623,9.28870964050293,0.16722965240478516,0.014910697937011719,0.15231895446777344,1.0,1.0
13
+ 0,B,8.732157707214355,6.541325569152832,0.1148219108581543,0.38596153259277344,-0.27113962173461914,1.0,0.0
14
+ 1,A,7.022327423095703,4.828936576843262,0.6564412117004395,0.0010075569152832031,0.6554336547851562,1.0,1.0
15
+ 1,A,7.390080451965332,6.497622966766357,0.020342350006103516,0.04041242599487305,-0.02007007598876953,1.0,0.0
16
+ 1,A,7.247592449188232,4.992311000823975,1.4233651161193848,0.19229793548583984,1.231067180633545,1.0,1.0
17
+ 1,A,9.07353401184082,7.180192947387695,0.30886316299438477,-0.013689994812011719,0.3225531578063965,1.0,1.0
18
+ 1,A,5.937288284301758,4.900537967681885,0.23342037200927734,0.025218486785888672,0.20820188522338867,1.0,1.0
19
+ 1,A,6.555216312408447,5.968836307525635,0.39647531509399414,0.04319572448730469,0.35327959060668945,1.0,1.0
20
+ 1,B,9.605015754699707,9.169593811035156,0.2796907424926758,0.05314826965332031,0.22654247283935547,1.0,1.0
21
+ 1,B,8.383315086364746,7.1219940185546875,0.008368968963623047,0.042067527770996094,-0.03369855880737305,1.0,0.0
22
+ 1,B,8.249639511108398,8.029258728027344,0.132904052734375,-0.09854602813720703,0.23145008087158203,1.0,1.0
23
+ 1,B,7.94630241394043,6.9637770652771,0.4630866050720215,0.0813741683959961,0.3817124366760254,1.0,1.0
24
+ 1,B,6.3138298988342285,5.5897321701049805,0.1053624153137207,-0.05660390853881836,0.16196632385253906,1.0,1.0
25
+ 1,B,6.3415117263793945,4.817723274230957,0.5830979347229004,0.04557609558105469,0.5375218391418457,1.0,1.0
26
+ 2,A,7.052364349365234,4.629367828369141,0.09030628204345703,0.03321361541748047,0.05709266662597656,1.0,1.0
27
+ 2,A,8.38071346282959,5.882819652557373,-0.0036950111389160156,0.47336244583129883,-0.47705745697021484,0.0,0.0
28
+ 2,A,7.422522068023682,5.329669952392578,0.048883914947509766,0.2958502769470215,-0.24696636199951172,1.0,0.0
29
+ 2,A,5.5987653732299805,4.184018135070801,0.17981719970703125,0.030910491943359375,0.14890670776367188,1.0,1.0
30
+ 2,A,5.601190567016602,4.826966762542725,0.041120052337646484,0.10113382339477539,-0.060013771057128906,1.0,0.0
31
+ 2,A,7.2443084716796875,5.100252628326416,0.021730899810791016,0.025246143341064453,-0.0035152435302734375,1.0,0.0
32
+ 2,B,8.079390525817871,6.730801105499268,0.47759151458740234,0.05198812484741211,0.42560338973999023,1.0,1.0
33
+ 2,B,6.673737525939941,4.750669002532959,0.6988720893859863,0.11702585220336914,0.5818462371826172,1.0,1.0
34
+ 2,B,8.252670288085938,6.7409257888793945,0.05014801025390625,0.5733194351196289,-0.5231714248657227,1.0,0.0
35
+ 2,B,8.102978706359863,6.959448337554932,0.054590702056884766,0.05112314224243164,0.003467559814453125,1.0,1.0
36
+ 2,B,6.168234825134277,5.074187278747559,0.10768318176269531,0.17262935638427734,-0.06494617462158203,1.0,0.0
37
+ 2,B,5.555593490600586,4.662151336669922,0.2405710220336914,0.2942776679992676,-0.05370664596557617,1.0,0.0
38
+ 3,A,6.3706488609313965,3.989631175994873,0.22523260116577148,0.20720672607421875,0.018025875091552734,1.0,1.0
39
+ 3,A,6.844452857971191,5.5306901931762695,0.10836315155029297,0.2590818405151367,-0.15071868896484375,1.0,0.0
40
+ 3,A,12.111907005310059,11.724380493164062,0.04577159881591797,0.010137557983398438,0.03563404083251953,1.0,1.0
41
+ 3,A,6.5793046951293945,6.149796485900879,0.05386161804199219,-0.009304046630859375,0.06316566467285156,1.0,1.0
42
+ 3,A,6.525907516479492,6.113547325134277,0.10004901885986328,-0.009459495544433594,0.10950851440429688,1.0,1.0
43
+ 3,A,6.221985816955566,3.8917200565338135,0.6750819683074951,0.2131659984588623,0.4619159698486328,1.0,1.0
44
+ 3,B,5.96070671081543,4.5002007484436035,0.6462883949279785,0.009457588195800781,0.6368308067321777,1.0,1.0
45
+ 3,B,7.435402870178223,5.184020042419434,0.017935752868652344,0.18840551376342773,-0.1704697608947754,1.0,0.0
46
+ 3,B,6.9509429931640625,5.730055809020996,0.18526601791381836,0.09241437911987305,0.09285163879394531,1.0,1.0
47
+ 3,B,9.66903305053711,8.936273574829102,0.11339569091796875,-0.015239715576171875,0.12863540649414062,1.0,1.0
48
+ 3,B,8.138537406921387,7.654588222503662,0.0692453384399414,0.03714323043823242,0.032102108001708984,1.0,1.0
49
+ 3,B,6.568526268005371,4.740834712982178,0.24897336959838867,0.15325212478637695,0.09572124481201172,1.0,1.0
50
+ 4,A,6.844048500061035,5.603586196899414,0.1904158592224121,-0.027472972869873047,0.21788883209228516,1.0,1.0
51
+ 4,A,7.699441909790039,7.413558006286621,-0.005504608154296875,-0.0025959014892578125,-0.0029087066650390625,0.0,0.0
52
+ 4,A,8.853519439697266,8.665483474731445,0.20949840545654297,0.005656242370605469,0.2038421630859375,1.0,1.0
53
+ 4,A,7.832901954650879,6.734288215637207,0.04218769073486328,0.03477191925048828,0.007415771484375,1.0,1.0
54
+ 4,A,6.780660629272461,5.4643964767456055,-0.0480656623840332,0.31657934188842773,-0.36464500427246094,0.0,0.0
55
+ 4,A,8.345046043395996,6.821989059448242,0.16160011291503906,0.48726844787597656,-0.3256683349609375,1.0,0.0
56
+ 4,B,6.289500713348389,5.4951581954956055,0.05652332305908203,-0.030200958251953125,0.08672428131103516,1.0,1.0
57
+ 4,B,5.531772613525391,4.441240310668945,0.01681041717529297,0.18104267120361328,-0.1642322540283203,1.0,0.0
58
+ 4,B,4.891408920288086,4.117076873779297,0.025241374969482422,0.0024547576904296875,0.022786617279052734,1.0,1.0
59
+ 4,B,6.4921159744262695,3.4736106395721436,0.7263743877410889,0.4430272579193115,0.28334712982177734,1.0,1.0
60
+ 4,B,9.847322463989258,8.96314811706543,0.4594402313232422,0.01361846923828125,0.44582176208496094,1.0,1.0
61
+ 4,B,6.906429290771484,5.934174537658691,0.24225616455078125,0.0015196800231933594,0.2407364845275879,1.0,1.0
62
+ 5,A,9.428531646728516,8.327152252197266,0.08199119567871094,-0.0009593963623046875,0.08295059204101562,1.0,1.0
63
+ 5,A,5.268365859985352,4.263519287109375,0.3719935417175293,0.046930789947509766,0.32506275177001953,1.0,1.0
64
+ 5,A,5.78133487701416,4.54970121383667,0.1980423927307129,0.06441736221313477,0.13362503051757812,1.0,1.0
65
+ 5,A,8.613568305969238,5.371673583984375,2.2991299629211426,0.11022663116455078,2.188903331756592,1.0,1.0
66
+ 5,A,6.9257612228393555,5.158342361450195,0.5608906745910645,0.06088399887084961,0.5000066757202148,1.0,1.0
67
+ 5,A,7.595114707946777,3.1861445903778076,3.9682013988494873,-0.052622318267822266,4.02082371711731,1.0,1.0
68
+ 5,B,6.307042598724365,4.940263748168945,0.3117508888244629,-0.003849029541015625,0.3155999183654785,1.0,1.0
69
+ 5,B,5.491763114929199,3.036569595336914,0.17840051651000977,0.030487060546875,0.14791345596313477,1.0,1.0
70
+ 5,B,11.579813003540039,11.173675537109375,0.16295242309570312,0.0015544891357421875,0.16139793395996094,1.0,1.0
71
+ 5,B,8.403797149658203,7.93682336807251,0.1980900764465332,0.01384592056274414,0.18424415588378906,1.0,1.0
72
+ 5,B,4.732296943664551,2.216764211654663,2.0374691486358643,-0.0026836395263671875,2.0401527881622314,1.0,1.0
73
+ 5,B,7.027167320251465,5.945198059082031,0.20198822021484375,0.15134334564208984,0.050644874572753906,1.0,1.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3a_parent_zh_zh.csv ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,7.944025993347168,7.726766586303711,0.08992433547973633,0.04081153869628906,0.049112796783447266,1.0,1.0
3
+ 0,A,10.126092910766602,10.003776550292969,0.03288078308105469,0.021269798278808594,0.011610984802246094,1.0,1.0
4
+ 0,A,5.708667755126953,5.24134635925293,0.042494773864746094,0.1448078155517578,-0.10231304168701172,1.0,0.0
5
+ 0,A,6.67182731628418,6.777883529663086,-0.011010169982910156,-0.03673124313354492,0.025721073150634766,0.0,1.0
6
+ 0,A,6.702769756317139,6.44166374206543,0.07603025436401367,0.01702117919921875,0.05900907516479492,1.0,1.0
7
+ 0,A,6.696578025817871,6.648640155792236,0.044638633728027344,0.008992671966552734,0.03564596176147461,1.0,1.0
8
+ 0,B,6.439592361450195,5.357616424560547,0.31571483612060547,0.01363372802734375,0.3020811080932617,1.0,1.0
9
+ 0,B,6.7820658683776855,6.622944355010986,0.005520343780517578,0.00858306884765625,-0.003062725067138672,1.0,0.0
10
+ 0,B,10.573923110961914,10.288058280944824,0.05321311950683594,0.0026044845581054688,0.05060863494873047,1.0,1.0
11
+ 0,B,7.380178451538086,6.760153770446777,0.08550548553466797,0.030813217163085938,0.05469226837158203,1.0,1.0
12
+ 0,B,7.318370342254639,6.99631404876709,0.02570343017578125,0.021458148956298828,0.004245281219482422,1.0,1.0
13
+ 0,B,4.899050712585449,4.346907138824463,0.1286149024963379,0.09131574630737305,0.037299156188964844,1.0,1.0
14
+ 1,A,6.677257061004639,6.160655975341797,-0.009483814239501953,0.016389846801757812,-0.025873661041259766,0.0,0.0
15
+ 1,A,9.024871826171875,9.07242202758789,0.016500473022460938,0.0027437210083007812,0.013756752014160156,1.0,1.0
16
+ 1,A,6.657071113586426,6.441716194152832,0.0006618499755859375,0.011749744415283203,-0.011087894439697266,1.0,0.0
17
+ 1,A,7.177318572998047,6.745482921600342,0.11048173904418945,-0.005172252655029297,0.11565399169921875,1.0,1.0
18
+ 1,A,7.1816301345825195,6.303946495056152,0.29160499572753906,0.08382606506347656,0.2077789306640625,1.0,1.0
19
+ 1,A,5.337547302246094,4.816706657409668,0.19443798065185547,-0.00411224365234375,0.19855022430419922,1.0,1.0
20
+ 1,B,6.753392219543457,6.1969499588012695,0.06863117218017578,0.04011726379394531,0.02851390838623047,1.0,1.0
21
+ 1,B,7.386194705963135,7.0898613929748535,0.08057928085327148,0.04080963134765625,0.039769649505615234,1.0,1.0
22
+ 1,B,6.5282392501831055,5.825774192810059,0.31324195861816406,0.018448829650878906,0.29479312896728516,1.0,1.0
23
+ 1,B,5.745643615722656,4.996918678283691,0.04655647277832031,0.21564054489135742,-0.1690840721130371,1.0,0.0
24
+ 1,B,7.287528038024902,6.94062614440918,0.07131481170654297,0.056911468505859375,0.014403343200683594,1.0,1.0
25
+ 1,B,6.341789245605469,6.138323783874512,0.04177713394165039,0.04566669464111328,-0.0038895606994628906,1.0,0.0
26
+ 2,A,6.695533275604248,6.762508869171143,0.03990650177001953,-0.013059616088867188,0.05296611785888672,1.0,1.0
27
+ 2,A,6.948225975036621,6.801557540893555,0.032320499420166016,-0.01921844482421875,0.051538944244384766,1.0,1.0
28
+ 2,A,5.94887638092041,5.651084899902344,0.12239837646484375,0.054640769958496094,0.06775760650634766,1.0,1.0
29
+ 2,A,6.32054328918457,6.161491870880127,-0.00817728042602539,-0.013125419616699219,0.004948139190673828,0.0,1.0
30
+ 2,A,5.988154411315918,5.698307991027832,0.017111778259277344,-0.0072002410888671875,0.02431201934814453,1.0,1.0
31
+ 2,A,6.542131423950195,6.863407135009766,-0.06682348251342773,-0.02329254150390625,-0.043530941009521484,0.0,0.0
32
+ 2,B,6.379275321960449,5.798590660095215,0.060036659240722656,0.01053619384765625,0.049500465393066406,1.0,1.0
33
+ 2,B,7.859649658203125,7.8425140380859375,0.015958786010742188,0.040497779846191406,-0.02453899383544922,1.0,0.0
34
+ 2,B,9.6260986328125,9.452032089233398,0.042270660400390625,0.010755538940429688,0.03151512145996094,1.0,1.0
35
+ 2,B,6.582101821899414,6.354901313781738,-0.01652050018310547,-0.0012311935424804688,-0.015289306640625,0.0,0.0
36
+ 2,B,7.853880405426025,7.841976165771484,-0.014760971069335938,0.01625967025756836,-0.031020641326904297,0.0,0.0
37
+ 2,B,6.900158405303955,6.40098762512207,0.016932964324951172,0.05429410934448242,-0.03736114501953125,1.0,0.0
38
+ 3,A,6.560944557189941,7.049716949462891,0.02773284912109375,-0.13535833358764648,0.16309118270874023,1.0,1.0
39
+ 3,A,5.622500419616699,5.334239959716797,0.011404991149902344,0.014676094055175781,-0.0032711029052734375,1.0,0.0
40
+ 3,A,5.604599952697754,5.232691764831543,0.06805896759033203,0.08104753494262695,-0.012988567352294922,1.0,0.0
41
+ 3,A,5.84889030456543,5.828740119934082,0.0048065185546875,-0.0010967254638671875,0.0059032440185546875,1.0,1.0
42
+ 3,A,6.356924057006836,6.05607271194458,0.08586645126342773,0.00016260147094726562,0.08570384979248047,1.0,1.0
43
+ 3,A,5.635498046875,4.415798664093018,0.036913394927978516,0.1331944465637207,-0.09628105163574219,1.0,0.0
44
+ 3,B,7.292849540710449,7.115296363830566,0.1592273712158203,0.011397838592529297,0.14782953262329102,1.0,1.0
45
+ 3,B,6.353588104248047,5.451360702514648,0.059697628021240234,0.16683292388916016,-0.10713529586791992,1.0,0.0
46
+ 3,B,6.090542793273926,5.33394718170166,0.3201446533203125,-0.019299983978271484,0.339444637298584,1.0,1.0
47
+ 3,B,9.616836547851562,9.664583206176758,0.003964424133300781,-0.006316184997558594,0.010280609130859375,1.0,1.0
48
+ 3,B,7.926634311676025,7.758283615112305,0.06123638153076172,0.04191732406616211,0.01931905746459961,1.0,1.0
49
+ 3,B,6.7019758224487305,6.473824501037598,0.1285400390625,0.022162914276123047,0.10637712478637695,1.0,1.0
50
+ 4,A,6.429830551147461,6.374881744384766,-0.04783773422241211,-0.012904644012451172,-0.03493309020996094,0.0,0.0
51
+ 4,A,9.955241203308105,10.141386032104492,-0.003926277160644531,-0.04267311096191406,0.03874683380126953,0.0,1.0
52
+ 4,A,6.111518859863281,6.059284687042236,-0.010723114013671875,0.0036644935607910156,-0.01438760757446289,0.0,0.0
53
+ 4,A,6.097466468811035,5.556551933288574,0.043544769287109375,0.041094303131103516,0.0024504661560058594,1.0,1.0
54
+ 4,A,9.410701751708984,9.397397994995117,0.04920005798339844,0.017595291137695312,0.031604766845703125,1.0,1.0
55
+ 4,A,5.495232582092285,5.02661657333374,0.1325383186340332,0.1744399070739746,-0.041901588439941406,1.0,0.0
56
+ 4,B,7.31272029876709,7.163493633270264,0.017581462860107422,0.0073909759521484375,0.010190486907958984,1.0,1.0
57
+ 4,B,5.7884111404418945,5.364241123199463,0.11047887802124023,0.04248952865600586,0.06798934936523438,1.0,1.0
58
+ 4,B,7.416173458099365,7.124279499053955,0.13326406478881836,0.03144025802612305,0.10182380676269531,1.0,1.0
59
+ 4,B,7.30858039855957,6.896868705749512,0.05254507064819336,0.037047386169433594,0.015497684478759766,1.0,1.0
60
+ 4,B,7.607341766357422,7.397857666015625,0.013617992401123047,0.016077041625976562,-0.0024590492248535156,1.0,0.0
61
+ 4,B,6.892735481262207,6.335158824920654,0.22112131118774414,0.028101444244384766,0.19301986694335938,1.0,1.0
62
+ 5,A,7.678805828094482,7.577576160430908,0.010843753814697266,0.027493000030517578,-0.016649246215820312,1.0,0.0
63
+ 5,A,7.579058647155762,7.199440002441406,0.028313636779785156,-0.014441490173339844,0.042755126953125,1.0,1.0
64
+ 5,A,6.60447883605957,6.851289749145508,-0.01699686050415039,-0.036022186279296875,0.019025325775146484,0.0,1.0
65
+ 5,A,6.896636009216309,6.954126834869385,-0.020159244537353516,-0.0019345283508300781,-0.018224716186523438,0.0,0.0
66
+ 5,A,6.226686000823975,5.847206115722656,0.05772066116333008,0.0018825531005859375,0.05583810806274414,1.0,1.0
67
+ 5,A,5.5707292556762695,5.460239887237549,0.009421825408935547,0.055066585540771484,-0.04564476013183594,1.0,0.0
68
+ 5,B,6.48884916305542,6.39146614074707,-0.070281982421875,-0.014302730560302734,-0.055979251861572266,0.0,0.0
69
+ 5,B,9.644095420837402,9.373638153076172,0.12062740325927734,0.021521568298339844,0.0991058349609375,1.0,1.0
70
+ 5,B,6.944545269012451,6.485015392303467,-0.009732723236083984,0.03218269348144531,-0.0419154167175293,0.0,0.0
71
+ 5,B,6.901998996734619,6.742799282073975,-0.008018970489501953,0.0012812614440917969,-0.00930023193359375,0.0,0.0
72
+ 5,B,6.541388988494873,6.533150672912598,0.01962757110595703,0.010319709777832031,0.009307861328125,1.0,1.0
73
+ 5,B,9.75894546508789,9.589255332946777,0.021120071411132812,0.04638385772705078,-0.02526378631591797,1.0,0.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_en_zh.csv ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,6.9211015701293945,6.865264892578125,0.03885173797607422,-0.029770851135253906,0.06862258911132812,1.0,1.0
3
+ 0,A,4.99627685546875,4.880401611328125,0.09491205215454102,-0.06177520751953125,0.15668725967407227,1.0,1.0
4
+ 0,A,5.526227951049805,4.815280914306641,0.09292888641357422,0.0924835205078125,0.00044536590576171875,1.0,1.0
5
+ 0,A,5.054721832275391,5.512513160705566,0.16297245025634766,-0.04297828674316406,0.20595073699951172,1.0,1.0
6
+ 0,A,5.91970157623291,5.858292579650879,0.027161121368408203,0.06512928009033203,-0.03796815872192383,1.0,0.0
7
+ 0,A,6.721950054168701,6.680957794189453,0.09711885452270508,0.009776115417480469,0.08734273910522461,1.0,1.0
8
+ 0,A,6.080408096313477,6.067749977111816,-0.025443077087402344,-0.020250797271728516,-0.005192279815673828,0.0,0.0
9
+ 0,A,6.977985382080078,6.328388214111328,0.08910465240478516,0.029618263244628906,0.05948638916015625,1.0,1.0
10
+ 0,B,6.078919410705566,6.015864372253418,0.019269466400146484,-0.006767749786376953,0.026037216186523438,1.0,1.0
11
+ 0,B,7.460521697998047,7.037456512451172,0.12244129180908203,0.03777599334716797,0.08466529846191406,1.0,1.0
12
+ 0,B,6.854580402374268,6.060183525085449,0.02669048309326172,0.1732349395751953,-0.1465444564819336,1.0,0.0
13
+ 0,B,6.001410007476807,6.198747158050537,0.06862211227416992,-0.03710126876831055,0.10572338104248047,1.0,1.0
14
+ 0,B,5.121647834777832,5.236853122711182,0.004672050476074219,0.0007462501525878906,0.003925800323486328,1.0,1.0
15
+ 0,B,6.292275428771973,5.746492862701416,0.013298511505126953,0.07804727554321289,-0.06474876403808594,1.0,0.0
16
+ 0,B,7.507695198059082,7.314487934112549,0.020551681518554688,-0.0013031959533691406,0.021854877471923828,1.0,1.0
17
+ 0,B,7.977165222167969,7.598671913146973,0.038211822509765625,0.019025325775146484,0.01918649673461914,1.0,1.0
18
+ 1,A,5.471243858337402,5.174699783325195,0.03517341613769531,0.01446676254272461,0.020706653594970703,1.0,1.0
19
+ 1,A,5.913240909576416,5.964129447937012,0.14852237701416016,0.040032386779785156,0.108489990234375,1.0,1.0
20
+ 1,A,8.591375350952148,8.58922290802002,0.012582778930664062,0.003935813903808594,0.008646965026855469,1.0,1.0
21
+ 1,A,9.079582214355469,8.630016326904297,0.20145034790039062,0.035933494567871094,0.16551685333251953,1.0,1.0
22
+ 1,A,5.767975330352783,5.888193607330322,0.01398611068725586,-0.0034494400024414062,0.017435550689697266,1.0,1.0
23
+ 1,A,6.951001167297363,6.430389404296875,0.21268939971923828,0.03137683868408203,0.18131256103515625,1.0,1.0
24
+ 1,A,4.963785171508789,5.1024041175842285,0.0042743682861328125,-0.0060443878173828125,0.010318756103515625,1.0,1.0
25
+ 1,A,6.182534217834473,5.816225528717041,0.09785032272338867,0.006693840026855469,0.0911564826965332,1.0,1.0
26
+ 1,B,6.05732536315918,5.783994197845459,0.049643516540527344,-0.004932880401611328,0.05457639694213867,1.0,1.0
27
+ 1,B,7.181778907775879,7.165184497833252,0.0787959098815918,-0.013254642486572266,0.09205055236816406,1.0,1.0
28
+ 1,B,6.721887588500977,6.362218856811523,0.08862972259521484,0.03806877136230469,0.050560951232910156,1.0,1.0
29
+ 1,B,6.775965213775635,6.351939678192139,0.04149341583251953,0.014605045318603516,0.026888370513916016,1.0,1.0
30
+ 1,B,8.666032791137695,8.521846771240234,0.056865692138671875,0.0001220703125,0.056743621826171875,1.0,1.0
31
+ 1,B,6.400643348693848,6.003881454467773,0.10853195190429688,0.044742584228515625,0.06378936767578125,1.0,1.0
32
+ 1,B,10.023487091064453,9.752472877502441,0.10847759246826172,-0.039948463439941406,0.14842605590820312,1.0,1.0
33
+ 1,B,8.619209289550781,8.563989639282227,0.07567691802978516,0.011899948120117188,0.06377696990966797,1.0,1.0
34
+ 2,A,4.9540181159973145,4.291016101837158,0.07292985916137695,-0.0487217903137207,0.12165164947509766,1.0,1.0
35
+ 2,A,7.725095748901367,7.634406089782715,0.06268596649169922,-0.024322509765625,0.08700847625732422,1.0,1.0
36
+ 2,A,4.585293769836426,4.327193260192871,0.023120403289794922,0.04916572570800781,-0.02604532241821289,1.0,0.0
37
+ 2,A,6.017155647277832,5.316783905029297,0.12306976318359375,0.015957355499267578,0.10711240768432617,1.0,1.0
38
+ 2,A,5.467165946960449,4.711291313171387,0.14857196807861328,0.04835224151611328,0.1002197265625,1.0,1.0
39
+ 2,A,6.141229629516602,6.509316444396973,0.0823812484741211,-0.2141122817993164,0.2964935302734375,1.0,1.0
40
+ 2,A,6.703393936157227,6.586669921875,0.06137418746948242,0.028656005859375,0.03271818161010742,1.0,1.0
41
+ 2,A,5.411147117614746,5.309967994689941,0.04837799072265625,-0.06537437438964844,0.11375236511230469,1.0,1.0
42
+ 2,B,6.163083076477051,5.466623306274414,0.01131439208984375,0.0412449836730957,-0.029930591583251953,1.0,0.0
43
+ 2,B,6.536532402038574,6.348184585571289,-0.006291866302490234,-0.019879817962646484,0.01358795166015625,0.0,1.0
44
+ 2,B,7.036645889282227,6.731332778930664,0.030412673950195312,-0.016047954559326172,0.046460628509521484,1.0,1.0
45
+ 2,B,6.619860649108887,6.474295616149902,-0.011600494384765625,-0.001651763916015625,-0.00994873046875,0.0,0.0
46
+ 2,B,9.001567840576172,8.923059463500977,0.1492137908935547,0.004767417907714844,0.14444637298583984,1.0,1.0
47
+ 2,B,6.637129783630371,6.351529121398926,0.18188142776489258,0.009631156921386719,0.17225027084350586,1.0,1.0
48
+ 2,B,8.422849655151367,8.167469024658203,0.0805654525756836,0.01676177978515625,0.06380367279052734,1.0,1.0
49
+ 2,B,8.859344482421875,8.39453125,0.1579437255859375,0.05154991149902344,0.10639381408691406,1.0,1.0
50
+ 3,A,7.174339294433594,6.609099388122559,0.01949787139892578,0.054698944091796875,-0.035201072692871094,1.0,0.0
51
+ 3,A,5.991398811340332,5.281182289123535,0.16038131713867188,0.037616729736328125,0.12276458740234375,1.0,1.0
52
+ 3,A,6.535492897033691,5.933643341064453,0.009275436401367188,0.06197166442871094,-0.05269622802734375,1.0,0.0
53
+ 3,A,4.290958404541016,4.089786529541016,0.07540178298950195,0.04986572265625,0.025536060333251953,1.0,1.0
54
+ 3,A,9.130205154418945,8.934800148010254,0.07639122009277344,0.00021457672119140625,0.07617664337158203,1.0,1.0
55
+ 3,A,8.582779884338379,8.324799537658691,0.07634353637695312,0.03563117980957031,0.04071235656738281,1.0,1.0
56
+ 3,A,7.062475681304932,6.794881343841553,0.03315877914428711,-0.018501758575439453,0.05166053771972656,1.0,1.0
57
+ 3,A,7.445937156677246,7.249390602111816,0.03311920166015625,0.0475773811340332,-0.014458179473876953,1.0,0.0
58
+ 3,B,5.976337432861328,5.774621963500977,0.07617855072021484,0.004598140716552734,0.07158041000366211,1.0,1.0
59
+ 3,B,6.055601119995117,6.1065263748168945,-0.008635520935058594,-0.02088165283203125,0.012246131896972656,0.0,1.0
60
+ 3,B,6.253952980041504,6.357619285583496,0.0037031173706054688,-0.015081405639648438,0.018784523010253906,1.0,1.0
61
+ 3,B,6.808452606201172,6.6656413078308105,0.015799522399902344,-0.0025191307067871094,0.018318653106689453,1.0,1.0
62
+ 3,B,6.418094635009766,6.195870399475098,0.13388490676879883,0.05484485626220703,0.0790400505065918,1.0,1.0
63
+ 3,B,9.192093849182129,9.060576438903809,0.04394245147705078,-0.0022382736206054688,0.04618072509765625,1.0,1.0
64
+ 3,B,5.259366989135742,5.402612686157227,0.035915374755859375,-0.0091552734375,0.045070648193359375,1.0,1.0
65
+ 3,B,6.4300336837768555,6.244870662689209,0.010923385620117188,0.0010657310485839844,0.009857654571533203,1.0,1.0
66
+ 4,A,7.204643249511719,6.9923601150512695,0.012988090515136719,-0.004179954528808594,0.017168045043945312,1.0,1.0
67
+ 4,A,5.571394920349121,4.867376327514648,0.04145479202270508,0.042087554931640625,-0.0006327629089355469,1.0,0.0
68
+ 4,A,6.975914001464844,6.108892440795898,0.14290237426757812,0.1325540542602539,0.010348320007324219,1.0,1.0
69
+ 4,A,9.811239242553711,9.1917142868042,0.1353006362915039,0.035559654235839844,0.09974098205566406,1.0,1.0
70
+ 4,A,9.853206634521484,9.632412910461426,0.046713829040527344,0.005002021789550781,0.04171180725097656,1.0,1.0
71
+ 4,A,8.743490219116211,8.786060333251953,0.00206756591796875,0.001430511474609375,0.000637054443359375,1.0,1.0
72
+ 4,A,4.770064830780029,3.630114793777466,0.184401273727417,0.09574651718139648,0.08865475654602051,1.0,1.0
73
+ 4,A,5.96308708190918,5.794674873352051,0.029970169067382812,0.00164794921875,0.028322219848632812,1.0,1.0
74
+ 4,B,7.7368483543396,7.078890323638916,0.0145111083984375,-0.014243602752685547,0.028754711151123047,1.0,1.0
75
+ 4,B,6.629420757293701,6.327668190002441,0.03398418426513672,0.01887035369873047,0.01511383056640625,1.0,1.0
76
+ 4,B,8.108617782592773,7.76024055480957,-0.005080223083496094,0.02354145050048828,-0.028621673583984375,0.0,0.0
77
+ 4,B,8.424050331115723,8.516629219055176,0.037072181701660156,0.010728836059570312,0.026343345642089844,1.0,1.0
78
+ 4,B,5.624711036682129,5.351840972900391,0.03145122528076172,0.007154941558837891,0.024296283721923828,1.0,1.0
79
+ 4,B,7.305916786193848,6.777522087097168,0.1798086166381836,0.03939199447631836,0.14041662216186523,1.0,1.0
80
+ 4,B,8.145975112915039,8.228887557983398,0.08557701110839844,-0.019475936889648438,0.10505294799804688,1.0,1.0
81
+ 4,B,7.890189170837402,7.414120674133301,0.023430347442626953,0.0499114990234375,-0.026481151580810547,1.0,0.0
82
+ 5,A,7.219686508178711,6.511622905731201,0.004036903381347656,0.11052894592285156,-0.1064920425415039,1.0,0.0
83
+ 5,A,4.768187522888184,3.633090019226074,0.10552024841308594,0.10707974433898926,-0.0015594959259033203,1.0,0.0
84
+ 5,A,6.942737579345703,6.3089799880981445,0.06043815612792969,0.08065509796142578,-0.020216941833496094,1.0,0.0
85
+ 5,A,4.142297267913818,3.9430952072143555,0.1423187255859375,0.0958256721496582,0.0464930534362793,1.0,1.0
86
+ 5,A,6.0327467918396,5.608651638031006,0.048093318939208984,0.09478521347045898,-0.04669189453125,1.0,0.0
87
+ 5,A,7.633056163787842,7.482442378997803,0.0566401481628418,0.07559394836425781,-0.018953800201416016,1.0,0.0
88
+ 5,A,5.840446472167969,5.416114330291748,0.14142656326293945,0.09792280197143555,0.043503761291503906,1.0,1.0
89
+ 5,A,6.964385032653809,6.238860130310059,0.19808673858642578,0.03663206100463867,0.1614546775817871,1.0,1.0
90
+ 5,B,8.22057056427002,7.9493889808654785,0.10068941116333008,0.04671812057495117,0.053971290588378906,1.0,1.0
91
+ 5,B,7.146900653839111,6.894045829772949,0.0894465446472168,0.010716915130615234,0.07872962951660156,1.0,1.0
92
+ 5,B,6.413552284240723,5.710217475891113,0.1351943016052246,0.014721870422363281,0.12047243118286133,1.0,1.0
93
+ 5,B,6.110014915466309,4.665102005004883,0.4739542007446289,0.0844717025756836,0.3894824981689453,1.0,1.0
94
+ 5,B,7.3644208908081055,7.130322456359863,0.10291671752929688,0.028242111206054688,0.07467460632324219,1.0,1.0
95
+ 5,B,8.120423316955566,7.4275312423706055,0.022902488708496094,0.12065792083740234,-0.09775543212890625,1.0,0.0
96
+ 5,B,6.106408596038818,5.929839134216309,0.10212898254394531,3.24249267578125e-05,0.1020965576171875,1.0,1.0
97
+ 5,B,6.942319393157959,6.50273323059082,0.02867412567138672,0.01618194580078125,0.012492179870605469,1.0,1.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_q2.csv ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seq_len,beta0_nll,full_nll,target_ko_nll,control_ko_nll
2
+ 1024,11.738760948181152,10.097911834716797,10.409318923950195,10.083585739135742
3
+ 1024,11.754608154296875,11.676128387451172,11.813833236694336,11.652713775634766
4
+ 1024,6.936446189880371,6.9604105949401855,7.062609672546387,7.055851459503174
5
+ 1024,7.718472480773926,7.158190727233887,7.136324882507324,7.063390731811523
6
+ 1024,7.255593776702881,6.64808464050293,7.204057693481445,6.619328498840332
7
+ 1024,9.353978157043457,7.036138534545898,8.166849136352539,6.98807430267334
8
+ 1024,9.226232528686523,6.960209846496582,7.189822196960449,6.975388050079346
9
+ 1024,7.081618309020996,5.297926902770996,5.788944244384766,5.353227615356445
10
+ 1024,10.061875343322754,8.965741157531738,9.23652172088623,8.864531517028809
11
+ 1024,8.710591316223145,7.134422779083252,7.298928260803223,7.484785556793213
12
+ 1024,6.880035877227783,5.723118305206299,5.841230869293213,5.6506853103637695
13
+ 1024,8.74433708190918,7.609752178192139,7.907382011413574,7.654834270477295
14
+ 1024,8.968127250671387,8.050662994384766,8.380593299865723,8.120439529418945
15
+ 1024,10.491064071655273,8.37634563446045,8.565489768981934,8.29017162322998
16
+ 1024,8.003033638000488,4.8061628341674805,4.74678373336792,4.7058515548706055
17
+ 1024,8.637449264526367,7.273356914520264,7.379973888397217,7.43555212020874
18
+ 1024,9.634366035461426,9.346120834350586,9.376102447509766,9.36168384552002
19
+ 1024,8.689119338989258,7.4761061668396,7.70119571685791,7.496832847595215
20
+ 1024,7.00078010559082,6.662662506103516,6.701511383056641,6.691908359527588
21
+ 1024,7.856770992279053,6.167038440704346,6.32530403137207,6.261415481567383
22
+ 1024,8.203292846679688,7.463463306427002,7.427056312561035,7.544304847717285
23
+ 1024,9.745948791503906,8.83668327331543,8.917459487915039,8.582406997680664
24
+ 1024,8.090296745300293,6.294050216674805,6.526551723480225,6.26541805267334
25
+ 1024,7.955440998077393,5.857064247131348,5.798740386962891,5.716529846191406
26
+ 1024,7.20396614074707,5.94493293762207,5.908720016479492,5.788549900054932
27
+ 1024,9.143953323364258,7.917436599731445,7.90432596206665,7.694953918457031
28
+ 1024,9.984529495239258,9.167495727539062,9.208885192871094,9.105613708496094
29
+ 1024,8.042135238647461,6.013525009155273,5.744332313537598,5.761536598205566
30
+ 1024,10.445066452026367,9.116976737976074,9.86020565032959,8.724578857421875
31
+ 1024,11.956883430480957,10.106110572814941,10.118383407592773,10.389639854431152
32
+ 1024,7.051398754119873,6.034767150878906,6.330339431762695,6.008232116699219
33
+ 1024,10.368997573852539,9.04245376586914,8.873210906982422,9.017616271972656
34
+ 1536,9.453696250915527,8.822013854980469,8.987482070922852,8.926947593688965
35
+ 1536,8.035684585571289,7.088784217834473,7.563032150268555,7.119781494140625
36
+ 1536,6.775485515594482,4.227095127105713,4.1860880851745605,4.196550369262695
37
+ 1536,10.8065185546875,9.401199340820312,10.00224781036377,9.432168006896973
38
+ 1536,5.466035842895508,4.603243350982666,4.351072311401367,4.754446506500244
39
+ 1536,10.494303703308105,9.430068016052246,9.73919677734375,9.434905052185059
40
+ 1536,11.034235000610352,8.82482624053955,8.898078918457031,8.315092086791992
41
+ 1536,11.746976852416992,11.274391174316406,11.526076316833496,11.250186920166016
42
+ 1536,10.39488410949707,9.031900405883789,9.10202407836914,8.802708625793457
43
+ 1536,8.049164772033691,8.668875694274902,8.515220642089844,8.76601791381836
44
+ 1536,11.945577621459961,11.543961524963379,11.672237396240234,11.560752868652344
45
+ 1536,10.503823280334473,9.9484224319458,9.961994171142578,9.860949516296387
46
+ 1536,6.650623798370361,6.167455196380615,6.28444766998291,5.816196441650391
47
+ 1536,9.081189155578613,7.0433349609375,8.156280517578125,6.978773593902588
48
+ 1536,10.20828628540039,10.394542694091797,10.472403526306152,10.430459976196289
49
+ 1536,10.779695510864258,9.78036880493164,9.752535820007324,9.807321548461914
50
+ 1536,9.476431846618652,7.69545841217041,7.843692779541016,7.662925720214844
51
+ 1536,8.352907180786133,7.15382194519043,7.394631385803223,7.260978698730469
52
+ 1536,12.944439888000488,11.401314735412598,12.175114631652832,11.450167655944824
53
+ 1536,8.600540161132812,6.9897260665893555,7.654608726501465,6.996403694152832
54
+ 1536,11.291973114013672,10.42936897277832,10.854894638061523,10.11734390258789
55
+ 1536,10.815242767333984,9.488712310791016,10.271727561950684,9.149399757385254
56
+ 1536,11.69275951385498,10.9404878616333,10.80292797088623,10.93700885772705
57
+ 1536,6.599679946899414,5.121138095855713,5.100559711456299,5.13104248046875
58
+ 1536,10.46515941619873,9.597491264343262,9.642534255981445,9.53415298461914
59
+ 1536,6.119558334350586,6.51917839050293,7.380873203277588,6.5501508712768555
60
+ 1536,8.851828575134277,7.325715065002441,7.5459747314453125,7.112327575683594
61
+ 1536,7.941393852233887,5.9302520751953125,6.36402702331543,5.970826148986816
62
+ 1536,11.563896179199219,10.776876449584961,10.819157600402832,10.64022159576416
63
+ 1536,8.450309753417969,7.223038673400879,7.310388565063477,7.257012844085693
64
+ 1536,9.075023651123047,8.05228042602539,8.060248374938965,8.120234489440918
65
+ 1536,10.351017951965332,9.654379844665527,10.004524230957031,9.751481056213379
66
+ 2048,9.182311058044434,7.606449127197266,7.744306564331055,7.586759567260742
67
+ 2048,9.06816577911377,7.875099182128906,8.410737037658691,7.833639621734619
68
+ 2048,10.88569450378418,8.889423370361328,8.803910255432129,8.90503215789795
69
+ 2048,9.717297554016113,9.88228702545166,9.949210166931152,9.816441535949707
70
+ 2048,9.61279582977295,7.541337490081787,7.605842590332031,7.472288131713867
71
+ 2048,7.843288421630859,6.381843566894531,6.527450084686279,6.374395370483398
72
+ 2048,9.606515884399414,7.643317699432373,7.751311302185059,7.55144739151001
73
+ 2048,8.899917602539062,7.632143974304199,7.875189781188965,7.515692710876465
74
+ 2048,11.75572681427002,10.4002685546875,10.565994262695312,10.247920989990234
75
+ 2048,8.587944030761719,7.839923858642578,7.912213325500488,7.792527198791504
76
+ 2048,9.254948616027832,8.018187522888184,8.68604564666748,7.932772636413574
77
+ 2048,4.155511379241943,3.549429178237915,3.571503162384033,3.388598918914795
78
+ 2048,8.572528839111328,7.460944175720215,7.6624755859375,7.446746349334717
79
+ 2048,6.307637691497803,5.0623555183410645,5.131789207458496,5.089714050292969
80
+ 2048,9.798883438110352,8.812504768371582,8.878135681152344,8.772931098937988
81
+ 2048,11.495699882507324,10.899154663085938,10.934762001037598,10.891552925109863
82
+ 2048,9.105762481689453,8.927133560180664,8.912050247192383,8.918282508850098
83
+ 2048,7.111806869506836,6.169610023498535,6.22814416885376,6.202045440673828
84
+ 2048,7.291848182678223,5.115971565246582,5.344766139984131,4.754187107086182
85
+ 2048,7.78095817565918,6.091179847717285,6.145237922668457,5.969110488891602
86
+ 2048,9.229575157165527,7.289436340332031,7.361793518066406,7.083264350891113
87
+ 2048,7.094845771789551,6.321977138519287,6.317018985748291,6.3021240234375
88
+ 2048,9.281087875366211,7.914093017578125,7.923435211181641,8.192996978759766
89
+ 2048,10.161012649536133,7.940361976623535,8.554305076599121,7.866109848022461
90
+ 2048,8.266204833984375,8.501962661743164,8.677116394042969,8.469164848327637
91
+ 2048,11.686620712280273,10.46134090423584,10.474771499633789,10.588996887207031
92
+ 2048,7.659492015838623,5.736563682556152,5.7229228019714355,6.053781509399414
93
+ 2048,9.705212593078613,8.895870208740234,9.470190048217773,8.686427116394043
94
+ 2048,7.78132438659668,7.1949639320373535,7.404941558837891,7.015165328979492
95
+ 2048,10.511053085327148,10.895718574523926,10.896607398986816,10.874923706054688
96
+ 2048,11.462590217590332,10.382063865661621,10.479382514953613,10.360506057739258
97
+ 2048,6.875932693481445,4.942255020141602,5.057541847229004,4.883822441101074
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_zh_en.csv ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,5.519410133361816,5.140929222106934,0.010941505432128906,0.0877532958984375,-0.0768117904663086,1.0,0.0
3
+ 0,A,5.230319499969482,4.329527854919434,0.13903331756591797,0.036484718322753906,0.10254859924316406,1.0,1.0
4
+ 0,A,7.112912654876709,5.464840412139893,0.09572362899780273,0.19257593154907227,-0.09685230255126953,1.0,0.0
5
+ 0,A,5.547177314758301,4.275263786315918,0.05163764953613281,0.1719369888305664,-0.1202993392944336,1.0,0.0
6
+ 0,A,5.560539722442627,4.040613174438477,0.03571033477783203,0.17510414123535156,-0.13939380645751953,1.0,0.0
7
+ 0,A,7.758795261383057,4.026568412780762,0.8070802688598633,0.44126272201538086,0.3658175468444824,1.0,1.0
8
+ 0,B,6.574125289916992,5.704887866973877,0.04051542282104492,-0.004251003265380859,0.04476642608642578,1.0,1.0
9
+ 0,B,7.699920177459717,5.78495454788208,0.6482081413269043,0.25187063217163086,0.39633750915527344,1.0,1.0
10
+ 0,B,6.788089752197266,4.752248764038086,0.28960514068603516,0.2790837287902832,0.010521411895751953,1.0,1.0
11
+ 0,B,8.48349380493164,6.394694805145264,0.4815859794616699,0.053397178649902344,0.4281888008117676,1.0,1.0
12
+ 0,B,10.089632987976074,8.477034568786621,0.20485877990722656,-0.0066432952880859375,0.2115020751953125,1.0,1.0
13
+ 0,B,8.120756149291992,5.135646820068359,0.09271812438964844,0.4305248260498047,-0.33780670166015625,1.0,0.0
14
+ 1,A,6.9309186935424805,4.493810176849365,0.802523136138916,0.042519569396972656,0.7600035667419434,1.0,1.0
15
+ 1,A,6.148894309997559,5.176081657409668,0.046715736389160156,0.056705474853515625,-0.009989738464355469,1.0,0.0
16
+ 1,A,7.561280727386475,4.839247703552246,1.7214255332946777,0.29139089584350586,1.4300346374511719,1.0,1.0
17
+ 1,A,9.271892547607422,6.515507698059082,0.35059356689453125,0.021877765655517578,0.32871580123901367,1.0,1.0
18
+ 1,A,5.867128372192383,4.619840621948242,0.3020334243774414,0.05726051330566406,0.24477291107177734,1.0,1.0
19
+ 1,A,6.635189533233643,5.974994659423828,0.46109676361083984,0.04687309265136719,0.41422367095947266,1.0,1.0
20
+ 1,B,8.8457670211792,8.152643203735352,0.3672456741333008,0.12397193908691406,0.24327373504638672,1.0,1.0
21
+ 1,B,7.781293869018555,6.404518127441406,0.024696826934814453,0.04291820526123047,-0.018221378326416016,1.0,0.0
22
+ 1,B,6.345432281494141,5.99517822265625,0.20606327056884766,-0.0666804313659668,0.27274370193481445,1.0,1.0
23
+ 1,B,6.740971565246582,5.641914367675781,0.4784097671508789,0.09999847412109375,0.37841129302978516,1.0,1.0
24
+ 1,B,5.707085132598877,4.8130950927734375,0.10221242904663086,-0.0489201545715332,0.15113258361816406,1.0,1.0
25
+ 1,B,5.862342834472656,3.7231504917144775,0.5522534847259521,0.0049610137939453125,0.5472924709320068,1.0,1.0
26
+ 2,A,6.673676490783691,4.348787307739258,0.1006770133972168,0.018762588500976562,0.08191442489624023,1.0,1.0
27
+ 2,A,7.934325218200684,4.8662004470825195,-0.044610023498535156,0.5006852149963379,-0.545295238494873,0.0,0.0
28
+ 2,A,7.7681684494018555,5.819746017456055,0.08734798431396484,0.1978778839111328,-0.11052989959716797,1.0,0.0
29
+ 2,A,4.429159641265869,2.993326425552368,0.253277063369751,0.040935516357421875,0.2123415470123291,1.0,1.0
30
+ 2,A,5.552468776702881,4.491331100463867,0.05975818634033203,0.11153602600097656,-0.05177783966064453,1.0,0.0
31
+ 2,A,7.393430709838867,4.428481101989746,0.04888296127319336,0.3259925842285156,-0.27710962295532227,1.0,0.0
32
+ 2,B,7.061038494110107,5.252832412719727,0.562720775604248,0.05635547637939453,0.5063652992248535,1.0,1.0
33
+ 2,B,6.661535263061523,4.521552085876465,0.7772245407104492,0.13185596466064453,0.6453685760498047,1.0,1.0
34
+ 2,B,7.829034805297852,6.124711990356445,0.03461790084838867,0.6401610374450684,-0.6055431365966797,1.0,0.0
35
+ 2,B,6.955010414123535,5.563559532165527,0.1147775650024414,0.08140134811401367,0.033376216888427734,1.0,1.0
36
+ 2,B,6.0308732986450195,4.914271831512451,0.10027790069580078,0.14583158493041992,-0.04555368423461914,1.0,0.0
37
+ 2,B,5.421048164367676,4.5919342041015625,0.23354339599609375,0.34870147705078125,-0.1151580810546875,1.0,0.0
38
+ 3,A,6.093291282653809,3.3783297538757324,0.22236013412475586,0.2968864440917969,-0.07452630996704102,1.0,0.0
39
+ 3,A,6.040767669677734,4.299949645996094,0.12599802017211914,0.4131031036376953,-0.28710508346557617,1.0,0.0
40
+ 3,A,10.828564643859863,10.134505271911621,0.03464221954345703,0.05852222442626953,-0.0238800048828125,1.0,0.0
41
+ 3,A,5.5282745361328125,4.700137138366699,0.1009206771850586,0.1028757095336914,-0.0019550323486328125,1.0,0.0
42
+ 3,A,5.479219436645508,5.24912166595459,0.11803340911865234,-0.04753828048706055,0.1655716896057129,1.0,1.0
43
+ 3,A,5.519567966461182,2.9720022678375244,0.6107382774353027,0.212782621383667,0.39795565605163574,1.0,1.0
44
+ 3,B,6.223211288452148,4.593959808349609,0.7076888084411621,0.05277442932128906,0.654914379119873,1.0,1.0
45
+ 3,B,7.6375908851623535,4.928959369659424,0.024238109588623047,0.3540682792663574,-0.3298301696777344,1.0,0.0
46
+ 3,B,6.797830104827881,5.713385581970215,0.18544483184814453,0.11074447631835938,0.07470035552978516,1.0,1.0
47
+ 3,B,8.122359275817871,7.236609935760498,0.18815326690673828,-0.002670764923095703,0.19082403182983398,1.0,1.0
48
+ 3,B,7.516794204711914,6.6155195236206055,0.1118154525756836,0.07668304443359375,0.035132408142089844,1.0,1.0
49
+ 3,B,6.534396648406982,4.394172668457031,0.2741432189941406,0.21160125732421875,0.06254196166992188,1.0,1.0
50
+ 4,A,6.6282148361206055,4.997343063354492,0.28153038024902344,-0.007631778717041016,0.28916215896606445,1.0,1.0
51
+ 4,A,6.776637077331543,6.469211578369141,-0.0004911422729492188,-0.016918182373046875,0.016427040100097656,0.0,1.0
52
+ 4,A,8.005274772644043,7.775458812713623,0.17998552322387695,0.03472280502319336,0.1452627182006836,1.0,1.0
53
+ 4,A,7.129036903381348,5.943839073181152,0.030692100524902344,0.06613349914550781,-0.03544139862060547,1.0,0.0
54
+ 4,A,6.952116012573242,5.439513206481934,-0.05237865447998047,0.3261375427246094,-0.37851619720458984,0.0,0.0
55
+ 4,A,8.852160453796387,7.181132793426514,0.18855857849121094,0.6086544990539551,-0.42009592056274414,1.0,0.0
56
+ 4,B,6.2537055015563965,5.618964195251465,0.10747003555297852,-0.01251220703125,0.11998224258422852,1.0,1.0
57
+ 4,B,5.426541328430176,4.298945903778076,0.056885719299316406,0.14619207382202148,-0.08930635452270508,1.0,0.0
58
+ 4,B,5.047521591186523,4.144989013671875,0.10515165328979492,0.020682811737060547,0.08446884155273438,1.0,1.0
59
+ 4,B,6.458707809448242,2.9507436752319336,0.6703057289123535,0.4984564781188965,0.17184925079345703,1.0,1.0
60
+ 4,B,9.775327682495117,8.660690307617188,0.5272178649902344,0.058966636657714844,0.46825122833251953,1.0,1.0
61
+ 4,B,6.316150188446045,5.665249347686768,0.2583045959472656,-0.009064674377441406,0.26736927032470703,1.0,1.0
62
+ 5,A,8.627079963684082,7.388840675354004,0.1279153823852539,0.02632617950439453,0.10158920288085938,1.0,1.0
63
+ 5,A,5.437914848327637,4.315256595611572,0.41527509689331055,0.007633686065673828,0.4076414108276367,1.0,1.0
64
+ 5,A,4.860602378845215,3.1047863960266113,0.18800830841064453,0.10079479217529297,0.08721351623535156,1.0,1.0
65
+ 5,A,7.81179141998291,4.247095584869385,2.5726304054260254,0.1318984031677246,2.440732002258301,1.0,1.0
66
+ 5,A,6.77659797668457,4.786273956298828,0.6612687110900879,0.14129352569580078,0.5199751853942871,1.0,1.0
67
+ 5,A,7.716449737548828,2.988969564437866,4.223865747451782,-0.05903029441833496,4.282896041870117,1.0,1.0
68
+ 5,B,6.047875881195068,3.9379725456237793,0.32158851623535156,-0.032253265380859375,0.35384178161621094,1.0,1.0
69
+ 5,B,5.260950088500977,2.80088472366333,0.1835005283355713,-0.0210573673248291,0.2045578956604004,1.0,1.0
70
+ 5,B,10.997361183166504,10.272318840026855,0.2654390335083008,0.05225849151611328,0.2131805419921875,1.0,1.0
71
+ 5,B,7.800644874572754,7.248934745788574,0.2220325469970703,0.07429027557373047,0.14774227142333984,1.0,1.0
72
+ 5,B,3.8385443687438965,1.0215389728546143,2.2528562545776367,0.03698444366455078,2.215871810913086,1.0,1.0
73
+ 5,B,6.994104862213135,5.828246116638184,0.2609214782714844,0.24599933624267578,0.014922142028808594,1.0,1.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_candidate_zh_zh.csv ADDED
@@ -0,0 +1,73 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ panel_id,family,beta0_nll,full_nll,target_drop_penalty,control_median_penalty,target_minus_control_median,target_positive,target_beats_control_median
2
+ 0,A,7.185009002685547,7.00240421295166,0.12111091613769531,0.008398056030273438,0.11271286010742188,1.0,1.0
3
+ 0,A,9.561330795288086,9.347586631774902,0.01691722869873047,-0.004517555236816406,0.021434783935546875,1.0,1.0
4
+ 0,A,5.432873249053955,5.179419040679932,0.026144981384277344,0.12058734893798828,-0.09444236755371094,1.0,0.0
5
+ 0,A,7.156802177429199,7.112701416015625,0.0023097991943359375,-0.01926708221435547,0.021576881408691406,1.0,1.0
6
+ 0,A,6.365907669067383,6.085839748382568,0.05269575119018555,0.005738735198974609,0.04695701599121094,1.0,1.0
7
+ 0,A,6.184957504272461,6.2435526847839355,0.011548519134521484,-0.035562992095947266,0.04711151123046875,1.0,1.0
8
+ 0,B,5.740145206451416,4.4268083572387695,0.22286462783813477,0.004197120666503906,0.21866750717163086,1.0,1.0
9
+ 0,B,6.171397686004639,6.166073799133301,0.014899253845214844,0.01097869873046875,0.003920555114746094,1.0,1.0
10
+ 0,B,10.135851860046387,9.99020767211914,0.017104148864746094,-0.03663921356201172,0.05374336242675781,1.0,1.0
11
+ 0,B,7.236214637756348,6.644723892211914,0.06814384460449219,0.0014591217041015625,0.06668472290039062,1.0,1.0
12
+ 0,B,6.969799995422363,6.727546215057373,0.039391517639160156,0.03883028030395508,0.0005612373352050781,1.0,1.0
13
+ 0,B,4.762937545776367,4.048763275146484,0.08134269714355469,0.0807962417602539,0.0005464553833007812,1.0,1.0
14
+ 1,A,6.439607620239258,5.767301559448242,0.09425687789916992,0.07800912857055664,0.01624774932861328,1.0,1.0
15
+ 1,A,8.383091926574707,8.370704650878906,0.05109882354736328,0.013734817504882812,0.03736400604248047,1.0,1.0
16
+ 1,A,6.662784576416016,6.478204727172852,0.0006589889526367188,-0.013574600219726562,0.014233589172363281,1.0,1.0
17
+ 1,A,5.9806342124938965,5.2863688468933105,0.20487499237060547,0.020007610321044922,0.18486738204956055,1.0,1.0
18
+ 1,A,7.019984722137451,6.006829261779785,0.3874807357788086,0.08730697631835938,0.3001737594604492,1.0,1.0
19
+ 1,A,4.983373641967773,4.464967727661133,0.28818511962890625,0.006708621978759766,0.2814764976501465,1.0,1.0
20
+ 1,B,6.500181198120117,6.122262001037598,0.057464599609375,0.05225086212158203,0.005213737487792969,1.0,1.0
21
+ 1,B,7.228586673736572,6.822879791259766,0.11527061462402344,0.08379745483398438,0.03147315979003906,1.0,1.0
22
+ 1,B,6.019789695739746,5.226245880126953,0.4525423049926758,0.0630655288696289,0.3894767761230469,1.0,1.0
23
+ 1,B,5.326053619384766,4.747788429260254,0.02956104278564453,0.09669733047485352,-0.06713628768920898,1.0,0.0
24
+ 1,B,7.068150520324707,6.694842338562012,0.08556747436523438,0.03700733184814453,0.048560142517089844,1.0,1.0
25
+ 1,B,5.852489471435547,5.644482135772705,0.04106569290161133,0.02487468719482422,0.01619100570678711,1.0,1.0
26
+ 2,A,6.68202543258667,6.76338005065918,0.024964332580566406,-0.026864051818847656,0.05182838439941406,1.0,1.0
27
+ 2,A,6.6932220458984375,6.474020004272461,0.03578758239746094,0.002864837646484375,0.03292274475097656,1.0,1.0
28
+ 2,A,5.459330081939697,5.316182613372803,0.11433172225952148,-0.012101173400878906,0.1264328956604004,1.0,1.0
29
+ 2,A,5.483784198760986,5.351100921630859,0.0009331703186035156,-0.08625078201293945,0.08718395233154297,1.0,1.0
30
+ 2,A,5.47296142578125,5.152926445007324,0.0027718544006347656,0.005751132965087891,-0.002979278564453125,1.0,0.0
31
+ 2,A,6.555480480194092,6.752163410186768,-0.06732892990112305,-0.018640518188476562,-0.048688411712646484,0.0,0.0
32
+ 2,B,6.083982467651367,5.476622581481934,0.14194202423095703,0.024567604064941406,0.11737442016601562,1.0,1.0
33
+ 2,B,6.983787536621094,7.020696640014648,-0.009392738342285156,0.002891063690185547,-0.012283802032470703,0.0,0.0
34
+ 2,B,9.180006980895996,8.985904693603516,0.0652303695678711,0.00481414794921875,0.060416221618652344,1.0,1.0
35
+ 2,B,5.9402008056640625,5.434652805328369,0.02412271499633789,0.014305591583251953,0.009817123413085938,1.0,1.0
36
+ 2,B,7.154976844787598,7.1899614334106445,-0.0046100616455078125,0.004927635192871094,-0.009537696838378906,0.0,0.0
37
+ 2,B,7.261051177978516,6.799153804779053,0.012684345245361328,0.05762434005737305,-0.04493999481201172,1.0,0.0
38
+ 3,A,6.555492401123047,7.117630958557129,-0.0074920654296875,-0.17423152923583984,0.16673946380615234,0.0,1.0
39
+ 3,A,5.488699913024902,5.157156944274902,0.06065654754638672,0.07573413848876953,-0.015077590942382812,1.0,0.0
40
+ 3,A,5.242793560028076,4.929186820983887,0.028070449829101562,0.029188156127929688,-0.001117706298828125,1.0,0.0
41
+ 3,A,5.29630184173584,5.404637813568115,-0.06986618041992188,-0.013226985931396484,-0.05663919448852539,0.0,0.0
42
+ 3,A,6.285325050354004,5.781695365905762,0.11175060272216797,0.021421432495117188,0.09032917022705078,1.0,1.0
43
+ 3,A,4.851968765258789,4.052178859710693,-0.03213644027709961,-0.00017595291137695312,-0.031960487365722656,0.0,0.0
44
+ 3,B,7.085685729980469,6.892068862915039,0.1951889991760254,0.03585338592529297,0.15933561325073242,1.0,1.0
45
+ 3,B,6.167534828186035,5.326044082641602,0.1287860870361328,0.1716446876525879,-0.04285860061645508,1.0,0.0
46
+ 3,B,5.94005823135376,5.235082626342773,0.3284626007080078,-0.03055286407470703,0.35901546478271484,1.0,1.0
47
+ 3,B,9.317268371582031,9.336538314819336,-0.011862754821777344,-0.013591766357421875,0.0017290115356445312,0.0,1.0
48
+ 3,B,7.331362724304199,7.145159721374512,0.052978515625,0.025675296783447266,0.027303218841552734,1.0,1.0
49
+ 3,B,6.305840015411377,6.047492027282715,0.1813211441040039,0.022147178649902344,0.15917396545410156,1.0,1.0
50
+ 4,A,6.393706321716309,6.2861504554748535,-0.09884881973266602,-0.042870521545410156,-0.05597829818725586,0.0,0.0
51
+ 4,A,9.565173149108887,9.62588119506836,0.012987136840820312,-0.0294952392578125,0.04248237609863281,1.0,1.0
52
+ 4,A,5.699604034423828,5.68453311920166,-0.009347915649414062,0.03203248977661133,-0.04138040542602539,0.0,0.0
53
+ 4,A,5.848155498504639,5.472043037414551,0.061305999755859375,0.02714681625366211,0.034159183502197266,1.0,1.0
54
+ 4,A,8.873228073120117,8.674339294433594,0.060039520263671875,0.0041637420654296875,0.05587577819824219,1.0,1.0
55
+ 4,A,5.13867712020874,4.769907474517822,0.0639195442199707,0.11490583419799805,-0.050986289978027344,1.0,0.0
56
+ 4,B,7.314133644104004,7.034363269805908,-0.020635128021240234,0.01951456069946289,-0.040149688720703125,0.0,0.0
57
+ 4,B,5.367845058441162,5.159089088439941,0.13143253326416016,0.03289651870727539,0.09853601455688477,1.0,1.0
58
+ 4,B,7.074519157409668,6.708345890045166,0.16562318801879883,0.03043985366821289,0.13518333435058594,1.0,1.0
59
+ 4,B,7.640630722045898,7.032473564147949,0.019023895263671875,0.000156402587890625,0.01886749267578125,1.0,1.0
60
+ 4,B,7.700789451599121,7.475289344787598,0.0066776275634765625,-0.01317739486694336,0.019855022430419922,1.0,1.0
61
+ 4,B,6.669111251831055,6.294923782348633,0.22451305389404297,-0.030710220336914062,0.25522327423095703,1.0,1.0
62
+ 5,A,7.442265033721924,7.513637542724609,-0.006282329559326172,0.018263816833496094,-0.024546146392822266,0.0,0.0
63
+ 5,A,6.04044246673584,5.766310691833496,0.0811758041381836,0.0034332275390625,0.0777425765991211,1.0,1.0
64
+ 5,A,7.08819580078125,7.305697917938232,-0.05384492874145508,-0.06722688674926758,0.0133819580078125,0.0,1.0
65
+ 5,A,6.961637020111084,6.973635196685791,-0.002311229705810547,-0.02566051483154297,0.023349285125732422,0.0,1.0
66
+ 5,A,6.841346740722656,6.336986064910889,0.04925203323364258,0.006276607513427734,0.042975425720214844,1.0,1.0
67
+ 5,A,5.011490821838379,4.769320487976074,0.02754974365234375,0.02443981170654297,0.0031099319458007812,1.0,1.0
68
+ 5,B,5.641366004943848,5.371521949768066,0.01994800567626953,-0.009510993957519531,0.029458999633789062,1.0,1.0
69
+ 5,B,9.925100326538086,9.450077056884766,0.14940261840820312,0.023255348205566406,0.12614727020263672,1.0,1.0
70
+ 5,B,7.312159061431885,6.688832759857178,-0.015787601470947266,0.03628206253051758,-0.052069664001464844,0.0,0.0
71
+ 5,B,6.67337703704834,6.408179759979248,0.041460514068603516,-0.02083873748779297,0.062299251556396484,1.0,1.0
72
+ 5,B,6.309573173522949,6.325689315795898,-0.0001068115234375,0.015699386596679688,-0.015806198120117188,0.0,0.0
73
+ 5,B,9.401510238647461,9.149972915649414,0.018798828125,0.025114059448242188,-0.0063152313232421875,1.0,0.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_causality.csv ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ kind,seq_len,max_abs_prefix_logit_diff,mean_abs_prefix_logit_diff
2
+ OLD,512,0.0,0.0
3
+ OLD,1024,0.0,0.0
4
+ OLD,1536,0.0,0.0
5
+ OLD,2048,0.0,0.0
6
+ CHINESE,512,0.0,0.0
7
+ CHINESE,1024,0.0,0.0
8
+ CHINESE,1536,0.0,0.0
9
+ CHINESE,2048,0.0,0.0
10
+ MIXED,512,0.0,0.0
11
+ MIXED,1024,0.0,0.0
12
+ MIXED,1536,0.0,0.0
13
+ MIXED,2048,0.0,0.0
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_replay.csv ADDED
@@ -0,0 +1,769 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ event,update,record_kind,mode,target_gap,specificity_gap,target_hinge_active,specificity_hinge_active
2
+ 0,8,base,ZH_ZH,-0.014170169830322266,0.018065452575683594,True,False
3
+ 0,8,extra,ZH_EN,-0.010571956634521484,0.029723405838012695,True,False
4
+ 1,16,base,ZH_ZH,-0.0015196800231933594,-0.018274784088134766,False,True
5
+ 1,16,extra,EN_ZH,0.009844779968261719,-0.0007171630859375,False,False
6
+ 2,24,base,ZH_EN,-0.01604008674621582,-0.024418354034423828,True,True
7
+ 2,24,extra,ZH_ZH,0.01991558074951172,0.012776374816894531,False,False
8
+ 3,32,base,EN_ZH,0.008275985717773438,0.025066375732421875,False,False
9
+ 3,32,extra,ZH_ZH,-0.0022420883178710938,0.009037971496582031,False,False
10
+ 4,40,base,ZH_ZH,0.0031104087829589844,-0.052734375,False,True
11
+ 4,40,extra,ZH_EN,-0.009615898132324219,0.014711380004882812,True,False
12
+ 5,48,base,ZH_ZH,0.019322872161865234,0.028030872344970703,False,False
13
+ 5,48,extra,EN_ZH,-0.003788471221923828,-0.015488147735595703,False,True
14
+ 6,56,base,ZH_EN,0.005652427673339844,0.006447792053222656,False,False
15
+ 6,56,extra,ZH_ZH,0.03925466537475586,0.0390009880065918,False,False
16
+ 7,64,base,EN_ZH,-0.009705543518066406,-0.0027866363525390625,True,False
17
+ 7,64,extra,ZH_ZH,-0.0517573356628418,-0.014817237854003906,True,True
18
+ 8,72,base,ZH_ZH,0.0036067962646484375,-0.022757530212402344,False,True
19
+ 8,72,extra,ZH_EN,0.039693355560302734,0.03427600860595703,False,False
20
+ 9,80,base,ZH_ZH,-0.049630165100097656,-0.030033588409423828,True,True
21
+ 9,80,extra,EN_ZH,0.018390178680419922,-0.004359245300292969,False,False
22
+ 10,88,base,ZH_EN,-0.04525899887084961,-0.040873050689697266,True,True
23
+ 10,88,extra,ZH_ZH,0.001369476318359375,0.026436328887939453,False,False
24
+ 11,96,base,EN_ZH,0.0026178359985351562,0.01603078842163086,False,False
25
+ 11,96,extra,ZH_ZH,0.006273746490478516,0.00946664810180664,False,False
26
+ 12,104,base,ZH_ZH,-0.034653663635253906,0.005309581756591797,True,False
27
+ 12,104,extra,ZH_EN,0.01455068588256836,0.012689590454101562,False,False
28
+ 13,112,base,ZH_ZH,-0.04107952117919922,-0.029022693634033203,True,True
29
+ 13,112,extra,EN_ZH,0.0013628005981445312,-0.017129898071289062,False,True
30
+ 14,120,base,ZH_EN,0.0038232803344726562,-0.0187835693359375,False,True
31
+ 14,120,extra,ZH_ZH,0.0243072509765625,0.06869840621948242,False,False
32
+ 15,128,base,EN_ZH,-0.019074440002441406,-0.00910186767578125,True,True
33
+ 15,128,extra,ZH_ZH,-0.003124237060546875,0.014834403991699219,False,False
34
+ 16,136,base,ZH_ZH,-0.08307218551635742,-0.009006023406982422,True,True
35
+ 16,136,extra,ZH_EN,-0.13503623008728027,-0.04284930229187012,True,True
36
+ 17,144,base,ZH_ZH,0.06908941268920898,0.051859378814697266,False,False
37
+ 17,144,extra,EN_ZH,-0.0035648345947265625,0.004954814910888672,False,False
38
+ 18,152,base,ZH_EN,-0.09140443801879883,-0.010191917419433594,True,True
39
+ 18,152,extra,ZH_ZH,0.0019068717956542969,-0.004795551300048828,False,False
40
+ 19,160,base,EN_ZH,-0.029718875885009766,-0.020560264587402344,True,True
41
+ 19,160,extra,ZH_ZH,0.02006673812866211,0.046636104583740234,False,False
42
+ 20,168,base,ZH_ZH,0.05962562561035156,-0.011966705322265625,False,True
43
+ 20,168,extra,ZH_EN,0.015089988708496094,0.031275272369384766,False,False
44
+ 21,176,base,ZH_ZH,-0.034877777099609375,0.0005698204040527344,True,False
45
+ 21,176,extra,EN_ZH,0.015766620635986328,-0.020298004150390625,False,True
46
+ 22,184,base,ZH_EN,-0.032601356506347656,0.011129379272460938,True,False
47
+ 22,184,extra,ZH_ZH,0.0055694580078125,-0.01325368881225586,False,True
48
+ 23,192,base,EN_ZH,-0.026947498321533203,-0.030915260314941406,True,True
49
+ 23,192,extra,ZH_ZH,0.03958559036254883,0.0147552490234375,False,False
50
+ 24,200,base,ZH_ZH,-0.04102373123168945,0.004366397857666016,True,False
51
+ 24,200,extra,ZH_EN,-0.00231170654296875,-0.013852357864379883,False,True
52
+ 25,208,base,ZH_ZH,-0.016717910766601562,-0.011035919189453125,True,True
53
+ 25,208,extra,EN_ZH,0.029850482940673828,0.023088455200195312,False,False
54
+ 26,216,base,ZH_EN,-0.005124092102050781,-0.034757137298583984,True,True
55
+ 26,216,extra,ZH_ZH,0.0028252601623535156,0.00992584228515625,False,False
56
+ 27,224,base,EN_ZH,-0.021552562713623047,0.046142578125,True,False
57
+ 27,224,extra,ZH_ZH,-0.011744499206542969,0.04285430908203125,True,False
58
+ 28,232,base,ZH_ZH,-0.05405282974243164,-0.04386758804321289,True,True
59
+ 28,232,extra,ZH_EN,0.016829967498779297,-0.03639101982116699,False,True
60
+ 29,240,base,ZH_ZH,0.04535961151123047,0.050020694732666016,False,False
61
+ 29,240,extra,EN_ZH,0.02259969711303711,0.05116558074951172,False,False
62
+ 30,248,base,ZH_EN,-0.006545066833496094,0.007355690002441406,True,False
63
+ 30,248,extra,ZH_ZH,0.05182695388793945,-0.028337478637695312,False,True
64
+ 31,256,base,EN_ZH,-0.03818321228027344,-0.005366325378417969,True,True
65
+ 31,256,extra,ZH_ZH,-0.011983394622802734,0.007395744323730469,True,False
66
+ 32,264,base,ZH_ZH,0.02646160125732422,0.034493446350097656,False,False
67
+ 32,264,extra,ZH_EN,-0.03198504447937012,-0.038305044174194336,True,True
68
+ 33,272,base,ZH_ZH,0.04265022277832031,0.09611797332763672,False,False
69
+ 33,272,extra,EN_ZH,0.019735336303710938,0.03043222427368164,False,False
70
+ 34,280,base,ZH_EN,0.02798938751220703,0.020193099975585938,False,False
71
+ 34,280,extra,ZH_ZH,-0.029757976531982422,-0.01661968231201172,True,True
72
+ 35,288,base,EN_ZH,0.03945636749267578,0.055553436279296875,False,False
73
+ 35,288,extra,ZH_ZH,0.014126300811767578,-0.010698795318603516,False,True
74
+ 36,296,base,ZH_ZH,0.018993854522705078,-0.03317594528198242,False,True
75
+ 36,296,extra,ZH_EN,-0.020827293395996094,-0.0029523372650146484,True,False
76
+ 37,304,base,ZH_ZH,0.005950927734375,-0.041429996490478516,False,True
77
+ 37,304,extra,EN_ZH,0.004983425140380859,0.0695796012878418,False,False
78
+ 38,312,base,ZH_EN,0.04922676086425781,-0.024254322052001953,False,True
79
+ 38,312,extra,ZH_ZH,0.022300243377685547,0.010090351104736328,False,False
80
+ 39,320,base,EN_ZH,0.00840616226196289,-0.0480198860168457,False,True
81
+ 39,320,extra,ZH_ZH,-0.030097484588623047,-0.10521650314331055,True,True
82
+ 40,328,base,ZH_ZH,0.011855125427246094,0.015938282012939453,False,False
83
+ 40,328,extra,ZH_EN,-0.008661746978759766,-0.010260343551635742,True,True
84
+ 41,336,base,ZH_ZH,0.019744873046875,0.011182308197021484,False,False
85
+ 41,336,extra,EN_ZH,0.005174160003662109,0.04583406448364258,False,False
86
+ 42,344,base,ZH_EN,-0.015430450439453125,-0.006872415542602539,True,True
87
+ 42,344,extra,ZH_ZH,-0.0036439895629882812,0.0035080909729003906,False,False
88
+ 43,352,base,EN_ZH,-0.035157203674316406,-0.006732940673828125,True,True
89
+ 43,352,extra,ZH_ZH,0.06517791748046875,0.014124393463134766,False,False
90
+ 44,360,base,ZH_ZH,0.02402210235595703,0.037653446197509766,False,False
91
+ 44,360,extra,ZH_EN,0.14165353775024414,0.09615373611450195,False,False
92
+ 45,368,base,ZH_ZH,-0.023697853088378906,-0.007287025451660156,True,True
93
+ 45,368,extra,EN_ZH,-0.006519317626953125,0.024012088775634766,True,False
94
+ 46,376,base,ZH_EN,-0.03130817413330078,-0.035074710845947266,True,True
95
+ 46,376,extra,ZH_ZH,-0.04859733581542969,-0.032006263732910156,True,True
96
+ 47,384,base,EN_ZH,-0.02077770233154297,-0.010386466979980469,True,True
97
+ 47,384,extra,ZH_ZH,-0.031968116760253906,-0.03090953826904297,True,True
98
+ 48,392,base,ZH_ZH,-0.0016903877258300781,0.0582427978515625,False,False
99
+ 48,392,extra,ZH_EN,-0.012895345687866211,-0.025740623474121094,True,True
100
+ 49,400,base,ZH_ZH,-0.06078147888183594,-0.07065629959106445,True,True
101
+ 49,400,extra,EN_ZH,0.00018978118896484375,0.02156352996826172,False,False
102
+ 50,408,base,ZH_EN,0.010054588317871094,0.043929100036621094,False,False
103
+ 50,408,extra,ZH_ZH,0.0011281967163085938,-0.09276056289672852,False,True
104
+ 51,416,base,EN_ZH,-0.03850126266479492,-0.06585121154785156,True,True
105
+ 51,416,extra,ZH_ZH,-0.0032014846801757812,0.018938541412353516,False,False
106
+ 52,424,base,ZH_ZH,-0.03820514678955078,-0.02650594711303711,True,True
107
+ 52,424,extra,ZH_EN,-0.020412445068359375,0.0016536712646484375,True,False
108
+ 53,432,base,ZH_ZH,0.03479719161987305,0.056322574615478516,False,False
109
+ 53,432,extra,EN_ZH,-0.01152658462524414,0.0079345703125,True,False
110
+ 54,440,base,ZH_EN,0.20771503448486328,0.18677997589111328,False,False
111
+ 54,440,extra,ZH_ZH,-0.01208353042602539,-0.018886566162109375,True,True
112
+ 55,448,base,EN_ZH,-0.008205413818359375,0.0015287399291992188,True,False
113
+ 55,448,extra,ZH_ZH,0.03854084014892578,0.03034496307373047,False,False
114
+ 56,456,base,ZH_ZH,-0.031699180603027344,-0.017670631408691406,True,True
115
+ 56,456,extra,ZH_EN,0.02063894271850586,0.03072500228881836,False,False
116
+ 57,464,base,ZH_ZH,-0.0759134292602539,-0.018624305725097656,True,True
117
+ 57,464,extra,EN_ZH,-0.03725767135620117,0.003676891326904297,True,False
118
+ 58,472,base,ZH_EN,0.07578635215759277,0.020044326782226562,False,False
119
+ 58,472,extra,ZH_ZH,-0.05548810958862305,-0.007715702056884766,True,True
120
+ 59,480,base,EN_ZH,0.0005173683166503906,0.054277896881103516,False,False
121
+ 59,480,extra,ZH_ZH,0.09796428680419922,-0.037312984466552734,False,True
122
+ 60,488,base,ZH_ZH,0.07708740234375,0.035178184509277344,False,False
123
+ 60,488,extra,ZH_EN,0.015232086181640625,-0.00543975830078125,False,True
124
+ 61,496,base,ZH_ZH,0.010922908782958984,0.039214134216308594,False,False
125
+ 61,496,extra,EN_ZH,-0.0057964324951171875,0.0005764961242675781,True,False
126
+ 62,504,base,ZH_EN,0.08161473274230957,0.012176752090454102,False,False
127
+ 62,504,extra,ZH_ZH,-0.031219005584716797,0.03962373733520508,True,False
128
+ 63,512,base,EN_ZH,0.08308649063110352,0.09727096557617188,False,False
129
+ 63,512,extra,ZH_ZH,0.015892982482910156,0.02573871612548828,False,False
130
+ 64,520,base,ZH_ZH,-0.05857992172241211,-0.10234260559082031,True,True
131
+ 64,520,extra,ZH_EN,0.03751802444458008,-0.01771259307861328,False,True
132
+ 65,528,base,ZH_ZH,0.060123443603515625,0.08312606811523438,False,False
133
+ 65,528,extra,EN_ZH,0.014157295227050781,0.05066490173339844,False,False
134
+ 66,536,base,ZH_EN,-0.018968582153320312,0.008452415466308594,True,False
135
+ 66,536,extra,ZH_ZH,-0.013887882232666016,-0.09423828125,True,True
136
+ 67,544,base,EN_ZH,0.0010428428649902344,0.04635190963745117,False,False
137
+ 67,544,extra,ZH_ZH,0.017638683319091797,0.015253543853759766,False,False
138
+ 68,552,base,ZH_ZH,-0.006869316101074219,0.01646137237548828,True,False
139
+ 68,552,extra,ZH_EN,-0.0071506500244140625,-0.07182931900024414,True,True
140
+ 69,560,base,ZH_ZH,-0.0744781494140625,-0.08061838150024414,True,True
141
+ 69,560,extra,EN_ZH,0.07359695434570312,0.06786203384399414,False,False
142
+ 70,568,base,ZH_EN,0.002288341522216797,0.06430768966674805,False,False
143
+ 70,568,extra,ZH_ZH,0.06728315353393555,0.05205249786376953,False,False
144
+ 71,576,base,EN_ZH,0.03941059112548828,0.012692928314208984,False,False
145
+ 71,576,extra,ZH_ZH,-0.003928661346435547,-0.0005030632019042969,False,False
146
+ 72,584,base,ZH_ZH,-0.023103713989257812,-0.01704692840576172,True,True
147
+ 72,584,extra,ZH_EN,-0.04600858688354492,-0.049839019775390625,True,True
148
+ 73,592,base,ZH_ZH,0.019621849060058594,-0.01153564453125,False,True
149
+ 73,592,extra,EN_ZH,0.00036716461181640625,-0.025306224822998047,False,True
150
+ 74,600,base,ZH_EN,-0.017340660095214844,0.05633735656738281,True,False
151
+ 74,600,extra,ZH_ZH,0.004822254180908203,-0.0351710319519043,False,True
152
+ 75,608,base,EN_ZH,0.07587146759033203,0.04044914245605469,False,False
153
+ 75,608,extra,ZH_ZH,0.016064167022705078,0.07206344604492188,False,False
154
+ 76,616,base,ZH_ZH,0.056789398193359375,0.04161643981933594,False,False
155
+ 76,616,extra,ZH_EN,-0.005178928375244141,-0.03577709197998047,True,True
156
+ 77,624,base,ZH_ZH,0.009582042694091797,-0.0889744758605957,False,True
157
+ 77,624,extra,EN_ZH,-0.015287399291992188,-0.11755752563476562,True,True
158
+ 78,632,base,ZH_EN,0.02396869659423828,0.024713993072509766,False,False
159
+ 78,632,extra,ZH_ZH,0.00146484375,-0.03626251220703125,False,True
160
+ 79,640,base,EN_ZH,0.02470254898071289,0.018648624420166016,False,False
161
+ 79,640,extra,ZH_ZH,0.010431766510009766,0.03951311111450195,False,False
162
+ 80,648,base,ZH_ZH,0.00856637954711914,0.04917573928833008,False,False
163
+ 80,648,extra,ZH_EN,-0.014983177185058594,0.021541595458984375,True,False
164
+ 81,656,base,ZH_ZH,0.03814077377319336,0.08102941513061523,False,False
165
+ 81,656,extra,EN_ZH,0.0163726806640625,0.02294158935546875,False,False
166
+ 82,664,base,ZH_EN,0.022275924682617188,-0.041945457458496094,False,True
167
+ 82,664,extra,ZH_ZH,-0.024915218353271484,0.0015592575073242188,True,False
168
+ 83,672,base,EN_ZH,0.03827619552612305,0.04343414306640625,False,False
169
+ 83,672,extra,ZH_ZH,0.03476285934448242,0.011385917663574219,False,False
170
+ 84,680,base,ZH_ZH,-0.007944107055664062,-0.04733848571777344,True,True
171
+ 84,680,extra,ZH_EN,-0.0023610591888427734,0.018954992294311523,False,False
172
+ 85,688,base,ZH_ZH,0.06505250930786133,0.09444952011108398,False,False
173
+ 85,688,extra,EN_ZH,0.03619194030761719,0.023306846618652344,False,False
174
+ 86,696,base,ZH_EN,0.025651931762695312,0.06814861297607422,False,False
175
+ 86,696,extra,ZH_ZH,-0.018351078033447266,-0.015144824981689453,True,True
176
+ 87,704,base,EN_ZH,0.05505657196044922,0.020464420318603516,False,False
177
+ 87,704,extra,ZH_ZH,-0.06885051727294922,-0.003876209259033203,True,False
178
+ 88,712,base,ZH_ZH,0.0876309871673584,0.07895040512084961,False,False
179
+ 88,712,extra,ZH_EN,-0.018652915954589844,-0.06178021430969238,True,True
180
+ 89,720,base,ZH_ZH,-0.015583515167236328,-0.0134124755859375,True,True
181
+ 89,720,extra,EN_ZH,-0.05140495300292969,-0.016636371612548828,True,True
182
+ 90,728,base,ZH_EN,0.055321455001831055,0.05858492851257324,False,False
183
+ 90,728,extra,ZH_ZH,-0.05027914047241211,-0.05450773239135742,True,True
184
+ 91,736,base,EN_ZH,0.036843299865722656,0.027650833129882812,False,False
185
+ 91,736,extra,ZH_ZH,-0.015935897827148438,-0.04018592834472656,True,True
186
+ 92,744,base,ZH_ZH,-0.02491617202758789,0.044219017028808594,True,False
187
+ 92,744,extra,ZH_EN,0.1258559226989746,0.12591171264648438,False,False
188
+ 93,752,base,ZH_ZH,-0.007660388946533203,-0.03763771057128906,True,True
189
+ 93,752,extra,EN_ZH,-0.06636381149291992,-0.03840303421020508,True,True
190
+ 94,760,base,ZH_EN,0.011012554168701172,-0.0067272186279296875,False,True
191
+ 94,760,extra,ZH_ZH,0.02086925506591797,0.056632041931152344,False,False
192
+ 95,768,base,EN_ZH,-0.007718563079833984,0.11207771301269531,True,False
193
+ 95,768,extra,ZH_ZH,0.05826568603515625,-0.09144020080566406,False,True
194
+ 96,776,base,ZH_ZH,0.037641048431396484,0.027699947357177734,False,False
195
+ 96,776,extra,ZH_EN,0.5012829303741455,0.5348424911499023,False,False
196
+ 97,784,base,ZH_ZH,0.01751565933227539,0.026565074920654297,False,False
197
+ 97,784,extra,EN_ZH,0.014725685119628906,0.009186267852783203,False,False
198
+ 98,792,base,ZH_EN,-0.06666684150695801,-0.054210662841796875,True,True
199
+ 98,792,extra,ZH_ZH,-0.010040283203125,0.02454853057861328,True,False
200
+ 99,800,base,EN_ZH,-0.01541900634765625,0.029618263244628906,True,False
201
+ 99,800,extra,ZH_ZH,0.03360891342163086,0.058175086975097656,False,False
202
+ 100,808,base,ZH_ZH,-0.02812814712524414,0.0018129348754882812,True,False
203
+ 100,808,extra,ZH_EN,0.00939178466796875,0.043158531188964844,False,False
204
+ 101,816,base,ZH_ZH,0.005768299102783203,0.039569854736328125,False,False
205
+ 101,816,extra,EN_ZH,0.012347221374511719,-0.02247333526611328,False,True
206
+ 102,824,base,ZH_EN,-0.04970884323120117,-0.024839401245117188,True,True
207
+ 102,824,extra,ZH_ZH,-0.009582042694091797,0.04113626480102539,True,False
208
+ 103,832,base,EN_ZH,0.036540985107421875,0.0655069351196289,False,False
209
+ 103,832,extra,ZH_ZH,-0.012001991271972656,-0.010601997375488281,True,True
210
+ 104,840,base,ZH_ZH,0.038831233978271484,0.04607677459716797,False,False
211
+ 104,840,extra,ZH_EN,0.05112195014953613,0.08149003982543945,False,False
212
+ 105,848,base,ZH_ZH,-0.03934192657470703,-0.03178548812866211,True,True
213
+ 105,848,extra,EN_ZH,0.012553215026855469,0.01644277572631836,False,False
214
+ 106,856,base,ZH_EN,0.011662006378173828,0.049390316009521484,False,False
215
+ 106,856,extra,ZH_ZH,0.04922294616699219,0.049626827239990234,False,False
216
+ 107,864,base,EN_ZH,-0.019038677215576172,0.06739187240600586,True,False
217
+ 107,864,extra,ZH_ZH,0.06528282165527344,0.07324743270874023,False,False
218
+ 108,872,base,ZH_ZH,0.02090167999267578,0.012993812561035156,False,False
219
+ 108,872,extra,ZH_EN,0.045961856842041016,0.052872657775878906,False,False
220
+ 109,880,base,ZH_ZH,-0.027706623077392578,-0.008285045623779297,True,True
221
+ 109,880,extra,EN_ZH,0.08510923385620117,0.09840250015258789,False,False
222
+ 110,888,base,ZH_EN,0.07817769050598145,0.06293249130249023,False,False
223
+ 110,888,extra,ZH_ZH,0.017264842987060547,-0.014670372009277344,False,True
224
+ 111,896,base,EN_ZH,-0.0015058517456054688,-0.0366368293762207,False,True
225
+ 111,896,extra,ZH_ZH,0.0302276611328125,0.0034742355346679688,False,False
226
+ 112,904,base,ZH_ZH,0.03502202033996582,0.07908248901367188,False,False
227
+ 112,904,extra,ZH_EN,0.006946563720703125,0.06696605682373047,False,False
228
+ 113,912,base,ZH_ZH,0.013156890869140625,0.024621963500976562,False,False
229
+ 113,912,extra,EN_ZH,0.015302181243896484,0.09634780883789062,False,False
230
+ 114,920,base,ZH_EN,0.013224601745605469,0.017701148986816406,False,False
231
+ 114,920,extra,ZH_ZH,0.06446552276611328,0.012239933013916016,False,False
232
+ 115,928,base,EN_ZH,-0.03915596008300781,-0.020637989044189453,True,True
233
+ 115,928,extra,ZH_ZH,-0.0035233497619628906,0.1108546257019043,False,False
234
+ 116,936,base,ZH_ZH,-0.05694866180419922,0.003902435302734375,True,False
235
+ 116,936,extra,ZH_EN,-0.03677940368652344,-0.04389142990112305,True,True
236
+ 117,944,base,ZH_ZH,0.013735771179199219,0.010587692260742188,False,False
237
+ 117,944,extra,EN_ZH,0.17495298385620117,0.22914934158325195,False,False
238
+ 118,952,base,ZH_EN,0.09280586242675781,0.06995534896850586,False,False
239
+ 118,952,extra,ZH_ZH,-0.04268503189086914,0.02691793441772461,True,False
240
+ 119,960,base,EN_ZH,0.02888202667236328,0.030576229095458984,False,False
241
+ 119,960,extra,ZH_ZH,-0.0033206939697265625,-0.03652477264404297,False,True
242
+ 120,968,base,ZH_ZH,-0.012357234954833984,-0.022910594940185547,True,True
243
+ 120,968,extra,ZH_EN,-0.05037999153137207,-0.16064000129699707,True,True
244
+ 121,976,base,ZH_ZH,0.05274248123168945,0.053134918212890625,False,False
245
+ 121,976,extra,EN_ZH,0.008406639099121094,-0.0065212249755859375,False,True
246
+ 122,984,base,ZH_EN,0.19539546966552734,0.20809030532836914,False,False
247
+ 122,984,extra,ZH_ZH,0.035245418548583984,0.02808523178100586,False,False
248
+ 123,992,base,EN_ZH,-0.006365776062011719,-0.011844158172607422,True,True
249
+ 123,992,extra,ZH_ZH,-0.10822725296020508,-0.04534006118774414,True,True
250
+ 124,1000,base,ZH_ZH,-0.011011123657226562,0.010564804077148438,True,False
251
+ 124,1000,extra,ZH_EN,0.027156829833984375,-0.05247783660888672,False,True
252
+ 125,1008,base,ZH_ZH,0.054451942443847656,0.038349151611328125,False,False
253
+ 125,1008,extra,EN_ZH,-0.005797863006591797,-0.010956287384033203,True,True
254
+ 126,1016,base,ZH_EN,0.03719472885131836,0.08106613159179688,False,False
255
+ 126,1016,extra,ZH_ZH,-0.052231788635253906,-0.03545093536376953,True,True
256
+ 127,1024,base,EN_ZH,0.02752542495727539,0.01821613311767578,False,False
257
+ 127,1024,extra,ZH_ZH,0.08972740173339844,0.012941360473632812,False,False
258
+ 128,1032,base,ZH_ZH,0.07450532913208008,0.040950775146484375,False,False
259
+ 128,1032,extra,ZH_EN,0.014630317687988281,0.03869438171386719,False,False
260
+ 129,1040,base,ZH_ZH,-0.0819549560546875,-0.0889286994934082,True,True
261
+ 129,1040,extra,EN_ZH,0.0036649703979492188,0.06407642364501953,False,False
262
+ 130,1048,base,ZH_EN,0.10727334022521973,0.09717941284179688,False,False
263
+ 130,1048,extra,ZH_ZH,-0.0029544830322265625,0.002029895782470703,False,False
264
+ 131,1056,base,EN_ZH,0.010034561157226562,0.025753021240234375,False,False
265
+ 131,1056,extra,ZH_ZH,0.012217044830322266,0.026470661163330078,False,False
266
+ 132,1064,base,ZH_ZH,0.08829879760742188,0.09491634368896484,False,False
267
+ 132,1064,extra,ZH_EN,-0.012423515319824219,0.013349533081054688,True,False
268
+ 133,1072,base,ZH_ZH,0.03792285919189453,0.03945159912109375,False,False
269
+ 133,1072,extra,EN_ZH,-0.012534141540527344,-0.008214473724365234,True,True
270
+ 134,1080,base,ZH_EN,0.022701740264892578,0.02586078643798828,False,False
271
+ 134,1080,extra,ZH_ZH,0.016788005828857422,0.02814626693725586,False,False
272
+ 135,1088,base,EN_ZH,-0.01249837875366211,0.02431631088256836,True,False
273
+ 135,1088,extra,ZH_ZH,-0.0007524490356445312,0.0051727294921875,False,False
274
+ 136,1096,base,ZH_ZH,-0.0201263427734375,-0.002304553985595703,True,False
275
+ 136,1096,extra,ZH_EN,-0.012009620666503906,-0.02281665802001953,True,True
276
+ 137,1104,base,ZH_ZH,-0.027038097381591797,-0.033179283142089844,True,True
277
+ 137,1104,extra,EN_ZH,0.04589080810546875,-0.0010247230529785156,False,False
278
+ 138,1112,base,ZH_EN,-0.0011966228485107422,-0.005951404571533203,False,True
279
+ 138,1112,extra,ZH_ZH,0.023742198944091797,-0.00850534439086914,False,True
280
+ 139,1120,base,EN_ZH,0.05575132369995117,0.07064437866210938,False,False
281
+ 139,1120,extra,ZH_ZH,-0.027442216873168945,-0.05071258544921875,True,True
282
+ 140,1128,base,ZH_ZH,0.08405780792236328,0.1147456169128418,False,False
283
+ 140,1128,extra,ZH_EN,0.06430363655090332,0.04524564743041992,False,False
284
+ 141,1136,base,ZH_ZH,0.02698516845703125,-0.01277923583984375,False,True
285
+ 141,1136,extra,EN_ZH,0.030262470245361328,0.04737377166748047,False,False
286
+ 142,1144,base,ZH_EN,-0.06396889686584473,-0.06239962577819824,True,True
287
+ 142,1144,extra,ZH_ZH,0.03651618957519531,0.043207645416259766,False,False
288
+ 143,1152,base,EN_ZH,-0.03871631622314453,0.017327308654785156,True,False
289
+ 143,1152,extra,ZH_ZH,0.18988561630249023,0.16520118713378906,False,False
290
+ 144,1160,base,ZH_ZH,-0.0246429443359375,-0.011109352111816406,True,True
291
+ 144,1160,extra,ZH_EN,0.01966571807861328,0.03870964050292969,False,False
292
+ 145,1168,base,ZH_ZH,-0.07283687591552734,-0.19791460037231445,True,True
293
+ 145,1168,extra,EN_ZH,0.0167236328125,0.052754878997802734,False,False
294
+ 146,1176,base,ZH_EN,0.007702827453613281,-0.03336668014526367,False,True
295
+ 146,1176,extra,ZH_ZH,0.0985422134399414,0.09941625595092773,False,False
296
+ 147,1184,base,EN_ZH,-0.0324859619140625,0.0003209114074707031,True,False
297
+ 147,1184,extra,ZH_ZH,0.004242897033691406,0.006838798522949219,False,False
298
+ 148,1192,base,ZH_ZH,0.0384526252746582,0.04442739486694336,False,False
299
+ 148,1192,extra,ZH_EN,-0.1508464813232422,-0.02537059783935547,True,True
300
+ 149,1200,base,ZH_ZH,0.06079387664794922,0.016495227813720703,False,False
301
+ 149,1200,extra,EN_ZH,-0.10120248794555664,-0.03930807113647461,True,True
302
+ 150,1208,base,ZH_EN,-0.134627103805542,-0.12613439559936523,True,True
303
+ 150,1208,extra,ZH_ZH,0.09534978866577148,0.025604248046875,False,False
304
+ 151,1216,base,EN_ZH,-0.013749122619628906,-0.04232025146484375,True,True
305
+ 151,1216,extra,ZH_ZH,0.006961822509765625,0.01222848892211914,False,False
306
+ 152,1224,base,ZH_ZH,0.04077005386352539,0.01766347885131836,False,False
307
+ 152,1224,extra,ZH_EN,0.12264537811279297,0.00843667984008789,False,False
308
+ 153,1232,base,ZH_ZH,0.016739845275878906,-0.05271720886230469,False,True
309
+ 153,1232,extra,EN_ZH,0.027382850646972656,0.010525703430175781,False,False
310
+ 154,1240,base,ZH_EN,0.030750751495361328,0.027592182159423828,False,False
311
+ 154,1240,extra,ZH_ZH,-0.005413055419921875,-0.011719703674316406,True,True
312
+ 155,1248,base,EN_ZH,0.02453327178955078,-0.0762033462524414,False,True
313
+ 155,1248,extra,ZH_ZH,0.08275365829467773,0.06470012664794922,False,False
314
+ 156,1256,base,ZH_ZH,0.01573801040649414,-0.018256664276123047,False,True
315
+ 156,1256,extra,ZH_EN,0.005455493927001953,0.11110377311706543,False,False
316
+ 157,1264,base,ZH_ZH,0.005051136016845703,0.021429061889648438,False,False
317
+ 157,1264,extra,EN_ZH,0.05550718307495117,-0.06405305862426758,False,True
318
+ 158,1272,base,ZH_EN,-0.03339648246765137,1.430511474609375e-05,True,False
319
+ 158,1272,extra,ZH_ZH,-0.0015568733215332031,0.053792476654052734,False,False
320
+ 159,1280,base,EN_ZH,0.02760028839111328,0.0677957534790039,False,False
321
+ 159,1280,extra,ZH_ZH,-0.045430660247802734,-0.01631307601928711,True,True
322
+ 160,1288,base,ZH_ZH,-0.010711193084716797,0.04594564437866211,True,False
323
+ 160,1288,extra,ZH_EN,0.02941584587097168,0.0042781829833984375,False,False
324
+ 161,1296,base,ZH_ZH,0.014035224914550781,0.03490161895751953,False,False
325
+ 161,1296,extra,EN_ZH,-0.008431434631347656,0.04619741439819336,True,False
326
+ 162,1304,base,ZH_EN,0.13010668754577637,0.1004018783569336,False,False
327
+ 162,1304,extra,ZH_ZH,-0.022137165069580078,-0.007328987121582031,True,True
328
+ 163,1312,base,EN_ZH,-0.021099090576171875,-0.05537223815917969,True,True
329
+ 163,1312,extra,ZH_ZH,-0.0199737548828125,0.01492929458618164,True,False
330
+ 164,1320,base,ZH_ZH,0.11582374572753906,0.07655882835388184,False,False
331
+ 164,1320,extra,ZH_EN,0.04555797576904297,0.09407234191894531,False,False
332
+ 165,1328,base,ZH_ZH,-0.010642051696777344,-0.01389455795288086,True,True
333
+ 165,1328,extra,EN_ZH,1.33514404296875e-05,-0.024000167846679688,False,True
334
+ 166,1336,base,ZH_EN,0.05209779739379883,-0.00969552993774414,False,True
335
+ 166,1336,extra,ZH_ZH,0.03279399871826172,-0.0620574951171875,False,True
336
+ 167,1344,base,EN_ZH,0.06832671165466309,0.02591705322265625,False,False
337
+ 167,1344,extra,ZH_ZH,0.038877010345458984,-0.02817392349243164,False,True
338
+ 168,1352,base,ZH_ZH,0.012481689453125,0.06771421432495117,False,False
339
+ 168,1352,extra,ZH_EN,-0.03808164596557617,0.01481008529663086,True,False
340
+ 169,1360,base,ZH_ZH,-0.013363838195800781,-0.056143760681152344,True,True
341
+ 169,1360,extra,EN_ZH,-0.00960540771484375,0.012736797332763672,True,False
342
+ 170,1368,base,ZH_EN,0.07492446899414062,0.008724212646484375,False,False
343
+ 170,1368,extra,ZH_ZH,0.015895843505859375,0.05317544937133789,False,False
344
+ 171,1376,base,EN_ZH,0.0532689094543457,0.0464787483215332,False,False
345
+ 171,1376,extra,ZH_ZH,-0.011550426483154297,-0.025516748428344727,True,True
346
+ 172,1384,base,ZH_ZH,0.019839763641357422,-0.030645370483398438,False,True
347
+ 172,1384,extra,ZH_EN,0.05790114402770996,0.048429250717163086,False,False
348
+ 173,1392,base,ZH_ZH,0.00993204116821289,-0.017436981201171875,False,True
349
+ 173,1392,extra,EN_ZH,-0.015410423278808594,0.02475261688232422,True,False
350
+ 174,1400,base,ZH_EN,-0.10640835762023926,-0.05823206901550293,True,True
351
+ 174,1400,extra,ZH_ZH,-0.0650181770324707,-0.022235631942749023,True,True
352
+ 175,1408,base,EN_ZH,-0.08442974090576172,-0.05773162841796875,True,True
353
+ 175,1408,extra,ZH_ZH,-0.008302688598632812,-0.011013031005859375,True,True
354
+ 176,1416,base,ZH_ZH,0.028784751892089844,0.0620579719543457,False,False
355
+ 176,1416,extra,ZH_EN,0.0018868446350097656,0.032410621643066406,False,False
356
+ 177,1424,base,ZH_ZH,0.010075569152832031,-0.0058002471923828125,False,True
357
+ 177,1424,extra,EN_ZH,-0.010921478271484375,-0.007386207580566406,True,True
358
+ 178,1432,base,ZH_EN,-0.14333128929138184,-0.12076997756958008,True,True
359
+ 178,1432,extra,ZH_ZH,0.021685123443603516,-0.01641988754272461,False,True
360
+ 179,1440,base,EN_ZH,0.07360315322875977,0.016892433166503906,False,False
361
+ 179,1440,extra,ZH_ZH,0.018357276916503906,0.047957420349121094,False,False
362
+ 180,1448,base,ZH_ZH,-0.04168367385864258,-0.08097600936889648,True,True
363
+ 180,1448,extra,ZH_EN,0.0017943382263183594,0.006021738052368164,False,False
364
+ 181,1456,base,ZH_ZH,0.17885208129882812,0.12221050262451172,False,False
365
+ 181,1456,extra,EN_ZH,-0.05955696105957031,-0.039742469787597656,True,True
366
+ 182,1464,base,ZH_EN,-0.009832143783569336,-0.004698991775512695,True,False
367
+ 182,1464,extra,ZH_ZH,-0.024488449096679688,-0.04646778106689453,True,True
368
+ 183,1472,base,EN_ZH,0.04213142395019531,-0.014841556549072266,False,True
369
+ 183,1472,extra,ZH_ZH,-0.049630165100097656,-0.03954887390136719,True,True
370
+ 184,1480,base,ZH_ZH,0.04500317573547363,0.05506134033203125,False,False
371
+ 184,1480,extra,ZH_EN,-0.0009222030639648438,-0.02608633041381836,False,True
372
+ 185,1488,base,ZH_ZH,0.02270221710205078,-0.0009570121765136719,False,False
373
+ 185,1488,extra,EN_ZH,-0.02118968963623047,0.08318424224853516,True,False
374
+ 186,1496,base,ZH_EN,-0.1457819938659668,-0.04612255096435547,True,True
375
+ 186,1496,extra,ZH_ZH,0.09041643142700195,0.026105403900146484,False,False
376
+ 187,1504,base,EN_ZH,0.01955699920654297,-0.05768442153930664,False,True
377
+ 187,1504,extra,ZH_ZH,0.03730916976928711,-0.033031463623046875,False,True
378
+ 188,1512,base,ZH_ZH,0.04905891418457031,0.01943492889404297,False,False
379
+ 188,1512,extra,ZH_EN,-0.02936840057373047,0.11034750938415527,True,False
380
+ 189,1520,base,ZH_ZH,0.03925037384033203,0.03177833557128906,False,False
381
+ 189,1520,extra,EN_ZH,-0.016597747802734375,-0.047754764556884766,True,True
382
+ 190,1528,base,ZH_EN,0.08052968978881836,0.10550928115844727,False,False
383
+ 190,1528,extra,ZH_ZH,-0.02764892578125,-0.01537179946899414,True,True
384
+ 191,1536,base,EN_ZH,-0.0032777786254882812,-0.010983943939208984,False,True
385
+ 191,1536,extra,ZH_ZH,0.04603242874145508,0.1069941520690918,False,False
386
+ 192,1544,base,ZH_ZH,-0.009247779846191406,-0.03275632858276367,True,True
387
+ 192,1544,extra,ZH_EN,-0.07151484489440918,-0.08870673179626465,True,True
388
+ 193,1552,base,ZH_ZH,0.045630455017089844,0.026970386505126953,False,False
389
+ 193,1552,extra,EN_ZH,0.1666862964630127,0.19028043746948242,False,False
390
+ 194,1560,base,ZH_EN,0.10848212242126465,0.0677785873413086,False,False
391
+ 194,1560,extra,ZH_ZH,0.014336585998535156,0.006322383880615234,False,False
392
+ 195,1568,base,EN_ZH,0.22429800033569336,0.28549671173095703,False,False
393
+ 195,1568,extra,ZH_ZH,-0.03449249267578125,-0.03927469253540039,True,True
394
+ 196,1576,base,ZH_ZH,-0.12347555160522461,0.0015096664428710938,True,False
395
+ 196,1576,extra,ZH_EN,0.009378314018249512,0.010114908218383789,False,False
396
+ 197,1584,base,ZH_ZH,0.12308168411254883,0.09256935119628906,False,False
397
+ 197,1584,extra,EN_ZH,0.013063430786132812,0.0041751861572265625,False,False
398
+ 198,1592,base,ZH_EN,0.006005048751831055,-0.00533604621887207,False,True
399
+ 198,1592,extra,ZH_ZH,-0.049451351165771484,-0.024425983428955078,True,True
400
+ 199,1600,base,EN_ZH,0.04693460464477539,0.06255578994750977,False,False
401
+ 199,1600,extra,ZH_ZH,-0.009626388549804688,0.012783050537109375,True,False
402
+ 200,1608,base,ZH_ZH,-0.009800434112548828,0.018018722534179688,True,False
403
+ 200,1608,extra,ZH_EN,0.019609451293945312,0.05400228500366211,False,False
404
+ 201,1616,base,ZH_ZH,-0.06257820129394531,-0.003967761993408203,True,False
405
+ 201,1616,extra,EN_ZH,0.021070480346679688,0.0070743560791015625,False,False
406
+ 202,1624,base,ZH_EN,0.012263298034667969,0.02402520179748535,False,False
407
+ 202,1624,extra,ZH_ZH,-0.029761791229248047,-0.0059528350830078125,True,True
408
+ 203,1632,base,EN_ZH,0.05323028564453125,0.04848670959472656,False,False
409
+ 203,1632,extra,ZH_ZH,-0.021158695220947266,-0.017946243286132812,True,True
410
+ 204,1640,base,ZH_ZH,-0.03428506851196289,-0.028499126434326172,True,True
411
+ 204,1640,extra,ZH_EN,0.09907341003417969,0.16858673095703125,False,False
412
+ 205,1648,base,ZH_ZH,0.016431808471679688,0.027655601501464844,False,False
413
+ 205,1648,extra,EN_ZH,0.062181949615478516,0.027751922607421875,False,False
414
+ 206,1656,base,ZH_EN,0.0857781171798706,0.11888813972473145,False,False
415
+ 206,1656,extra,ZH_ZH,0.036588191986083984,0.01949167251586914,False,False
416
+ 207,1664,base,EN_ZH,0.09966850280761719,0.0894327163696289,False,False
417
+ 207,1664,extra,ZH_ZH,-0.008230209350585938,-0.12398815155029297,True,True
418
+ 208,1672,base,ZH_ZH,0.06835794448852539,0.04401254653930664,False,False
419
+ 208,1672,extra,ZH_EN,0.09342575073242188,0.07115030288696289,False,False
420
+ 209,1680,base,ZH_ZH,-0.025287628173828125,0.006100177764892578,True,False
421
+ 209,1680,extra,EN_ZH,-0.013910293579101562,0.21164941787719727,True,False
422
+ 210,1688,base,ZH_EN,-0.12513184547424316,-0.11251997947692871,True,True
423
+ 210,1688,extra,ZH_ZH,0.06383562088012695,-0.03405475616455078,False,True
424
+ 211,1696,base,EN_ZH,0.052288055419921875,0.039569854736328125,False,False
425
+ 211,1696,extra,ZH_ZH,0.008293628692626953,0.027559757232666016,False,False
426
+ 212,1704,base,ZH_ZH,-0.03442192077636719,0.023260116577148438,True,False
427
+ 212,1704,extra,ZH_EN,-0.1479804515838623,-0.19478893280029297,True,True
428
+ 213,1712,base,ZH_ZH,0.023067474365234375,-0.028528213500976562,False,True
429
+ 213,1712,extra,EN_ZH,-0.0071086883544921875,-0.04306983947753906,True,True
430
+ 214,1720,base,ZH_EN,0.012726068496704102,0.027256488800048828,False,False
431
+ 214,1720,extra,ZH_ZH,-0.007676124572753906,-0.060385704040527344,True,True
432
+ 215,1728,base,EN_ZH,0.05395221710205078,0.12765741348266602,False,False
433
+ 215,1728,extra,ZH_ZH,0.06782388687133789,0.06545352935791016,False,False
434
+ 216,1736,base,ZH_ZH,0.007723331451416016,-0.07613229751586914,False,True
435
+ 216,1736,extra,ZH_EN,0.19668102264404297,0.21387147903442383,False,False
436
+ 217,1744,base,ZH_ZH,-0.029793739318847656,-0.06476879119873047,True,True
437
+ 217,1744,extra,EN_ZH,0.044377803802490234,-0.017517566680908203,False,True
438
+ 218,1752,base,ZH_EN,0.06139969825744629,0.027968406677246094,False,False
439
+ 218,1752,extra,ZH_ZH,0.058777809143066406,0.09425544738769531,False,False
440
+ 219,1760,base,EN_ZH,0.03041982650756836,0.0016980171203613281,False,False
441
+ 219,1760,extra,ZH_ZH,0.0055561065673828125,0.0028533935546875,False,False
442
+ 220,1768,base,ZH_ZH,0.039984703063964844,0.031262874603271484,False,False
443
+ 220,1768,extra,ZH_EN,0.034923553466796875,0.07039642333984375,False,False
444
+ 221,1776,base,ZH_ZH,0.003971099853515625,-0.022693634033203125,False,True
445
+ 221,1776,extra,EN_ZH,0.061656951904296875,0.04234790802001953,False,False
446
+ 222,1784,base,ZH_EN,-0.0003380775451660156,0.14245319366455078,False,False
447
+ 222,1784,extra,ZH_ZH,0.05658435821533203,0.04197072982788086,False,False
448
+ 223,1792,base,EN_ZH,0.06328034400939941,0.10074019432067871,False,False
449
+ 223,1792,extra,ZH_ZH,-0.0020198822021484375,-0.026224136352539062,False,True
450
+ 224,1800,base,ZH_ZH,0.0008597373962402344,0.010308265686035156,False,False
451
+ 224,1800,extra,ZH_EN,0.049925804138183594,0.0007562637329101562,False,False
452
+ 225,1808,base,ZH_ZH,0.05953836441040039,0.04474639892578125,False,False
453
+ 225,1808,extra,EN_ZH,0.031106948852539062,0.07112789154052734,False,False
454
+ 226,1816,base,ZH_EN,-0.0159151554107666,-0.0003361701965332031,True,False
455
+ 226,1816,extra,ZH_ZH,0.04839897155761719,0.07216405868530273,False,False
456
+ 227,1824,base,EN_ZH,0.03354787826538086,-0.003581523895263672,False,False
457
+ 227,1824,extra,ZH_ZH,0.029084205627441406,0.013813495635986328,False,False
458
+ 228,1832,base,ZH_ZH,-0.05003643035888672,-0.04611539840698242,True,True
459
+ 228,1832,extra,ZH_EN,0.033483266830444336,0.23684239387512207,False,False
460
+ 229,1840,base,ZH_ZH,-0.04109382629394531,-0.03740215301513672,True,True
461
+ 229,1840,extra,EN_ZH,0.01125955581665039,0.006880283355712891,False,False
462
+ 230,1848,base,ZH_EN,0.05303525924682617,0.043500423431396484,False,False
463
+ 230,1848,extra,ZH_ZH,0.2329120635986328,0.21236944198608398,False,False
464
+ 231,1856,base,EN_ZH,0.006152629852294922,0.016097068786621094,False,False
465
+ 231,1856,extra,ZH_ZH,-0.022463321685791016,-0.048004150390625,True,True
466
+ 232,1864,base,ZH_ZH,0.007194995880126953,-0.024097442626953125,False,True
467
+ 232,1864,extra,ZH_EN,-0.04708385467529297,-0.008747577667236328,True,True
468
+ 233,1872,base,ZH_ZH,0.08928918838500977,0.033594608306884766,False,False
469
+ 233,1872,extra,EN_ZH,0.09722566604614258,0.06769418716430664,False,False
470
+ 234,1880,base,ZH_EN,0.010123729705810547,0.014018058776855469,False,False
471
+ 234,1880,extra,ZH_ZH,0.0017547607421875,0.02891826629638672,False,False
472
+ 235,1888,base,EN_ZH,0.03130960464477539,-0.01148366928100586,False,True
473
+ 235,1888,extra,ZH_ZH,-0.04741716384887695,-0.016364097595214844,True,True
474
+ 236,1896,base,ZH_ZH,-0.030828475952148438,-0.0114288330078125,True,True
475
+ 236,1896,extra,ZH_EN,0.040760040283203125,0.047280073165893555,False,False
476
+ 237,1904,base,ZH_ZH,0.05257892608642578,0.049784183502197266,False,False
477
+ 237,1904,extra,EN_ZH,0.1695423126220703,0.1549391746520996,False,False
478
+ 238,1912,base,ZH_EN,-0.008186817169189453,0.017130374908447266,True,False
479
+ 238,1912,extra,ZH_ZH,0.04648447036743164,0.01998138427734375,False,False
480
+ 239,1920,base,EN_ZH,0.07543373107910156,0.08287525177001953,False,False
481
+ 239,1920,extra,ZH_ZH,0.19686651229858398,0.181596040725708,False,False
482
+ 240,1928,base,ZH_ZH,-0.10297679901123047,-0.0439453125,True,True
483
+ 240,1928,extra,ZH_EN,0.07922792434692383,0.07973814010620117,False,False
484
+ 241,1936,base,ZH_ZH,-0.07187461853027344,-0.028494834899902344,True,True
485
+ 241,1936,extra,EN_ZH,0.023927688598632812,0.024236202239990234,False,False
486
+ 242,1944,base,ZH_EN,-0.04353523254394531,0.04512906074523926,True,False
487
+ 242,1944,extra,ZH_ZH,0.041950225830078125,0.027896881103515625,False,False
488
+ 243,1952,base,EN_ZH,-0.022696971893310547,0.03159618377685547,True,False
489
+ 243,1952,extra,ZH_ZH,0.07242774963378906,0.08306026458740234,False,False
490
+ 244,1960,base,ZH_ZH,-0.01649761199951172,0.02542877197265625,True,False
491
+ 244,1960,extra,ZH_EN,-0.04535484313964844,0.018037796020507812,True,False
492
+ 245,1968,base,ZH_ZH,0.03977537155151367,0.020589828491210938,False,False
493
+ 245,1968,extra,EN_ZH,0.08634805679321289,0.09940004348754883,False,False
494
+ 246,1976,base,ZH_EN,-0.010580778121948242,-0.02485346794128418,True,True
495
+ 246,1976,extra,ZH_ZH,0.04411745071411133,0.16355419158935547,False,False
496
+ 247,1984,base,EN_ZH,-0.031377315521240234,0.00811767578125,True,False
497
+ 247,1984,extra,ZH_ZH,-0.04865694046020508,-0.03020191192626953,True,True
498
+ 248,1992,base,ZH_ZH,-0.08605527877807617,-0.07746744155883789,True,True
499
+ 248,1992,extra,ZH_EN,0.017145633697509766,-0.011556386947631836,False,True
500
+ 249,2000,base,ZH_ZH,0.021759986877441406,0.023061752319335938,False,False
501
+ 249,2000,extra,EN_ZH,0.1464681625366211,0.1351923942565918,False,False
502
+ 250,2008,base,ZH_EN,0.04752159118652344,0.022409439086914062,False,False
503
+ 250,2008,extra,ZH_ZH,0.1395578384399414,0.1743025779724121,False,False
504
+ 251,2016,base,EN_ZH,0.07179594039916992,0.13791990280151367,False,False
505
+ 251,2016,extra,ZH_ZH,0.04390716552734375,0.06300163269042969,False,False
506
+ 252,2024,base,ZH_ZH,-0.022311687469482422,-0.017406940460205078,True,True
507
+ 252,2024,extra,ZH_EN,0.02824878692626953,0.16699600219726562,False,False
508
+ 253,2032,base,ZH_ZH,0.03507232666015625,0.03570270538330078,False,False
509
+ 253,2032,extra,EN_ZH,-0.029301166534423828,0.09355401992797852,True,False
510
+ 254,2040,base,ZH_EN,0.10743045806884766,0.11209964752197266,False,False
511
+ 254,2040,extra,ZH_ZH,-0.027163028717041016,-0.032604217529296875,True,True
512
+ 255,2048,base,EN_ZH,0.35879087448120117,0.15400981903076172,False,False
513
+ 255,2048,extra,ZH_ZH,0.025371551513671875,0.060138702392578125,False,False
514
+ 256,2056,base,ZH_ZH,0.004650592803955078,-0.0045680999755859375,False,False
515
+ 256,2056,extra,ZH_EN,-0.006389617919921875,-0.018306732177734375,True,True
516
+ 257,2064,base,ZH_ZH,0.03337383270263672,0.0443568229675293,False,False
517
+ 257,2064,extra,EN_ZH,0.02486419677734375,0.0019207000732421875,False,False
518
+ 258,2072,base,ZH_EN,-0.08005619049072266,-0.08134651184082031,True,True
519
+ 258,2072,extra,ZH_ZH,0.0754237174987793,0.047019004821777344,False,False
520
+ 259,2080,base,EN_ZH,0.05128955841064453,0.02641773223876953,False,False
521
+ 259,2080,extra,ZH_ZH,0.027170181274414062,0.012256622314453125,False,False
522
+ 260,2088,base,ZH_ZH,-0.2835812568664551,-0.13599109649658203,True,True
523
+ 260,2088,extra,ZH_EN,-0.012993812561035156,-0.021196842193603516,True,True
524
+ 261,2096,base,ZH_ZH,0.010831832885742188,0.0064907073974609375,False,False
525
+ 261,2096,extra,EN_ZH,0.03054523468017578,-0.0027618408203125,False,False
526
+ 262,2104,base,ZH_EN,-0.00592803955078125,-0.004136562347412109,True,False
527
+ 262,2104,extra,ZH_ZH,-0.010246753692626953,0.017644882202148438,True,False
528
+ 263,2112,base,EN_ZH,-0.0029125213623046875,-0.006712436676025391,False,True
529
+ 263,2112,extra,ZH_ZH,0.04273819923400879,0.00856471061706543,False,False
530
+ 264,2120,base,ZH_ZH,0.07207918167114258,0.0993504524230957,False,False
531
+ 264,2120,extra,ZH_EN,-0.08483505249023438,-0.11392569541931152,True,True
532
+ 265,2128,base,ZH_ZH,0.043328285217285156,0.042153358459472656,False,False
533
+ 265,2128,extra,EN_ZH,0.07534146308898926,0.08716940879821777,False,False
534
+ 266,2136,base,ZH_EN,-0.033046722412109375,0.0005230903625488281,True,False
535
+ 266,2136,extra,ZH_ZH,0.05817413330078125,0.07351398468017578,False,False
536
+ 267,2144,base,EN_ZH,0.043055057525634766,0.08261919021606445,False,False
537
+ 267,2144,extra,ZH_ZH,-0.006633281707763672,0.00374603271484375,True,False
538
+ 268,2152,base,ZH_ZH,0.05881834030151367,0.06036376953125,False,False
539
+ 268,2152,extra,ZH_EN,-0.0034313201904296875,-0.025964736938476562,False,True
540
+ 269,2160,base,ZH_ZH,-0.00018835067749023438,-0.022036075592041016,False,True
541
+ 269,2160,extra,EN_ZH,-0.010095596313476562,0.014594078063964844,True,False
542
+ 270,2168,base,ZH_EN,0.14030027389526367,0.1032109260559082,False,False
543
+ 270,2168,extra,ZH_ZH,-0.04574871063232422,-0.02553844451904297,True,True
544
+ 271,2176,base,EN_ZH,0.007244110107421875,0.005070686340332031,False,False
545
+ 271,2176,extra,ZH_ZH,-0.02422475814819336,-0.01406717300415039,True,True
546
+ 272,2184,base,ZH_ZH,0.015732288360595703,0.046848297119140625,False,False
547
+ 272,2184,extra,ZH_EN,-0.009047508239746094,0.034522056579589844,True,False
548
+ 273,2192,base,ZH_ZH,-0.013354301452636719,0.020832538604736328,True,False
549
+ 273,2192,extra,EN_ZH,-0.013798713684082031,-0.3041200637817383,True,True
550
+ 274,2200,base,ZH_EN,0.028794050216674805,0.019536495208740234,False,False
551
+ 274,2200,extra,ZH_ZH,0.038671016693115234,0.04431486129760742,False,False
552
+ 275,2208,base,EN_ZH,0.03254508972167969,0.003860950469970703,False,False
553
+ 275,2208,extra,ZH_ZH,0.02914571762084961,-0.0006256103515625,False,False
554
+ 276,2216,base,ZH_ZH,-0.018767356872558594,-0.03287792205810547,True,True
555
+ 276,2216,extra,ZH_EN,-0.016242504119873047,-0.017416954040527344,True,True
556
+ 277,2224,base,ZH_ZH,0.022767066955566406,0.008658409118652344,False,False
557
+ 277,2224,extra,EN_ZH,0.1575026512145996,0.1956787109375,False,False
558
+ 278,2232,base,ZH_EN,-0.00806283950805664,0.05426788330078125,True,False
559
+ 278,2232,extra,ZH_ZH,-0.02860879898071289,0.0431971549987793,True,False
560
+ 279,2240,base,EN_ZH,0.034621238708496094,0.06604909896850586,False,False
561
+ 279,2240,extra,ZH_ZH,-0.006272792816162109,-0.009021282196044922,True,True
562
+ 280,2248,base,ZH_ZH,0.0602259635925293,0.0595393180847168,False,False
563
+ 280,2248,extra,ZH_EN,-0.011634111404418945,0.019560813903808594,True,False
564
+ 281,2256,base,ZH_ZH,-0.05635690689086914,-0.05142498016357422,True,True
565
+ 281,2256,extra,EN_ZH,-0.062468528747558594,-0.074493408203125,True,True
566
+ 282,2264,base,ZH_EN,0.017612457275390625,0.055438995361328125,False,False
567
+ 282,2264,extra,ZH_ZH,-0.10906839370727539,0.08090066909790039,True,False
568
+ 283,2272,base,EN_ZH,-0.05333709716796875,-0.01704120635986328,True,True
569
+ 283,2272,extra,ZH_ZH,0.03766679763793945,0.024193286895751953,False,False
570
+ 284,2280,base,ZH_ZH,0.03441047668457031,-0.012608051300048828,False,True
571
+ 284,2280,extra,ZH_EN,-0.13508224487304688,-0.30327701568603516,True,True
572
+ 285,2288,base,ZH_ZH,-0.0015254020690917969,-0.0159149169921875,False,True
573
+ 285,2288,extra,EN_ZH,0.040816307067871094,0.07975959777832031,False,False
574
+ 286,2296,base,ZH_EN,-0.08455848693847656,0.014871597290039062,True,False
575
+ 286,2296,extra,ZH_ZH,-0.061446189880371094,-0.017095565795898438,True,True
576
+ 287,2304,base,EN_ZH,0.0028862953186035156,-0.06286907196044922,False,True
577
+ 287,2304,extra,ZH_ZH,-0.059520721435546875,-0.04895305633544922,True,True
578
+ 288,2312,base,ZH_ZH,-0.03614616394042969,0.027570724487304688,True,False
579
+ 288,2312,extra,ZH_EN,0.04099225997924805,0.03555917739868164,False,False
580
+ 289,2320,base,ZH_ZH,-0.015293121337890625,-0.017215728759765625,True,True
581
+ 289,2320,extra,EN_ZH,-0.10758209228515625,0.008306503295898438,True,False
582
+ 290,2328,base,ZH_EN,-0.0954132080078125,-0.04645824432373047,True,True
583
+ 290,2328,extra,ZH_ZH,0.0057373046875,-0.0037622451782226562,False,False
584
+ 291,2336,base,EN_ZH,-0.02402782440185547,-0.03781890869140625,True,True
585
+ 291,2336,extra,ZH_ZH,0.0106048583984375,0.03342485427856445,False,False
586
+ 292,2344,base,ZH_ZH,0.026863574981689453,0.0382533073425293,False,False
587
+ 292,2344,extra,ZH_EN,0.025687217712402344,0.05567359924316406,False,False
588
+ 293,2352,base,ZH_ZH,-0.003616809844970703,0.016941547393798828,False,False
589
+ 293,2352,extra,EN_ZH,0.1285419464111328,0.20772218704223633,False,False
590
+ 294,2360,base,ZH_EN,-0.032470703125,-0.07211923599243164,True,True
591
+ 294,2360,extra,ZH_ZH,0.03093576431274414,0.03484296798706055,False,False
592
+ 295,2368,base,EN_ZH,0.012787342071533203,-0.1024923324584961,False,True
593
+ 295,2368,extra,ZH_ZH,-0.019424915313720703,-0.0467686653137207,True,True
594
+ 296,2376,base,ZH_ZH,-0.02329111099243164,0.002883434295654297,True,False
595
+ 296,2376,extra,ZH_EN,0.055533409118652344,0.15209579467773438,False,False
596
+ 297,2384,base,ZH_ZH,0.04377937316894531,0.0021753311157226562,False,False
597
+ 297,2384,extra,EN_ZH,-0.0021696090698242188,-0.005469322204589844,False,True
598
+ 298,2392,base,ZH_EN,0.049793243408203125,-0.03574037551879883,False,True
599
+ 298,2392,extra,ZH_ZH,0.07113027572631836,0.08127355575561523,False,False
600
+ 299,2400,base,EN_ZH,0.16614484786987305,0.1811084747314453,False,False
601
+ 299,2400,extra,ZH_ZH,0.0007586479187011719,-0.013065338134765625,False,True
602
+ 300,2408,base,ZH_ZH,-0.050614356994628906,-0.009966373443603516,True,True
603
+ 300,2408,extra,ZH_EN,0.10956811904907227,0.0892786979675293,False,False
604
+ 301,2416,base,ZH_ZH,0.0568079948425293,-0.06545829772949219,False,True
605
+ 301,2416,extra,EN_ZH,0.030164718627929688,-0.02087688446044922,False,True
606
+ 302,2424,base,ZH_EN,0.03581428527832031,0.04215216636657715,False,False
607
+ 302,2424,extra,ZH_ZH,0.01401519775390625,0.14759540557861328,False,False
608
+ 303,2432,base,EN_ZH,-0.059659481048583984,-0.005401134490966797,True,True
609
+ 303,2432,extra,ZH_ZH,0.04457378387451172,0.09743881225585938,False,False
610
+ 304,2440,base,ZH_ZH,0.048983097076416016,-0.030569076538085938,False,True
611
+ 304,2440,extra,ZH_EN,-0.026825428009033203,0.02367401123046875,True,False
612
+ 305,2448,base,ZH_ZH,0.04494333267211914,-0.03688859939575195,False,True
613
+ 305,2448,extra,EN_ZH,-0.02600574493408203,-0.018746376037597656,True,True
614
+ 306,2456,base,ZH_EN,-0.004359245300292969,0.007918357849121094,False,False
615
+ 306,2456,extra,ZH_ZH,0.06113719940185547,0.05479907989501953,False,False
616
+ 307,2464,base,EN_ZH,0.04277849197387695,-0.04786109924316406,False,True
617
+ 307,2464,extra,ZH_ZH,0.0022039413452148438,-0.0122528076171875,False,True
618
+ 308,2472,base,ZH_ZH,0.038973331451416016,0.028886795043945312,False,False
619
+ 308,2472,extra,ZH_EN,-0.019497394561767578,-0.05162191390991211,True,True
620
+ 309,2480,base,ZH_ZH,0.09025001525878906,0.004055023193359375,False,False
621
+ 309,2480,extra,EN_ZH,0.049167633056640625,0.005499839782714844,False,False
622
+ 310,2488,base,ZH_EN,-0.03617286682128906,-0.006726264953613281,True,True
623
+ 310,2488,extra,ZH_ZH,-0.0015606880187988281,-0.0727238655090332,False,True
624
+ 311,2496,base,EN_ZH,-0.0050640106201171875,-0.005145072937011719,True,True
625
+ 311,2496,extra,ZH_ZH,0.06954383850097656,0.057005882263183594,False,False
626
+ 312,2504,base,ZH_ZH,0.05695772171020508,0.04538249969482422,False,False
627
+ 312,2504,extra,ZH_EN,-0.011130332946777344,-0.016301631927490234,True,True
628
+ 313,2512,base,ZH_ZH,0.2950277328491211,0.2350921630859375,False,False
629
+ 313,2512,extra,EN_ZH,0.014668941497802734,0.16620492935180664,False,False
630
+ 314,2520,base,ZH_EN,-0.03371286392211914,-0.02873086929321289,True,True
631
+ 314,2520,extra,ZH_ZH,-0.0014934539794921875,-0.01572418212890625,False,True
632
+ 315,2528,base,EN_ZH,-0.033068180084228516,-0.005924224853515625,True,True
633
+ 315,2528,extra,ZH_ZH,0.0008502006530761719,0.016181468963623047,False,False
634
+ 316,2536,base,ZH_ZH,-0.019508838653564453,0.055169105529785156,True,False
635
+ 316,2536,extra,ZH_EN,-0.027299880981445312,-0.05611848831176758,True,True
636
+ 317,2544,base,ZH_ZH,0.38981008529663086,0.38640260696411133,False,False
637
+ 317,2544,extra,EN_ZH,0.004214763641357422,0.021695613861083984,False,False
638
+ 318,2552,base,ZH_EN,0.010959386825561523,0.054047346115112305,False,False
639
+ 318,2552,extra,ZH_ZH,-0.03450345993041992,-0.03313922882080078,True,True
640
+ 319,2560,base,EN_ZH,-0.013909339904785156,0.012618064880371094,True,False
641
+ 319,2560,extra,ZH_ZH,-0.012919425964355469,0.08473825454711914,True,False
642
+ 320,2568,base,ZH_ZH,0.029664278030395508,0.013480901718139648,False,False
643
+ 320,2568,extra,ZH_EN,0.05624556541442871,-0.01602768898010254,False,True
644
+ 321,2576,base,ZH_ZH,0.0472264289855957,-0.00848245620727539,False,True
645
+ 321,2576,extra,EN_ZH,0.1236581802368164,0.12280607223510742,False,False
646
+ 322,2584,base,ZH_EN,-0.001430511474609375,0.014601707458496094,False,False
647
+ 322,2584,extra,ZH_ZH,0.00074005126953125,-0.0009140968322753906,False,False
648
+ 323,2592,base,EN_ZH,0.07693290710449219,0.06603240966796875,False,False
649
+ 323,2592,extra,ZH_ZH,-0.12311983108520508,-0.0581512451171875,True,True
650
+ 324,2600,base,ZH_ZH,0.037938833236694336,0.05060148239135742,False,False
651
+ 324,2600,extra,ZH_EN,0.06494998931884766,0.0378265380859375,False,False
652
+ 325,2608,base,ZH_ZH,0.0770721435546875,0.1001119613647461,False,False
653
+ 325,2608,extra,EN_ZH,0.0967559814453125,0.0958719253540039,False,False
654
+ 326,2616,base,ZH_EN,0.15130090713500977,0.15430164337158203,False,False
655
+ 326,2616,extra,ZH_ZH,-0.04960823059082031,-0.05810689926147461,True,True
656
+ 327,2624,base,EN_ZH,-0.14282751083374023,-0.07482719421386719,True,True
657
+ 327,2624,extra,ZH_ZH,-0.08018207550048828,-0.09450960159301758,True,True
658
+ 328,2632,base,ZH_ZH,-0.06922483444213867,-0.072296142578125,True,True
659
+ 328,2632,extra,ZH_EN,-0.3278205394744873,-0.3278045654296875,True,True
660
+ 329,2640,base,ZH_ZH,0.012122631072998047,0.06615972518920898,False,False
661
+ 329,2640,extra,EN_ZH,-0.0022020339965820312,0.1633892059326172,False,False
662
+ 330,2648,base,ZH_EN,-0.04004526138305664,0.13256263732910156,True,False
663
+ 330,2648,extra,ZH_ZH,0.032869815826416016,0.054225921630859375,False,False
664
+ 331,2656,base,EN_ZH,-0.04109001159667969,-0.03305768966674805,True,True
665
+ 331,2656,extra,ZH_ZH,0.0015888214111328125,0.03072214126586914,False,False
666
+ 332,2664,base,ZH_ZH,0.02393364906311035,0.15878033638000488,False,False
667
+ 332,2664,extra,ZH_EN,0.05183529853820801,0.029749393463134766,False,False
668
+ 333,2672,base,ZH_ZH,0.07209348678588867,0.0996255874633789,False,False
669
+ 333,2672,extra,EN_ZH,0.021267414093017578,0.012613296508789062,False,False
670
+ 334,2680,base,ZH_EN,0.014496326446533203,0.044936418533325195,False,False
671
+ 334,2680,extra,ZH_ZH,-0.01768207550048828,0.01943206787109375,True,False
672
+ 335,2688,base,EN_ZH,-0.016454219818115234,-0.07217693328857422,True,True
673
+ 335,2688,extra,ZH_ZH,0.005644798278808594,0.021448135375976562,False,False
674
+ 336,2696,base,ZH_ZH,-0.013580322265625,0.09839153289794922,True,False
675
+ 336,2696,extra,ZH_EN,-0.14407014846801758,-0.10997295379638672,True,True
676
+ 337,2704,base,ZH_ZH,0.008058547973632812,0.059703826904296875,False,False
677
+ 337,2704,extra,EN_ZH,-0.047977447509765625,-0.08107709884643555,True,True
678
+ 338,2712,base,ZH_EN,0.04281902313232422,-0.05487346649169922,False,True
679
+ 338,2712,extra,ZH_ZH,-0.033133506774902344,-0.036966800689697266,True,True
680
+ 339,2720,base,EN_ZH,-0.0020279884338378906,-0.01895284652709961,False,True
681
+ 339,2720,extra,ZH_ZH,0.0009427070617675781,-0.014946460723876953,False,True
682
+ 340,2728,base,ZH_ZH,0.09425115585327148,0.16902637481689453,False,False
683
+ 340,2728,extra,ZH_EN,0.03461956977844238,0.026904821395874023,False,False
684
+ 341,2736,base,ZH_ZH,0.012281417846679688,0.019351959228515625,False,False
685
+ 341,2736,extra,EN_ZH,0.03277301788330078,0.08237504959106445,False,False
686
+ 342,2744,base,ZH_EN,-0.018670082092285156,0.06532716751098633,True,False
687
+ 342,2744,extra,ZH_ZH,0.1303262710571289,0.12386226654052734,False,False
688
+ 343,2752,base,EN_ZH,-0.171539306640625,-0.14808225631713867,True,True
689
+ 343,2752,extra,ZH_ZH,-0.021404743194580078,-0.014317512512207031,True,True
690
+ 344,2760,base,ZH_ZH,-0.037525177001953125,-0.029753684997558594,True,True
691
+ 344,2760,extra,ZH_EN,0.05914044380187988,0.01952528953552246,False,False
692
+ 345,2768,base,ZH_ZH,0.04912090301513672,0.05331611633300781,False,False
693
+ 345,2768,extra,EN_ZH,0.017156124114990234,0.02402496337890625,False,False
694
+ 346,2776,base,ZH_EN,-0.0023546218872070312,-0.0023322105407714844,False,False
695
+ 346,2776,extra,ZH_ZH,0.014899253845214844,-0.03501749038696289,False,True
696
+ 347,2784,base,EN_ZH,-0.03870248794555664,-0.01767110824584961,True,True
697
+ 347,2784,extra,ZH_ZH,0.003915309906005859,0.007100105285644531,False,False
698
+ 348,2792,base,ZH_ZH,0.010451793670654297,0.05870866775512695,False,False
699
+ 348,2792,extra,ZH_EN,-0.030875205993652344,-0.04166269302368164,True,True
700
+ 349,2800,base,ZH_ZH,-0.0017228126525878906,-0.020514488220214844,False,True
701
+ 349,2800,extra,EN_ZH,0.019479751586914062,0.02976512908935547,False,False
702
+ 350,2808,base,ZH_EN,0.02301311492919922,0.005228996276855469,False,False
703
+ 350,2808,extra,ZH_ZH,0.04251813888549805,0.03546857833862305,False,False
704
+ 351,2816,base,EN_ZH,0.20013666152954102,0.16585159301757812,False,False
705
+ 351,2816,extra,ZH_ZH,0.034493446350097656,0.0007305145263671875,False,False
706
+ 352,2824,base,ZH_ZH,-0.12046360969543457,-0.07500076293945312,True,True
707
+ 352,2824,extra,ZH_EN,0.15331768989562988,0.07575416564941406,False,False
708
+ 353,2832,base,ZH_ZH,0.04419994354248047,0.10538053512573242,False,False
709
+ 353,2832,extra,EN_ZH,0.08086633682250977,0.024802207946777344,False,False
710
+ 354,2840,base,ZH_EN,0.005918979644775391,-0.06595396995544434,False,True
711
+ 354,2840,extra,ZH_ZH,0.021091938018798828,0.016590595245361328,False,False
712
+ 355,2848,base,EN_ZH,0.013303279876708984,0.043089866638183594,False,False
713
+ 355,2848,extra,ZH_ZH,0.1563701629638672,0.15978574752807617,False,False
714
+ 356,2856,base,ZH_ZH,0.03679466247558594,0.02410888671875,False,False
715
+ 356,2856,extra,ZH_EN,-0.0547640323638916,-0.010008811950683594,True,True
716
+ 357,2864,base,ZH_ZH,0.024055004119873047,-0.007650852203369141,False,True
717
+ 357,2864,extra,EN_ZH,0.055357933044433594,0.07256174087524414,False,False
718
+ 358,2872,base,ZH_EN,-0.0240633487701416,-0.058579444885253906,True,True
719
+ 358,2872,extra,ZH_ZH,0.018735408782958984,-0.07646799087524414,False,True
720
+ 359,2880,base,EN_ZH,0.02425098419189453,0.009814739227294922,False,False
721
+ 359,2880,extra,ZH_ZH,-0.0061762332916259766,0.01042318344116211,True,False
722
+ 360,2888,base,ZH_ZH,0.03175020217895508,0.07362699508666992,False,False
723
+ 360,2888,extra,ZH_EN,0.06790494918823242,0.010512828826904297,False,False
724
+ 361,2896,base,ZH_ZH,0.025350093841552734,0.01684856414794922,False,False
725
+ 361,2896,extra,EN_ZH,-0.003986835479736328,0.16605925559997559,False,False
726
+ 362,2904,base,ZH_EN,0.03906893730163574,0.0672903060913086,False,False
727
+ 362,2904,extra,ZH_ZH,0.06806087493896484,0.07955408096313477,False,False
728
+ 363,2912,base,EN_ZH,0.0011167526245117188,-0.0468440055847168,False,True
729
+ 363,2912,extra,ZH_ZH,0.06423330307006836,0.06083250045776367,False,False
730
+ 364,2920,base,ZH_ZH,-0.004496574401855469,-0.012456893920898438,False,True
731
+ 364,2920,extra,ZH_EN,-0.015170812606811523,0.031007051467895508,True,False
732
+ 365,2928,base,ZH_ZH,-0.011714935302734375,-0.018869876861572266,True,True
733
+ 365,2928,extra,EN_ZH,-0.019449710845947266,-0.025178909301757812,True,True
734
+ 366,2936,base,ZH_EN,0.12766170501708984,0.14435768127441406,False,False
735
+ 366,2936,extra,ZH_ZH,0.07437610626220703,0.07399606704711914,False,False
736
+ 367,2944,base,EN_ZH,0.031513214111328125,0.15937137603759766,False,False
737
+ 367,2944,extra,ZH_ZH,-0.02730274200439453,0.01698780059814453,True,False
738
+ 368,2952,base,ZH_ZH,-0.02504444122314453,0.07872152328491211,True,False
739
+ 368,2952,extra,ZH_EN,-0.34214043617248535,-0.11873006820678711,True,True
740
+ 369,2960,base,ZH_ZH,-0.024499893188476562,0.04714679718017578,True,False
741
+ 369,2960,extra,EN_ZH,0.08504056930541992,0.10705709457397461,False,False
742
+ 370,2968,base,ZH_EN,-0.07996416091918945,-0.08788299560546875,True,True
743
+ 370,2968,extra,ZH_ZH,0.2240900993347168,0.21185827255249023,False,False
744
+ 371,2976,base,EN_ZH,-0.04811906814575195,-0.08472108840942383,True,True
745
+ 371,2976,extra,ZH_ZH,-0.014083385467529297,-0.003875732421875,True,False
746
+ 372,2984,base,ZH_ZH,0.033727169036865234,0.03319978713989258,False,False
747
+ 372,2984,extra,ZH_EN,-0.15726470947265625,-0.13070297241210938,True,True
748
+ 373,2992,base,ZH_ZH,0.003980159759521484,-0.011551856994628906,False,True
749
+ 373,2992,extra,EN_ZH,0.2236804962158203,0.24510669708251953,False,False
750
+ 374,3000,base,ZH_EN,0.03418159484863281,0.09566593170166016,False,False
751
+ 374,3000,extra,ZH_ZH,0.042200565338134766,0.06411170959472656,False,False
752
+ 375,3008,base,EN_ZH,0.0009412765502929688,0.008874893188476562,False,False
753
+ 375,3008,extra,ZH_ZH,-0.01922607421875,0.0029554367065429688,True,False
754
+ 376,3016,base,ZH_ZH,-0.03768348693847656,-0.003422260284423828,True,False
755
+ 376,3016,extra,ZH_EN,0.25406908988952637,0.26737213134765625,False,False
756
+ 377,3024,base,ZH_ZH,0.05823373794555664,-0.019474029541015625,False,True
757
+ 377,3024,extra,EN_ZH,-0.03444385528564453,-0.028858184814453125,True,True
758
+ 378,3032,base,ZH_EN,-0.002623319625854492,0.049282073974609375,False,False
759
+ 378,3032,extra,ZH_ZH,-0.022641658782958984,0.05899238586425781,True,False
760
+ 379,3040,base,EN_ZH,0.12691068649291992,0.11427783966064453,False,False
761
+ 379,3040,extra,ZH_ZH,-0.03511476516723633,-0.006859779357910156,True,True
762
+ 380,3048,base,ZH_ZH,-0.011790752410888672,0.08730602264404297,True,False
763
+ 380,3048,extra,ZH_EN,-0.16565585136413574,-0.15503716468811035,True,True
764
+ 381,3056,base,ZH_ZH,0.059276580810546875,-0.021999359130859375,False,True
765
+ 381,3056,extra,EN_ZH,0.05806255340576172,0.10401058197021484,False,False
766
+ 382,3064,base,ZH_EN,-0.004776477813720703,-0.014641284942626953,False,True
767
+ 382,3064,extra,ZH_ZH,0.03865242004394531,0.01182699203491211,False,False
768
+ 383,3072,base,EN_ZH,0.011501789093017578,0.04299640655517578,False,False
769
+ 383,3072,extra,ZH_ZH,-0.006713390350341797,-0.06373739242553711,True,True
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/formal_p3b_r1_training.csv ADDED
The diff for this file is too large to render. See raw diff
 
experiments/formal_bilingual_continuation/phase3b_r1/20260911T034504Z/hf_write_probe.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ stage2r-b4-r7-r2 write probe 20260911T034504Z