Hugging Face's logo

explcre
/
dnathinker-checkpoints

Model card Files
xet
 Community
explcre commited on
Commit
b4860d1
·
verified ·
1 Parent(s): 3ccb595

periodic: post_bench_pipeline.log (0.0MB)

Browse files
Files changed (1) hide show
  1. runs/post_bench_pipeline.log +115 -0
runs/post_bench_pipeline.log ADDED
@@ -0,0 +1,115 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [oracle] oracle_v2 not yet present at /workspace/dnathinker/runs/exp_oracle_v2_h100/oracle_v2.pt; falling back to lab v1: /workspace/dnathinker/_lab_results/runs/exp_oracle_ds_7cell_fdr_both_20260424_162210/oracle.pt
2
+ [2026-04-28 08:19:37 UTC] post-bench pipeline v4 starting
3
+ [08:19:37] STAGE 0: genqual on T1+T3 zs predictions
4
+ skip: no /workspace/dnathinker/runs/exp_t1_grid_separatedQA_20260426_h100_vllm_full/zs_raw/predictions.jsonl
5
+ skip: no /workspace/dnathinker/runs/exp_t3_grid_separatedQA_20260426_h100_vllm_full/zs_raw/predictions.jsonl
6
+ skip: no /workspace/dnathinker/runs/exp_t1_grid_separatedQA_20260426_h100_vllm_full/zs_enriched/predictions.jsonl
7
+ skip: no /workspace/dnathinker/runs/exp_t3_grid_separatedQA_20260426_h100_vllm_full/zs_enriched/predictions.jsonl
8
+ [08:19:37] STAGE 0c: T3 oracle-based eval (objective satisfaction)
9
+ skip: no /workspace/dnathinker/runs/exp_t3_grid_separatedQA_20260426_h100_vllm_full/zs_raw/predictions.jsonl
10
+ skip: no /workspace/dnathinker/runs/exp_t3_grid_separatedQA_20260426_h100_vllm_full/zs_enriched/predictions.jsonl
11
+ [08:19:37] STAGE 0b: early HF push
12
+ skip: exp_t1_fusion_sft_20260427_h100/final exists
13
+ [08:19:38] PREDICT-FUSION exp_t1_fusion_sft_20260427_h100 T1/raw
14
+ [score_adapter] max_new_tokens=384
15
+ [score_adapter] SCORE_ADAPTER_LIMIT=7000 (fast bench)
16
+ [score_adapter] batch_size=64
17
+ adapter] max_new_tokens=384
18
+ [score_adapter] SCORE_ADAPTER_LIMIT=7000 (fast bench)
19
+ [score_adapter] batch_size=64
20
+ [predict-fusion] task=enhancer_generation prompt=raw
21
+ [predict-fusion] building OneShotFusionLM (llm=Qwen/Qwen3.5-2B, dna=ntv3-650m)
22
+ [transformers] `torch_dtype` is deprecated! Use `dtype` instead!
23
+
24
+ 2026-04-28 08:20:16 [INFO] regureasoner.models.dna_encoder: Loading NTv3 DNA encoder from local snapshot /workspace/dnathinker/ntv3_local/generative
25
+ [transformers] You are using a model of type `ntv3_posttrained` to instantiate a model of type `ntv3_conditioned`. This may be expected if you are loading a checkpoint that shares a subset of the architecture (e.g., loading a `sam2_video` checkpoint into `Sam2Model`), but is otherwise not supported and can yield errors. Please verify that the checkpoint is compatible with the model you are instantiating.
26
+ [transformers] You are using a model of type `ntv3_posttrained` to instantiate a model of type `ntv3_conditioned`. This may be expected if you are loading a checkpoint that shares a subset of the architecture (e.g., loading a `sam2_video` checkpoint into `Sam2Model`), but is otherwise not supported and can yield errors. Please verify that the checkpoint is compatible with the model you are instantiating.
27
+ [predict-fusion] loading state_dict: /workspace/dnathinker/runs/exp_t1_fusion_sft_20260427_h100/final/pytorch_model.bin
28
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_1778959_1779459:760: HTTPError: HTTP Error 429: Too Many Requests
29
+ [predict-fusion] loaded; missing=0 unexpected=24
30
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_1873103_1873603:762: HTTPError: HTTP Error 429: Too Many Requests
31
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_1894319_1894819:764: HTTPError: HTTP Error 429: Too Many Requests
32
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_1920748_1921248:766: HTTPError: HTTP Error 429: Too Many Requests
33
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_1946911_1947411:768: HTTPError: HTTP Error 429: Too Many Requests
34
+ [trace] err id=train:pair_pos:Ast:TMEM52:chr1_1724197_1724697:738: HTTPError: HTTP Error 429: Too Many Requests
35
+ [trace] err id=train:pair_pos:Ast:ACAP3:chr1_1360502_1361002:315: HTTPError: HTTP Error 429: Too Many Requests
36
+ [trace] err id=train:pair_pos:Ast:ACAP3:chr1_1361849_1362349:317: HTTPError: HTTP Error 429: Too Many Requests
37
+ [trace] err id=train:pair_pos:Ast:TMEM52:chr1_1778959_1779459:744: HTTPError: HTTP Error 429: Too Many Requests
38
+ [trace] err id=train:pair_pos:Ast:ACAP3:chr1_1441903_1442403:319: HTTPError: HTTP Error 429: Too Many Requests
39
+ [trace] err id=train:pair_pos:Ast:TMEM52:chr1_1894319_1894819:748: HTTPError: HTTP Error 429: Too Many Requests
40
+ [trace] err id=train:pair_pos:Ast:MORN1:chr1_2274132_2274632:915: HTTPError: HTTP Error 429: Too Many Requests
41
+ [trace] err id=train:pair_pos:Ast:TMEM52:chr1_1946911_1947411:752: HTTPError: HTTP Error 429: Too Many Requests
42
+ [trace] err id=train:pair_pos:Ast:MORN1:chr1_2321632_2322132:921: HTTPError: HTTP Error 429: Too Many Requests
43
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1780050_1780550:724: HTTPError: HTTP Error 429: Too Many Requests
44
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1890907_1891407:726: HTTPError: HTTP Error 429: Too Many Requests
45
+ [trace] err id=train:pair_pos:Ast:MXRA8:chr1_1351924_1352424:401: HTTPError: HTTP Error 429: Too Many Requests
46
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1946383_1946883:730: HTTPError: HTTP Error 429: Too Many Requests
47
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1980607_1981107:732: HTTPError: HTTP Error 429: Too Many Requests
48
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_2060057_2060557:734: HTTPError: HTTP Error 429: Too Many Requests
49
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_2138056_2138556:736: HTTPError: HTTP Error 429: Too Many Requests
50
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1542469_1542969:639: HTTPError: HTTP Error 429: Too Many Requests
51
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1724197_1724697:641: HTTPError: HTTP Error 429: Too Many Requests
52
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1752591_1753091:643: HTTPError: HTTP Error 429: Too Many Requests
53
+ [trace] err id=train:pair_pos:Ast:TNFRSF18:chr1_1356721_1357221:174: HTTPError: HTTP Error 429: Too Many Requests
54
+ [trace] err id=train:pair_pos:Ast:PEX10:chr1_2214850_2215350:991: HTTPError: HTTP Error 429: Too Many Requests
55
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1873103_1873603:649: HTTPError: HTTP Error 429: Too Many Requests
56
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1894319_1894819:651: HTTPError: HTTP Error 429: Too Many Requests
57
+ [trace] err id=train:pair_pos:Ast:CDK11A:chr1_1920748_1921248:653: HTTPError: HTTP Error 429: Too Many Requests
58
+ [trace] err id=train:pair_pos:Ast:TAS1R3:chr1_1158154_1158654:361: HTTPError: HTTP Error 429: Too Many Requests
59
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1511817_1512317:657: HTTPError: HTTP Error 429: Too Many Requests
60
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1693150_1693650:659: HTTPError: HTTP Error 429: Too Many Requests
61
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1746158_1746658:661: HTTPError: HTTP Error 429: Too Many Requests
62
+ [trace] err id=train:pair_pos:Ast:MORN1:chr1_2407052_2407552:927: HTTPError: HTTP Error 429: Too Many Requests
63
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1763650_1764150:665: HTTPError: HTTP Error 429: Too Many Requests
64
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1780050_1780550:667: HTTPError: HTTP Error 429: Too Many Requests
65
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1890907_1891407:669: HTTPError: HTTP Error 429: Too Many Requests
66
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1907432_1907932:671: HTTPError: HTTP Error 429: Too Many Requests
67
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1946383_1946883:673: HTTPError: HTTP Error 429: Too Many Requests
68
+ [trace] err id=train:pair_pos:Ast:SLC35E2A:chr1_1980607_1981107:675: HTTPError: HTTP Error 429: Too Many Requests
69
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1724197_1724697:696: HTTPError: HTTP Error 429: Too Many Requests
70
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1752591_1753091:698: HTTPError: HTTP Error 429: Too Many Requests
71
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1758590_1759090:700: HTTPError: HTTP Error 429: Too Many Requests
72
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1778959_1779459:702: HTTPError: HTTP Error 429: Too Many Requests
73
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1873103_1873603:704: HTTPError: HTTP Error 429: Too Many Requests
74
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1894319_1894819:706: HTTPError: HTTP Error 429: Too Many Requests
75
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1920748_1921248:708: HTTPError: HTTP Error 429: Too Many Requests
76
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_1946911_1947411:710: HTTPError: HTTP Error 429: Too Many Requests
77
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_2016022_2016522:712: HTTPError: HTTP Error 429: Too Many Requests
78
+ [trace] err id=train:pair_pos:Ast:GNB1:chr1_2098254_2098754:714: HTTPError: HTTP Error 429: Too Many Requests
79
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1693150_1693650:716: HTTPError: HTTP Error 429: Too Many Requests
80
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1746158_1746658:718: HTTPError: HTTP Error 429: Too Many Requests
81
+ [trace] err id=train:pair_pos:Ast:CALML6:chr1_1753266_1753766:720: HTTPError: HTTP Error 429: Too Many Requests
82
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_2098254_2098754:772: HTTPError: HTTP Error 429: Too Many Requests
83
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_2194544_2195044:774: HTTPError: HTTP Error 429: Too Many Requests
84
+ [trace] err id=train:pair_pos:Ast:MRPL20-AS1:chr1_1511817_1512317:449: HTTPError: HTTP Error 429: Too Many Requests
85
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_2227617_2228117:778: HTTPError: HTTP Error 429: Too Many Requests
86
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_2238833_2239333:780: HTTPError: HTTP Error 429: Too Many Requests
87
+ [trace] err id=train:pair_pos:Ast:CFAP74:chr1_2248714_2249214:782: HTTPError: HTTP Error 429: Too Many Requests
88
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_1780050_1780550:784: HTTPError: HTTP Error 429: Too Many Requests
89
+ [trace] err id=train:pair_pos:Ast:FNDC10:chr1_1746158_1746658:569: HTTPError: HTTP Error 429: Too Many Requests
90
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_1907432_1907932:788: HTTPError: HTTP Error 429: Too Many Requests
91
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_1946383_1946883:790: HTTPError: HTTP Error 429: Too Many Requests
92
+ [trace] err id=train:pair_pos:Ast:MORN1:chr1_2591015_2591515:941: HTTPError: HTTP Error 429: Too Many Requests
93
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2060057_2060557:794: HTTPError: HTTP Error 429: Too Many Requests
94
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2138056_2138556:796: HTTPError: HTTP Error 429: Too Many Requests
95
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2200658_2201158:798: HTTPError: HTTP Error 429: Too Many Requests
96
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2214850_2215350:800: HTTPError: HTTP Error 429: Too Many Requests
97
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2230140_2230640:802: HTTPError: HTTP Error 429: Too Many Requests
98
+ [trace] err id=train:pair_pos:Ast:GABRD:chr1_2248019_2248519:804: HTTPError: HTTP Error 429: Too Many Requests
99
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_1980607_1981107:833: HTTPError: HTTP Error 429: Too Many Requests
100
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2060057_2060557:835: HTTPError: HTTP Error 429: Too Many Requests
101
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2138056_2138556:837: HTTPError: HTTP Error 429: Too Many Requests
102
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2200658_2201158:839: HTTPError: HTTP Error 429: Too Many Requests
103
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2214850_2215350:841: HTTPError: HTTP Error 429: Too Many Requests
104
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2230140_2230640:843: HTTPError: HTTP Error 429: Too Many Requests
105
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2248019_2248519:845: HTTPError: HTTP Error 429: Too Many Requests
106
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2270711_2271211:847: HTTPError: HTTP Error 429: Too Many Requests
107
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2272213_2272713:849: HTTPError: HTTP Error 429: Too Many Requests
108
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2274132_2274632:851: HTTPError: HTTP Error 429: Too Many Requests
109
+ [trace] err id=train:pair_pos:Ast:SLC35E2B:chr1_1920748_1921248:637: HTTPError: HTTP Error 429: Too Many Requests
110
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2312786_2313286:855: HTTPError: HTTP Error 429: Too Many Requests
111
+ [trace] err id=train:pair_pos:Ast:FAAP20:chr1_2321632_2322132:857: HTTPError: HTTP Error 429: Too Many Requests
112
+ [trace] err id=train:pair_pos:Ast:CDK11B:chr1_1752591_1753091:611: HTTPError: HTTP Error 429: Too Many Requests
113
+ [trace] err id=train:pair_pos:Ast:CDK11B:chr1_1758590_1759090:613: HTTPError: HTTP Error 429: Too Many Requests
114
+ [trace] err id=train:pair_pos:Ast:SKI:chr1_2248019_2248519:879: HTTPError: HTTP Error 429: Too Many Requests
115
+ [trace] err id=train:pair_pos:Ast:SKI:chr1_2270711_2271211:881: HTTPError: HTTP Error 429: Too Many Requests