logs/lookback-phi-4.log

Sync plan: hf://buckets/baimamboukar/generalizable-interpretability/lookback-lens/inputs -> artifacts/lookback-lens/inputs
  Uploads: 0
  Downloads: 4
  Deletes: 0
  Skips: 0
Syncing...
Sync completed.
Using Python 3.11.12 environment at: /opt/conda
Checked 8 packages in 9ms

Loading checkpoint shards:   0%|          | 0/6 [00:00<?, ?it/s]
Loading checkpoint shards:  17%|█▋        | 1/6 [00:00<00:03,  1.36it/s]
Loading checkpoint shards:  33%|███▎      | 2/6 [00:01<00:02,  1.36it/s]
Loading checkpoint shards:  50%|█████     | 3/6 [00:02<00:02,  1.34it/s]
Loading checkpoint shards:  67%|██████▋   | 4/6 [00:03<00:01,  1.27it/s]
Loading checkpoint shards:  83%|████████▎ | 5/6 [00:03<00:00,  1.24it/s]
Loading checkpoint shards: 100%|██████████| 6/6 [00:04<00:00,  1.18it/s]
Loading checkpoint shards: 100%|██████████| 6/6 [00:04<00:00,  1.24it/s]

  0%|          | 0/3850 [00:00<?, ?it/s]
  5%|▍         | 186/3850 [00:00<00:01, 1858.88it/s]
 10%|▉         | 378/3850 [00:00<00:01, 1894.00it/s]
 15%|█▍        | 568/3850 [00:00<00:01, 1874.87it/s]
 20%|█▉        | 756/3850 [00:00<00:01, 1855.16it/s]
 24%|██▍       | 942/3850 [00:00<00:02, 1424.24it/s]
 29%|██▉       | 1123/3850 [00:00<00:01, 1532.31it/s]
 34%|███▎      | 1299/3850 [00:00<00:01, 1597.46it/s]
 38%|███▊      | 1467/3850 [00:00<00:01, 1619.39it/s]
 43%|████▎     | 1645/3850 [00:00<00:01, 1666.00it/s]
 48%|████▊     | 1829/3850 [00:01<00:01, 1717.12it/s]
 52%|█████▏    | 2018/3850 [00:01<00:01, 1768.31it/s]
 57%|█████▋    | 2198/3850 [00:01<00:00, 1777.12it/s]
 62%|██████▏   | 2378/3850 [00:01<00:00, 1746.47it/s]
 67%|██████▋   | 2562/3850 [00:01<00:00, 1773.53it/s]
 71%|███████   | 2742/3850 [00:01<00:00, 1780.99it/s]
 76%|███████▌  | 2925/3850 [00:01<00:00, 1795.17it/s]
 81%|████████  | 3121/3850 [00:01<00:00, 1843.63it/s]
 86%|████████▌ | 3306/3850 [00:01<00:00, 1839.61it/s]
 91%|█████████ | 3491/3850 [00:02<00:00, 1832.47it/s]
 96%|█████████▌| 3679/3850 [00:02<00:00, 1846.52it/s]
100%|██████████| 3850/3850 [00:02<00:00, 1751.86it/s]

  0%|          | 0/1899 [00:00<?, ?it/s]
  7%|▋         | 129/1899 [00:00<00:02, 752.87it/s]
 13%|█▎        | 255/1899 [00:00<00:01, 982.58it/s]
 21%|██        | 390/1899 [00:00<00:01, 1116.01it/s]
 27%|██▋       | 512/1899 [00:00<00:01, 1151.76it/s]
 33%|███▎      | 631/1899 [00:00<00:01, 1161.52it/s]
 39%|███▉      | 750/1899 [00:00<00:00, 1168.06it/s]
 46%|████▌     | 872/1899 [00:00<00:00, 1183.96it/s]
 52%|█████▏    | 992/1899 [00:00<00:00, 1181.06it/s]
 59%|█████▊    | 1111/1899 [00:00<00:00, 1178.17it/s]
 65%|██████▍   | 1230/1899 [00:01<00:00, 1179.49it/s]
 71%|███████   | 1349/1899 [00:01<00:00, 1180.15it/s]
 77%|███████▋  | 1468/1899 [00:01<00:00, 1174.90it/s]
 84%|████████▎ | 1586/1899 [00:01<00:00, 1172.46it/s]
 90%|████████▉ | 1704/1899 [00:01<00:00, 1171.25it/s]
 96%|█████████▌| 1822/1899 [00:01<00:00, 1168.11it/s]
100%|██████████| 1899/1899 [00:01<00:00, 1129.94it/s]

  0%|          | 0/1899 [00:00<?, ?it/s]
  7%|▋         | 139/1899 [00:00<00:01, 1388.70it/s]
 15%|█▍        | 278/1899 [00:00<00:01, 1378.37it/s]
 22%|██▏       | 416/1899 [00:00<00:01, 1378.80it/s]
 29%|██▉       | 554/1899 [00:00<00:00, 1374.40it/s]
 36%|███▋      | 692/1899 [00:00<00:00, 1358.38it/s]
 44%|████▍     | 839/1899 [00:00<00:00, 1395.68it/s]
 52%|█████▏    | 982/1899 [00:00<00:00, 1406.17it/s]
 59%|█████▉    | 1123/1899 [00:00<00:00, 1405.80it/s]
 67%|██████▋   | 1264/1899 [00:00<00:00, 1404.18it/s]
 74%|███████▍  | 1405/1899 [00:01<00:00, 1403.31it/s]
 82%|████████▏ | 1554/1899 [00:01<00:00, 1429.31it/s]
 89%|████████▉ | 1698/1899 [00:01<00:00, 1432.10it/s]
 97%|█████████▋| 1842/1899 [00:01<00:00, 1432.89it/s]
100%|██████████| 1899/1899 [00:01<00:00, 1360.37it/s]

  0%|          | 0/3850 [00:00<?, ?it/s]
  6%|▌         | 214/3850 [00:00<00:03, 1201.32it/s]
 12%|█▏        | 461/3850 [00:00<00:01, 1764.65it/s]
 18%|█▊        | 691/3850 [00:00<00:01, 1959.53it/s]
 23%|██▎       | 900/3850 [00:00<00:02, 1471.76it/s]
 29%|██▊       | 1098/3850 [00:00<00:01, 1609.03it/s]
 34%|███▎      | 1299/3850 [00:00<00:01, 1720.31it/s]
 39%|███▊      | 1485/3850 [00:00<00:01, 1760.05it/s]
 44%|████▍     | 1686/3850 [00:00<00:01, 1832.07it/s]
 49%|████▉     | 1877/3850 [00:01<00:01, 1853.50it/s]
 55%|█████▌    | 2120/3850 [00:01<00:00, 2022.88it/s]
 61%|██████▏   | 2363/3850 [00:01<00:00, 2143.13it/s]
 68%|██████▊   | 2614/3850 [00:01<00:00, 2252.08it/s]
 74%|███████▍  | 2853/3850 [00:01<00:00, 2292.20it/s]
 81%|████████  | 3121/3850 [00:01<00:00, 2407.33it/s]
 87%|████████▋ | 3364/3850 [00:01<00:00, 2407.32it/s]
 94%|█████████▎| 3607/3850 [00:01<00:00, 2413.91it/s]
100%|██████████| 3850/3850 [00:01<00:00, 2043.98it/s]

  0%|          | 0/59046 [00:00<?, ?it/s]
  3%|▎         | 1535/59046 [00:00<00:03, 15348.11it/s]
  5%|▌         | 3104/59046 [00:00<00:03, 15544.86it/s]
  8%|▊         | 4674/59046 [00:00<00:03, 15611.82it/s]
 11%|█         | 6237/59046 [00:00<00:03, 15618.66it/s]
 13%|█▎        | 7874/59046 [00:00<00:03, 15888.19it/s]
 16%|█▌        | 9464/59046 [00:00<00:03, 15891.16it/s]
 19%|█▉        | 11109/59046 [00:00<00:02, 16071.71it/s]
 22%|██▏       | 12727/59046 [00:00<00:02, 16104.77it/s]
 24%|██▍       | 14342/59046 [00:00<00:02, 16118.07it/s]
 27%|██▋       | 15983/59046 [00:01<00:02, 16205.86it/s]
 30%|██▉       | 17604/59046 [00:01<00:02, 16123.70it/s]
 33%|███▎      | 19222/59046 [00:01<00:02, 16137.62it/s]
 35%|███▌      | 20838/59046 [00:01<00:02, 16141.74it/s]
 38%|███▊      | 22453/59046 [00:01<00:02, 15919.95it/s]
 41%|████      | 24046/59046 [00:01<00:02, 15748.60it/s]
 44%|████▎     | 25743/59046 [00:01<00:02, 16109.44it/s]
 47%|████▋     | 27979/59046 [00:01<00:01, 17966.89it/s]
 50%|█████     | 29779/59046 [00:01<00:01, 17407.90it/s]
 53%|█████▎    | 31526/59046 [00:01<00:01, 16923.34it/s]
 56%|█████▋    | 33224/59046 [00:02<00:01, 16662.43it/s]
 59%|█████▉    | 34895/59046 [00:02<00:01, 16459.99it/s]
 62%|██████▏   | 36544/59046 [00:02<00:01, 15380.52it/s]
 65%|██████▍   | 38096/59046 [00:02<00:01, 14782.26it/s]
 67%|██████▋   | 39586/59046 [00:02<00:01, 14405.02it/s]
 70%|██████▉   | 41070/59046 [00:02<00:01, 14523.50it/s]
 72%|███████▏  | 42544/59046 [00:02<00:01, 14583.48it/s]
 75%|███████▍  | 44016/59046 [00:02<00:01, 14621.95it/s]
 77%|███████▋  | 45507/59046 [00:02<00:00, 14704.92it/s]
 80%|███████▉  | 46981/59046 [00:02<00:00, 14499.90it/s]
 82%|████████▏ | 48434/59046 [00:03<00:00, 14344.20it/s]
 84%|████████▍ | 49870/59046 [00:03<00:00, 14115.56it/s]
 87%|████████▋ | 51283/59046 [00:03<00:00, 14060.03it/s]
 89%|████████▉ | 52690/59046 [00:03<00:00, 14053.15it/s]
 92%|█████████▏| 54109/59046 [00:03<00:00, 14092.71it/s]
 94%|█████████▍| 55542/59046 [00:03<00:00, 14161.43it/s]
 96%|█████████▋| 56959/59046 [00:03<00:00, 14082.15it/s]
 99%|█████████▉| 58368/59046 [00:03<00:00, 14035.94it/s]
100%|██████████| 59046/59046 [00:03<00:00, 15333.24it/s]

  0%|          | 0/137102 [00:00<?, ?it/s]
  1%|          | 1582/137102 [00:00<00:08, 15810.10it/s]
  2%|▏         | 3164/137102 [00:00<00:08, 15113.22it/s]
  3%|▎         | 4678/137102 [00:00<00:08, 15004.50it/s]
  5%|▍         | 6180/137102 [00:00<00:08, 14809.96it/s]
  6%|▌         | 7744/137102 [00:00<00:08, 15101.85it/s]
  7%|▋         | 9301/137102 [00:00<00:08, 15256.23it/s]
  8%|▊         | 10828/137102 [00:00<00:09, 13922.87it/s]
  9%|▉         | 12241/137102 [00:00<00:09, 13001.77it/s]
 10%|▉         | 13582/137102 [00:00<00:09, 13115.95it/s]
 11%|█         | 14910/137102 [00:01<00:09, 12833.34it/s]
 12%|█▏        | 16211/137102 [00:01<00:09, 12872.54it/s]
 13%|█▎        | 17506/137102 [00:01<00:09, 12795.32it/s]
 14%|█▎        | 18791/137102 [00:01<00:09, 12810.35it/s]
 15%|█▍        | 20121/137102 [00:01<00:09, 12944.89it/s]
 16%|█▌        | 21419/137102 [00:01<00:08, 12876.09it/s]
 17%|█▋        | 22714/137102 [00:01<00:08, 12897.40it/s]
 18%|█▊        | 24006/137102 [00:01<00:08, 12859.82it/s]
 18%|█▊        | 25293/137102 [00:01<00:08, 12829.70it/s]
 19%|█▉        | 26601/137102 [00:01<00:08, 12903.87it/s]
 20%|██        | 27893/137102 [00:02<00:08, 12906.11it/s]
 21%|██▏       | 29273/137102 [00:02<00:08, 13172.63it/s]
 22%|██▏       | 30591/137102 [00:02<00:08, 13064.54it/s]
 23%|██▎       | 31898/137102 [00:02<00:12, 8439.13it/s] 
 24%|██▍       | 33227/137102 [00:02<00:10, 9477.07it/s]
 25%|██▌       | 34520/137102 [00:02<00:09, 10288.74it/s]
 26%|██▌       | 35797/137102 [00:02<00:09, 10911.45it/s]
 27%|██▋       | 37127/137102 [00:02<00:08, 11538.17it/s]
 28%|██▊       | 38412/137102 [00:03<00:08, 11893.84it/s]
 29%|██▉       | 39751/137102 [00:03<00:07, 12311.05it/s]
 30%|██▉       | 41033/137102 [00:03<00:07, 12348.47it/s]
 31%|███       | 42361/137102 [00:03<00:07, 12598.42it/s]
 32%|███▏      | 43647/137102 [00:03<00:07, 12523.10it/s]
 33%|███▎      | 44918/137102 [00:03<00:07, 12555.58it/s]
 34%|███▎      | 46258/137102 [00:03<00:07, 12801.07it/s]
 35%|███▍      | 47559/137102 [00:03<00:06, 12860.84it/s]
 36%|███▌      | 48852/137102 [00:03<00:06, 12817.64it/s]
 37%|███▋      | 50139/137102 [00:03<00:06, 12768.51it/s]
 38%|███▊      | 51420/137102 [00:04<00:06, 12714.37it/s]
 38%|███▊      | 52694/137102 [00:04<00:06, 12677.70it/s]
 39%|███▉      | 53995/137102 [00:04<00:06, 12775.73it/s]
 40%|████      | 55331/137102 [00:04<00:06, 12948.58it/s]
 41%|████▏     | 56627/137102 [00:04<00:06, 12879.15it/s]
 42%|████▏     | 57916/137102 [00:04<00:06, 12380.45it/s]
 43%|████▎     | 59218/137102 [00:04<00:06, 12564.99it/s]
 44%|████▍     | 60511/137102 [00:04<00:06, 12670.88it/s]
 45%|████▌     | 61781/137102 [00:04<00:06, 12118.88it/s]
 46%|████▌     | 63000/137102 [00:05<00:06, 12111.45it/s]
 47%|████▋     | 64285/137102 [00:05<00:05, 12324.68it/s]
 48%|████▊     | 65561/137102 [00:05<00:05, 12451.62it/s]
 49%|████▉     | 66879/137102 [00:05<00:05, 12665.42it/s]
 50%|████▉     | 68175/137102 [00:05<00:05, 12751.00it/s]
 51%|█████     | 69495/137102 [00:05<00:05, 12883.54it/s]
 52%|█████▏    | 70850/137102 [00:05<00:05, 13080.70it/s]
 53%|█████▎    | 72160/137102 [00:05<00:04, 13076.47it/s]
 54%|█████▎    | 73485/137102 [00:05<00:04, 13126.17it/s]
 55%|█████▍    | 74799/137102 [00:05<00:04, 13070.36it/s]
 56%|█████▌    | 76107/137102 [00:06<00:04, 13036.53it/s]
 56%|█████▋    | 77411/137102 [00:06<00:04, 13005.73it/s]
 57%|█████▋    | 78737/137102 [00:06<00:04, 13080.93it/s]
 58%|█████▊    | 80046/137102 [00:06<00:04, 12988.58it/s]
 59%|█████▉    | 81346/137102 [00:06<00:04, 12945.54it/s]
 60%|██████    | 82646/137102 [00:06<00:04, 12959.47it/s]
 61%|██████    | 83957/137102 [00:06<00:04, 13003.25it/s]
 62%|██████▏   | 85266/137102 [00:06<00:03, 13028.06it/s]
 63%|██████▎   | 86569/137102 [00:06<00:03, 12975.71it/s]
 64%|██████▍   | 87900/137102 [00:06<00:03, 13074.58it/s]
 65%|██████▌   | 89208/137102 [00:07<00:03, 12989.25it/s]
 66%|██████▌   | 90540/137102 [00:07<00:03, 13085.67it/s]
 67%|██████▋   | 91849/137102 [00:07<00:03, 13045.78it/s]
 68%|██████▊   | 93189/137102 [00:07<00:03, 13149.13it/s]
 69%|██████▉   | 94505/137102 [00:07<00:03, 12991.02it/s]
 70%|██████▉   | 95821/137102 [00:07<00:03, 13038.15it/s]
 71%|███████   | 97126/137102 [00:07<00:03, 12993.58it/s]
 72%|███████▏  | 98435/137102 [00:07<00:02, 13018.95it/s]
 73%|███████▎  | 99738/137102 [00:07<00:02, 12956.38it/s]
 74%|███████▎  | 101044/137102 [00:07<00:02, 12985.50it/s]
 75%|███████▍  | 102343/137102 [00:08<00:02, 12914.41it/s]
 76%|███████▌  | 103635/137102 [00:08<00:02, 12833.90it/s]
 77%|███████▋  | 104919/137102 [00:08<00:02, 12688.64it/s]
 77%|███████▋  | 106189/137102 [00:08<00:02, 12566.08it/s]
 78%|███████▊  | 107446/137102 [00:08<00:02, 12471.95it/s]
 79%|███████▉  | 108694/137102 [00:08<00:02, 12418.51it/s]
 80%|████████  | 109936/137102 [00:08<00:02, 12360.30it/s]
 81%|████████  | 111173/137102 [00:08<00:02, 12293.19it/s]
 82%|████████▏ | 112423/137102 [00:08<00:01, 12353.30it/s]
 83%|████████▎ | 113664/137102 [00:08<00:01, 12369.92it/s]
 84%|████████▍ | 114902/137102 [00:09<00:01, 12361.39it/s]
 85%|████████▍ | 116139/137102 [00:09<00:01, 12294.45it/s]
 86%|████████▌ | 117369/137102 [00:09<00:01, 12247.96it/s]
 87%|████████▋ | 118613/137102 [00:09<00:01, 12302.40it/s]
 87%|████████▋ | 119844/137102 [00:09<00:01, 12225.39it/s]
 88%|████████▊ | 121067/137102 [00:09<00:01, 12189.47it/s]
 89%|████████▉ | 122299/137102 [00:09<00:01, 12224.66it/s]
 90%|█████████ | 123522/137102 [00:09<00:01, 12190.09it/s]
 91%|█████████ | 124751/137102 [00:09<00:01, 12217.23it/s]
 92%|█████████▏| 125973/137102 [00:09<00:00, 12146.27it/s]
 93%|█████████▎| 127716/137102 [00:10<00:00, 13719.57it/s]
 95%|█████████▍| 129602/137102 [00:10<00:00, 15245.04it/s]
 96%|█████████▌| 131501/137102 [00:10<00:00, 16344.01it/s]
 97%|█████████▋| 133523/137102 [00:10<00:00, 17502.19it/s]
 99%|█████████▉| 135581/137102 [00:10<00:00, 18347.42it/s]
100%|██████████| 137102/137102 [00:10<00:00, 12996.77it/s]

  0%|          | 0/137102 [00:00<?, ?it/s]
  1%|▏         | 1984/137102 [00:00<00:06, 19834.72it/s]
  3%|▎         | 3968/137102 [00:00<00:06, 19700.89it/s]
  4%|▍         | 5939/137102 [00:00<00:06, 19553.30it/s]
  6%|▌         | 7898/137102 [00:00<00:06, 19565.84it/s]
  7%|▋         | 9916/137102 [00:00<00:06, 19784.47it/s]
  9%|▊         | 11895/137102 [00:00<00:06, 19777.13it/s]
 10%|█         | 14084/137102 [00:00<00:06, 20465.76it/s]
 12%|█▏        | 16157/137102 [00:00<00:05, 20548.68it/s]
 13%|█▎        | 18276/137102 [00:00<00:05, 20748.21it/s]
 15%|█▍        | 20351/137102 [00:01<00:05, 20717.92it/s]
 16%|█▋        | 22517/137102 [00:01<00:05, 21002.91it/s]
 18%|█▊        | 24618/137102 [00:01<00:05, 20454.55it/s]
 19%|█▉        | 26667/137102 [00:01<00:05, 19947.57it/s]
 21%|██        | 28814/137102 [00:01<00:05, 20331.98it/s]
 23%|██▎       | 30891/137102 [00:01<00:05, 20439.17it/s]
 24%|██▍       | 32976/137102 [00:01<00:05, 20535.55it/s]
 26%|██▌       | 35142/137102 [00:01<00:04, 20859.26it/s]
 27%|██▋       | 37234/137102 [00:01<00:04, 20877.06it/s]
 29%|██▉       | 39513/137102 [00:01<00:04, 21391.54it/s]
 30%|███       | 41719/137102 [00:02<00:04, 21587.10it/s]
 32%|███▏      | 44034/137102 [00:02<00:04, 22015.05it/s]
 34%|███▎      | 46237/137102 [00:02<00:04, 21907.70it/s]
 35%|███▌      | 48447/137102 [00:02<00:04, 21963.95it/s]
 37%|███▋      | 50644/137102 [00:02<00:06, 12983.65it/s]
 39%|███▊      | 52926/137102 [00:02<00:05, 14964.35it/s]
 40%|████      | 55231/137102 [00:02<00:04, 16770.08it/s]
 42%|████▏     | 57357/137102 [00:02<00:04, 17856.16it/s]
 44%|████▎     | 59728/137102 [00:03<00:03, 19359.15it/s]
 45%|████▌     | 61964/137102 [00:03<00:03, 20163.09it/s]
 47%|████▋     | 64176/137102 [00:03<00:03, 20703.96it/s]
 48%|████▊     | 66383/137102 [00:03<00:03, 21089.45it/s]
 50%|█████     | 68575/137102 [00:03<00:03, 21304.88it/s]
 52%|█████▏    | 70765/137102 [00:03<00:03, 21391.33it/s]
 53%|█████▎    | 72946/137102 [00:03<00:02, 21432.31it/s]
 55%|█████▍    | 75119/137102 [00:03<00:02, 21347.60it/s]
 56%|█████▋    | 77275/137102 [00:03<00:02, 21185.16it/s]
 58%|█████▊    | 79408/137102 [00:03<00:02, 21012.72it/s]
 59%|█████▉    | 81542/137102 [00:04<00:02, 21107.37it/s]
 61%|██████    | 83660/137102 [00:04<00:02, 21011.23it/s]
 63%|██████▎   | 85818/137102 [00:04<00:02, 21178.80it/s]
 64%|██████▍   | 87974/137102 [00:04<00:02, 21289.23it/s]
 66%|██████▌   | 90106/137102 [00:04<00:02, 21235.11it/s]
 67%|██████▋   | 92232/137102 [00:04<00:02, 21070.67it/s]
 69%|██████▉   | 94341/137102 [00:04<00:02, 20779.82it/s]
 70%|███████   | 96421/137102 [00:04<00:01, 20760.74it/s]
 72%|███████▏  | 98590/137102 [00:04<00:01, 21034.20it/s]
 74%|███████▎  | 100794/137102 [00:04<00:01, 21330.55it/s]
 75%|███████▌  | 102975/137102 [00:05<00:01, 21472.41it/s]
 77%|███████▋  | 105124/137102 [00:05<00:01, 18547.74it/s]
 78%|███████▊  | 107050/137102 [00:05<00:01, 17224.48it/s]
 79%|███████▉  | 108834/137102 [00:05<00:01, 16080.79it/s]
 81%|████████  | 110491/137102 [00:05<00:01, 15027.15it/s]
 82%|████████▏ | 112032/137102 [00:05<00:01, 14475.97it/s]
 83%|████████▎ | 113504/137102 [00:05<00:01, 14298.76it/s]
 84%|████████▍ | 114949/137102 [00:05<00:01, 14096.39it/s]
 85%|████████▍ | 116368/137102 [00:06<00:01, 14105.50it/s]
 86%|████████▌ | 117785/137102 [00:06<00:01, 13943.22it/s]
 87%|████████▋ | 119183/137102 [00:06<00:01, 13734.85it/s]
 88%|████████▊ | 120559/137102 [00:06<00:01, 13726.34it/s]
 89%|████████▉ | 121934/137102 [00:06<00:01, 13662.59it/s]
 90%|████████▉ | 123302/137102 [00:06<00:01, 13639.43it/s]
 91%|█████████ | 124667/137102 [00:06<00:00, 13513.71it/s]
 92%|█████████▏| 126019/137102 [00:06<00:00, 13326.26it/s]
 93%|█████████▎| 127384/137102 [00:06<00:00, 13419.67it/s]
 94%|█████████▍| 128727/137102 [00:06<00:00, 13344.30it/s]
 95%|█████████▍| 130101/137102 [00:07<00:00, 13460.67it/s]
 96%|█████████▌| 131448/137102 [00:07<00:00, 13399.18it/s]
 97%|█████████▋| 132816/137102 [00:07<00:00, 13481.23it/s]
 98%|█████████▊| 134165/137102 [00:07<00:00, 13418.98it/s]
 99%|█████████▉| 135551/137102 [00:07<00:00, 13547.32it/s]
100%|█████████▉| 136907/137102 [00:07<00:00, 13538.12it/s]
100%|██████████| 137102/137102 [00:07<00:00, 18036.50it/s]

  0%|          | 0/59046 [00:00<?, ?it/s]
  4%|▎         | 2188/59046 [00:00<00:02, 21876.42it/s]
  7%|▋         | 4392/59046 [00:00<00:02, 21970.80it/s]
 11%|█         | 6590/59046 [00:00<00:02, 21557.78it/s]
 15%|█▍        | 8840/59046 [00:00<00:02, 21924.67it/s]
 19%|█▊        | 11034/59046 [00:00<00:02, 21338.55it/s]
 22%|██▏       | 13265/59046 [00:00<00:02, 21660.71it/s]
 26%|██▌       | 15434/59046 [00:00<00:02, 21531.21it/s]
 30%|██▉       | 17617/59046 [00:00<00:01, 21623.20it/s]
 34%|███▎      | 19782/59046 [00:00<00:01, 21630.43it/s]
 37%|███▋      | 21946/59046 [00:01<00:01, 21289.65it/s]
 41%|████      | 24239/59046 [00:01<00:01, 21783.09it/s]
 45%|████▍     | 26471/59046 [00:01<00:01, 21943.90it/s]
 49%|████▊     | 28667/59046 [00:01<00:01, 21660.05it/s]
 52%|█████▏    | 30842/59046 [00:01<00:01, 21685.64it/s]
 56%|█████▌    | 33092/59046 [00:01<00:01, 21927.90it/s]
 60%|█████▉    | 35390/59046 [00:01<00:01, 22240.13it/s]
 64%|██████▍   | 37820/59046 [00:01<00:00, 22855.66it/s]
 68%|██████▊   | 40107/59046 [00:01<00:00, 22752.77it/s]
 72%|███████▏  | 42384/59046 [00:01<00:00, 22448.18it/s]
 76%|███████▌  | 44631/59046 [00:02<00:00, 22299.98it/s]
 79%|███████▉  | 46862/59046 [00:02<00:00, 22003.10it/s]
 83%|████████▎ | 49064/59046 [00:02<00:00, 21631.72it/s]
 87%|████████▋ | 51343/59046 [00:02<00:00, 21967.91it/s]
 91%|█████████ | 53542/59046 [00:02<00:00, 21948.43it/s]
 94%|█████████▍| 55739/59046 [00:02<00:00, 21886.96it/s]
 98%|█████████▊| 57961/59046 [00:02<00:00, 21984.88it/s]
100%|██████████| 59046/59046 [00:02<00:00, 21802.09it/s]
/workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-nq.pt
/workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-cnndm.pt
======== Loading data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-nq-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-nq.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Baseline AUROC: 0.376940530
Train AUROC of the classifier: 0.984272984
Test AUROC of the classifier: 0.901579162
Top-10 important features:
lookback-mean-L33-H2: -1.446306408
lookback-mean-L16-H23: -1.348257371
lookback-mean-L22-H29: 1.223903212
lookback-mean-L25-H27: 1.215140050
lookback-mean-L33-H30: -1.161465338
lookback-mean-L25-H15: -1.145237004
lookback-mean-L31-H12: 1.125003287
lookback-mean-L29-H35: -1.115291894
lookback-mean-L25-H5: 1.106424866
lookback-mean-L24-H20: -1.082534317
Train AUROC of the classifier: 0.983784088
Test AUROC of the classifier: 0.906376732
Top-10 important features:
lookback-mean-L19-H5: 1.623896451
lookback-mean-L27-H17: 1.392790224
lookback-mean-L27-H11: 1.323177604
lookback-mean-L25-H15: -1.280765250
lookback-mean-L6-H39: 1.272454927
lookback-mean-L33-H2: -1.187557396
lookback-mean-L24-H4: 1.154348591
lookback-mean-L22-H21: -1.146721635
lookback-mean-L21-H16: 1.128777123
lookback-mean-L34-H27: 1.123702872
======== Transfer to data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-cnndm-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-cnndm.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Transfer Baseline AUROC: 0.440770517
Transfer AUROC of the classifier: 0.871386665
======== Loading data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-cnndm-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-cnndm.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Baseline AUROC: 0.440770517
Train AUROC of the classifier: 0.990813460
Test AUROC of the classifier: 0.884228612
Top-10 important features:
lookback-mean-L33-H21: -1.445000751
lookback-mean-L29-H30: -1.249933483
lookback-mean-L30-H11: 1.125202441
lookback-mean-L33-H30: -1.051773286
lookback-mean-L28-H30: 1.040183283
lookback-mean-L32-H9: -0.980378540
lookback-mean-L26-H35: -0.972076249
lookback-mean-L3-H18: 0.957095169
lookback-mean-L25-H39: 0.912895748
lookback-mean-L30-H38: -0.848151462
Train AUROC of the classifier: 0.982959107
Test AUROC of the classifier: 0.904578328
Top-10 important features:
lookback-mean-L30-H38: -1.249216261
lookback-mean-L5-H12: 1.133405217
lookback-mean-L29-H35: -1.096084248
lookback-mean-L28-H39: -1.068296549
lookback-mean-L18-H31: -1.019666741
lookback-mean-L16-H23: -0.988021026
lookback-mean-L30-H5: 0.959250148
lookback-mean-L17-H33: 0.946749663
lookback-mean-L29-H30: -0.933067216
lookback-mean-L10-H17: 0.932735972
======== Transfer to data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-nq-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-nq.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Transfer Baseline AUROC: 0.376940530
Transfer AUROC of the classifier: 0.830823083
======== Results:
                  , Train AUROC (on A), Test AUROC (on A), Transfer AUROC (on B)
A=nq-7b;B=cnndm-7b, 0.9840285357240282, 0.9039779471120246, 0.8713866645065729
A=cnndm-7b;B=nq-7b, 0.9868862837584778, 0.8944034697551608, 0.8308230833532361

======== Loading data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-nq-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-nq.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Baseline AUROC: 0.480779808
Train AUROC of the classifier: 0.939308628
Test AUROC of the classifier: 0.915359052
Top-10 important features:
lookback-mean-L25-H3: -3.424647478
lookback-mean-L34-H19: 3.265231521
lookback-mean-L16-H28: 3.074931514
lookback-mean-L14-H15: 2.911095850
lookback-mean-L5-H33: 2.750842740
lookback-mean-L22-H21: -2.746675145
lookback-mean-L25-H16: -2.712212324
lookback-mean-L34-H12: 2.707810457
lookback-mean-L39-H37: 2.639874798
lookback-mean-L23-H6: 2.545005858
Train AUROC of the classifier: 0.937659298
Test AUROC of the classifier: 0.917084086
Top-10 important features:
lookback-mean-L25-H3: -4.132416264
lookback-mean-L16-H24: 2.969433193
lookback-mean-L23-H6: 2.962343490
lookback-mean-L21-H17: -2.895780075
lookback-mean-L14-H0: -2.789521300
lookback-mean-L39-H28: -2.741262754
lookback-mean-L13-H32: -2.741260948
lookback-mean-L12-H35: -2.628990004
lookback-mean-L5-H31: -2.628137681
lookback-mean-L34-H19: 2.618534710
======== Transfer to data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-cnndm-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-cnndm.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Transfer Baseline AUROC: 0.502359549
Transfer AUROC of the classifier: 0.670671352
======== Loading data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-cnndm-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-cnndm.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Baseline AUROC: 0.502359549
Train AUROC of the classifier: 0.895463926
Test AUROC of the classifier: 0.871210164
Top-10 important features:
lookback-mean-L23-H35: 3.597013031
lookback-mean-L15-H26: 3.066894428
lookback-mean-L16-H28: 2.996024872
lookback-mean-L9-H35: 2.906000073
lookback-mean-L13-H25: -2.770293903
lookback-mean-L11-H8: -2.563216728
lookback-mean-L7-H21: -2.543976842
lookback-mean-L19-H16: -2.519763734
lookback-mean-L38-H27: 2.467098536
lookback-mean-L21-H20: -2.438839236
Train AUROC of the classifier: 0.893405563
Test AUROC of the classifier: 0.869312658
Top-10 important features:
lookback-mean-L39-H36: 3.089118432
lookback-mean-L9-H35: 2.861101068
lookback-mean-L16-H28: 2.687180901
lookback-mean-L15-H26: 2.613486935
lookback-mean-L21-H10: 2.540243063
lookback-mean-L21-H21: -2.442156517
lookback-mean-L28-H0: -2.435462698
lookback-mean-L15-H8: 2.433627751
lookback-mean-L17-H26: 2.341108526
lookback-mean-L19-H14: 2.328244982
======== Transfer to data from /workspace/generalizable-interpretability/artifacts/lookback-lens/inputs/anno-nq-7b.jsonl and /workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/lookback-ratio-nq.pt...
A trivial baseline: if higher lookback ratio means less hallucination.
Transfer Baseline AUROC: 0.480779808
Transfer AUROC of the classifier: 0.666093372
======== Results:
                  , Train AUROC (on A), Test AUROC (on A), Transfer AUROC (on B)
A=nq-7b;B=cnndm-7b, 0.9384839628145643, 0.9162215691790545, 0.6706713523655043
A=cnndm-7b;B=nq-7b, 0.8944347447845185, 0.8702614106007603, 0.6660933724114221

/workspace/generalizable-interpretability/artifacts/lookback-lens/extensions/phi-4/results.csv