artifacts/omac_4b_placebo.log

Tasks: 479 code + 500 math = 979 total
Domain shift (code→math) at episode 479
Conditions: ['PLACEBO_RETRIEVAL']
Seeds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9], Block size: 10, Concurrency: 10

Launching 10 runs with concurrency=10...
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
[start] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400 (979 episodes, 98 blocks, condition=PLACEBO_RETRIEVAL, resuming from block 0)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 1/98, score=0.30, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 1/98, score=0.30, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 1/98, score=0.20, reward=0.000, store=8
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 1/98, score=0.30, reward=0.000, store=3
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 1/98, score=0.10, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 1/98, score=0.30, reward=0.000, store=7
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 1/98, score=0.20, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 1/98, score=0.10, reward=0.000, store=1
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 1/98, score=0.20, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 1/98, score=0.10, reward=0.000, store=10
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 6/98, score=0.30, reward=0.000, store=43
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 6/98, score=0.10, reward=0.000, store=58
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 6/98, score=0.20, reward=0.000, store=53
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 6/98, score=0.40, reward=0.000, store=36
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 6/98, score=0.10, reward=0.000, store=38
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 6/98, score=0.30, reward=0.000, store=48
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 11/98, score=0.10, reward=0.000, store=90
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 11/98, score=0.30, reward=0.000, store=78
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 11/98, score=0.10, reward=0.000, store=58
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 11/98, score=0.10, reward=0.000, store=69
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 11/98, score=0.10, reward=0.000, store=94
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 11/98, score=0.30, reward=0.000, store=77
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 6/98, score=0.30, reward=0.000, store=44
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 6/98, score=0.20, reward=0.000, store=34
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 6/98, score=0.20, reward=0.000, store=30
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 6/98, score=0.20, reward=0.000, store=47
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 16/98, score=0.10, reward=0.000, store=128
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 16/98, score=0.10, reward=0.000, store=88
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 16/98, score=0.00, reward=0.000, store=110
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 16/98, score=0.20, reward=0.000, store=136
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 16/98, score=0.20, reward=0.000, store=115
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 11/98, score=0.20, reward=0.000, store=64
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 11/98, score=0.30, reward=0.000, store=77
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 21/98, score=0.40, reward=0.000, store=153
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 21/98, score=0.00, reward=0.000, store=169
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 16/98, score=0.10, reward=0.000, store=98
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 21/98, score=0.20, reward=0.000, store=146
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 16/98, score=0.00, reward=0.000, store=117
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 16/98, score=0.30, reward=0.000, store=104
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 26/98, score=0.00, reward=0.000, store=194
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 11/98, score=0.10, reward=0.000, store=66
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 11/98, score=0.10, reward=0.000, store=63
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 21/98, score=0.30, reward=0.000, store=163
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 26/98, score=0.10, reward=0.000, store=194
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 21/98, score=0.20, reward=0.000, store=146
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 21/98, score=0.40, reward=0.000, store=146
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 21/98, score=0.30, reward=0.000, store=157
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 26/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 31/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 26/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 31/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 16/98, score=0.40, reward=0.000, store=81
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 26/98, score=0.10, reward=0.000, store=170
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 26/98, score=0.30, reward=0.000, store=177
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 21/98, score=0.40, reward=0.000, store=130
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 31/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 36/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 16/98, score=0.20, reward=0.000, store=93
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 36/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 31/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 31/98, score=0.30, reward=0.000, store=198
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 31/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 41/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 36/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 26/98, score=0.30, reward=0.000, store=171
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 36/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 36/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 41/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 36/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 21/98, score=0.10, reward=0.000, store=122
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 31/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 26/98, score=0.20, reward=0.000, store=176
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 41/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 46/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 41/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 46/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 41/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 41/98, score=0.60, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 21/98, score=0.20, reward=0.000, store=111
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 36/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 46/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 31/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 46/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 46/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 46/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 26/98, score=0.20, reward=0.000, store=155
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 41/98, score=0.40, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 36/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 26/98, score=0.20, reward=0.000, store=150
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 31/98, score=0.00, reward=0.000, store=184
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 46/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 41/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 31/98, score=0.10, reward=0.000, store=182
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 36/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 46/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 36/98, score=0.20, reward=0.000, store=197
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 41/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 41/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 46/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 46/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 51/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 51/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 51/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 51/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 51/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 51/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 51/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 51/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 51/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 51/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 56/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 56/98, score=0.30, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 56/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 56/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 56/98, score=0.30, reward=0.000, store=200
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [retry] HTTP 502, waiting 4.0s (attempt 2/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 56/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 56/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 56/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 56/98, score=0.30, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 56/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 61/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 61/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 61/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 61/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 61/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 61/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 61/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 61/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 61/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 61/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 66/98, score=0.00, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 66/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 66/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 66/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 66/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 66/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 66/98, score=0.50, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 71/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 66/98, score=0.60, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 66/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [retry] HTTP 502, waiting 2.0s (attempt 1/5)
  [retry] HTTP 524, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 66/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 71/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 71/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 71/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 71/98, score=0.50, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 71/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 71/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 71/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 76/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 71/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 71/98, score=0.20, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 4.0s (attempt 2/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 76/98, score=0.50, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 76/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 76/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 76/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 76/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 76/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 76/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 76/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 81/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 81/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 76/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 81/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 81/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 81/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 81/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 81/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 81/98, score=0.30, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 86/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 81/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 81/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 86/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 86/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 86/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 86/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 86/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400] block 86/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 86/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 86/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 91/98, score=0.00, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 91/98, score=0.30, reward=0.000, store=200
  [1/10] FAILED omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400: API HTTPError 400 (attempt 1/5): {"error":{"message":"You passed 3585 input tokens and requested 512 output tokens. However, the model's context length is only 4096 tokens, resulting in a maximum input length of 3584 tokens. Please reduce the length of the input prompt. (parameter=input_tokens, value=3585)","type":"BadRequestError","param":"input_tokens","code":400}}
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 91/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 86/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 91/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 91/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 91/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 91/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 96/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 91/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400] block 98/98, score=0.33, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400
  [2/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed2__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 96/98, score=0.30, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 91/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 96/98, score=0.10, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 96/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400] block 98/98, score=0.33, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400
  [3/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed1__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400] block 98/98, score=0.56, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400
  [4/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed8__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 96/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 96/98, score=0.20, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 96/98, score=0.40, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 96/98, score=0.10, reward=0.000, store=200
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400] block 98/98, score=0.33, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400
  [5/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed4__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400] block 98/98, score=0.56, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400
  [6/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed0__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400] block 98/98, score=0.00, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400
  [7/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed5__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400] block 98/98, score=0.22, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400
  [8/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed6__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400] block 98/98, score=0.44, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400
  [9/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed9__b400
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 96/98, score=0.30, reward=0.000, store=200
  [retry] HTTP 404, waiting 2.0s (attempt 1/5)
  [omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400] block 98/98, score=0.00, reward=0.000, store=200
[done] omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400
  [10/10] done omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed3__b400

=== Done: 9 succeeded, 1 failed in 10417.1s ===

Failed runs:
  omac_4b_placebo__OMAC__PLACEBO_RETRIEVAL__seed7__b400: API HTTPError 400 (attempt 1/5): {"error":{"message":"You passed 3585 input tokens and requested 512 output tokens. However, the model's context length is only 4096 tokens, resulting in a maximum input length of 3584 tokens. Please reduce the length of the input prompt. (parameter=input_tokens, value=3585)","type":"BadRequestError","param":"input_tokens","code":400}}

Running factorial analysis...
  recovery_curves: /teamspace/studios/this_studio/implemented/memkit/artifacts/metrics/omac_4b_placebo__recovery_curves.csv
  aurc: /teamspace/studios/this_studio/implemented/memkit/artifacts/metrics/omac_4b_placebo__aurc.csv
  aurc_cis: /teamspace/studios/this_studio/implemented/memkit/artifacts/metrics/omac_4b_placebo__aurc_cis.csv
  factorial_summary: /teamspace/studios/this_studio/implemented/memkit/artifacts/metrics/omac_4b_placebo__factorial_summary.json
Analysis complete.