| [2026-01-01 00:04:33,038][model][INFO] - Setting pad_token as eos token: <|eot_id|> | |
| [2026-01-01 00:04:33,040][evaluator][INFO] - Evaluations stored in the experiment directory: ./saves/eval/NPO_verb_fix | |
| [2026-01-01 00:04:33,042][evaluator][INFO] - ***** Running TOFU evaluation suite ***** | |
| [2026-01-01 00:04:33,042][evaluator][INFO] - Fine-grained evaluations will be saved to: ./saves/eval/NPO_verb_fix/TOFU_EVAL.json | |
| [2026-01-01 00:04:33,042][evaluator][INFO] - Aggregated evaluations will be summarised in: ./saves/eval/NPO_verb_fix/TOFU_temperature1.01.0SUMMARY.json | |
| [2026-01-01 00:04:33,797][metrics][INFO] - Evaluating forget_Q_A_ROUGE | |
| [2026-01-01 00:53:49,931][metrics][INFO] - Evaluating retain_Q_A_ROUGE | |