| [2026-06-19 23:18:10,358][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/meta-llama/Llama-2-7b-hf/resolve/main/config.json "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:10,565][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/meta-llama/Llama-2-7b-hf/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:10,776][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/models/meta-llama/Llama-2-7b-hf/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:10,984][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/models/meta-llama/Llama-2-7b-hf/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:11,051][model][INFO] - Setting pad_token as eos token: </s> |
| [2026-06-19 23:18:11,052][evaluator][INFO] - Evaluations stored in the experiment directory: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr1e-5/evals |
| [2026-06-19 23:18:11,053][evaluator][INFO] - ***** Running MUSE evaluation suite ***** |
| [2026-06-19 23:18:11,053][evaluator][INFO] - Fine-grained evaluations will be saved to: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr1e-5/evals/MUSE_EVAL.json |
| [2026-06-19 23:18:11,053][evaluator][INFO] - Aggregated evaluations will be summarised in: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr1e-5/evals/MUSE_SUMMARY.json |
| [2026-06-19 23:18:11,253][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/main/README.md "HTTP/1.1 307 Temporary Redirect" |
| [2026-06-19 23:18:11,259][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/api/resolve-cache/datasets/muse-bench/MUSE-News/506bd5b150b92814d45e4404a82f120ab2d748bf/README.md "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:11,470][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/MUSE-News.py "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:12,093][httpx][INFO] - HTTP Request: HEAD https://s3.amazonaws.com/datasets.huggingface.co/datasets/datasets/muse-bench/MUSE-News/muse-bench/MUSE-News.py "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:12,306][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/revision/506bd5b150b92814d45e4404a82f120ab2d748bf "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:12,513][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/.huggingface.yaml "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:12,772][httpx][INFO] - HTTP Request: GET https://datasets-server.huggingface.co/info?dataset=muse-bench/MUSE-News "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:12,982][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/tree/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem?recursive=true&expand=false "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:13,179][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/tree/506bd5b150b92814d45e4404a82f120ab2d748bf?recursive=false&expand=false "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:13,385][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/dataset_infos.json "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:13,617][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/main/README.md "HTTP/1.1 307 Temporary Redirect" |
| [2026-06-19 23:18:13,623][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/api/resolve-cache/datasets/muse-bench/MUSE-News/506bd5b150b92814d45e4404a82f120ab2d748bf/README.md "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:13,820][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/MUSE-News.py "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:14,030][httpx][INFO] - HTTP Request: HEAD https://s3.amazonaws.com/datasets.huggingface.co/datasets/datasets/muse-bench/MUSE-News/muse-bench/MUSE-News.py "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:14,245][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/.huggingface.yaml "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:14,460][httpx][INFO] - HTTP Request: GET https://datasets-server.huggingface.co/info?dataset=muse-bench/MUSE-News "HTTP/1.1 200 OK" |
| [2026-06-19 23:18:14,670][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/dataset_infos.json "HTTP/1.1 404 Not Found" |
| [2026-06-19 23:18:14,681][metrics][INFO] - Evaluating forget_knowmem_ROUGE |
|
|
