Hugging Face's logo

Jeesup
/
muse_Llama-2-7b-hf_News_GradDiff_lr5e-5

TensorBoard
Safetensors
llama
Model card Files
xet
 Metrics Community
muse_Llama-2-7b-hf_News_GradDiff_lr5e-5 / eval.log
Jeesup's picture
Jeesup
muse hpsearch: muse_Llama-2-7b-hf_News_GradDiff_lr5e-5
3d62b41 verified
Raw
History Blame Contribute Delete
11 kB
[2026-06-19 20:21:04,499][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/meta-llama/Llama-2-7b-hf/resolve/main/config.json "HTTP/1.1 200 OK"
[2026-06-19 20:21:04,707][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/meta-llama/Llama-2-7b-hf/resolve/main/tokenizer_config.json "HTTP/1.1 200 OK"
[2026-06-19 20:21:04,920][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/models/meta-llama/Llama-2-7b-hf/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:05,134][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/models/meta-llama/Llama-2-7b-hf/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
[2026-06-19 20:21:05,204][model][INFO] - Setting pad_token as eos token: </s>
[2026-06-19 20:21:05,205][evaluator][INFO] - Evaluations stored in the experiment directory: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr5e-5/evals
[2026-06-19 20:21:05,207][evaluator][INFO] - ***** Running MUSE evaluation suite *****
[2026-06-19 20:21:05,207][evaluator][INFO] - Fine-grained evaluations will be saved to: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr5e-5/evals/MUSE_EVAL.json
[2026-06-19 20:21:05,207][evaluator][INFO] - Aggregated evaluations will be summarised in: saves/unlearn/muse_Llama-2-7b-hf_News_GradDiff_lr5e-5/evals/MUSE_SUMMARY.json
[2026-06-19 20:21:05,414][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/main/README.md "HTTP/1.1 307 Temporary Redirect"
[2026-06-19 20:21:05,418][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/api/resolve-cache/datasets/muse-bench/MUSE-News/506bd5b150b92814d45e4404a82f120ab2d748bf/README.md "HTTP/1.1 200 OK"
[2026-06-19 20:21:05,638][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/MUSE-News.py "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:06,277][httpx][INFO] - HTTP Request: HEAD https://s3.amazonaws.com/datasets.huggingface.co/datasets/datasets/muse-bench/MUSE-News/muse-bench/MUSE-News.py "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:06,488][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/revision/506bd5b150b92814d45e4404a82f120ab2d748bf "HTTP/1.1 200 OK"
[2026-06-19 20:21:06,691][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/.huggingface.yaml "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:07,051][httpx][INFO] - HTTP Request: GET https://datasets-server.huggingface.co/info?dataset=muse-bench/MUSE-News "HTTP/1.1 200 OK"
[2026-06-19 20:21:07,263][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/tree/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem?recursive=true&expand=false "HTTP/1.1 200 OK"
[2026-06-19 20:21:07,467][httpx][INFO] - HTTP Request: GET https://huggingface.co/api/datasets/muse-bench/MUSE-News/tree/506bd5b150b92814d45e4404a82f120ab2d748bf?recursive=false&expand=false "HTTP/1.1 200 OK"
[2026-06-19 20:21:07,667][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/dataset_infos.json "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:07,892][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/retain_qa_icl-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:08,114][httpx][INFO] - HTTP Request: GET https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/retain_qa_icl-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:08,320][httpx][INFO] - HTTP Request: GET https://cas-bridge.xethub.hf.co/xet-bridge-us/666a472428d005ac1c5990fb/a4045a33150d31c75fe14e8164d5606bddf1c73d050cd4eba31f6a341c758ae7?Expires=1781871668&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jYXMtYnJpZGdlLnhldGh1Yi5oZi5jby94ZXQtYnJpZGdlLXVzLzY2NmE0NzI0MjhkMDA1YWMxYzU5OTBmYi9hNDA0NWEzMzE1MGQzMWM3NWZlMTRlODE2NGQ1NjA2YmRkZjFjNzNkMDUwY2Q0ZWJhMzFmNmEzNDFjNzU4YWU3KiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTc4MTg3MTY2OH19fV19&Signature=MEYCIQCVFMIqzdJDuP8lYFdS1dZrw%7EuaPRzRtrzaJXXbit46WAIhAL9EnS7SZnEvOy8DWb8VN8MKpnPploGdJeecGasezrXT&Key-Pair-Id=K1LYXO563TGWFU&X-Xet-Cas-Uid=66b0c434a210bfb3f8bba264&response-content-disposition=inline%3B+filename*%3DUTF-8%27%27retain_qa_icl-00000-of-00001.parquet%3B+filename%3D%22retain_qa_icl-00000-of-00001.parquet%22%3B&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=cas%2F20260619%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260619T112108Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=9df170555f0dfdfcd6ab9216f44928a587afb2fea94da0de7b31ab4b68f0eaed "HTTP/1.1 200 OK"
[2026-06-19 20:21:08,565][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/retain_qa-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:08,771][httpx][INFO] - HTTP Request: GET https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/retain_qa-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:08,960][httpx][INFO] - HTTP Request: GET https://cas-bridge.xethub.hf.co/xet-bridge-us/666a472428d005ac1c5990fb/8fb6bb79580fa715a7cb2d8edce5ccd8a039e070528040a1c0980ffb800abe52?Expires=1781871668&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jYXMtYnJpZGdlLnhldGh1Yi5oZi5jby94ZXQtYnJpZGdlLXVzLzY2NmE0NzI0MjhkMDA1YWMxYzU5OTBmYi84ZmI2YmI3OTU4MGZhNzE1YTdjYjJkOGVkY2U1Y2NkOGEwMzllMDcwNTI4MDQwYTFjMDk4MGZmYjgwMGFiZTUyKiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTc4MTg3MTY2OH19fV19&Signature=MEYCIQC6FXwxE%7EcEc9OmqahYpS%7EUw8Slp5KK4itnDcXeFYxzFAIhAPypL54SggQEUW32J4L1SMbwN7M4plfTdbj1uYkrUT4S&Key-Pair-Id=K1LYXO563TGWFU&response-content-disposition=inline%3B+filename*%3DUTF-8%27%27retain_qa-00000-of-00001.parquet%3B+filename%3D%22retain_qa-00000-of-00001.parquet%22%3B&X-Xet-Cas-Uid=66b0c434a210bfb3f8bba264&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=cas%2F20260619%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260619T112108Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=b9d2b89f7c3191920e04fc472df2690b513226b377040f4ddd6d09fd65ee5cc0 "HTTP/1.1 200 OK"
[2026-06-19 20:21:09,167][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/forget_qa-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:09,388][httpx][INFO] - HTTP Request: GET https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/forget_qa-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:09,589][httpx][INFO] - HTTP Request: GET https://cas-bridge.xethub.hf.co/xet-bridge-us/666a472428d005ac1c5990fb/d3a4d2b6a43316a3e0ca25114c65ed2cf49a9c8804de10f5d4feebe7250baa4d?Expires=1781871669&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jYXMtYnJpZGdlLnhldGh1Yi5oZi5jby94ZXQtYnJpZGdlLXVzLzY2NmE0NzI0MjhkMDA1YWMxYzU5OTBmYi9kM2E0ZDJiNmE0MzMxNmEzZTBjYTI1MTE0YzY1ZWQyY2Y0OWE5Yzg4MDRkZTEwZjVkNGZlZWJlNzI1MGJhYTRkKiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTc4MTg3MTY2OX19fV19&Signature=MEQCIEONcB-7gGKNwZTVh-OV4QdUl4qDk9jmLP1z%7EDstBWOBAiBJ3Qq87RGqeIeTDHoPljbYoCXvyx33hSxmInkBFmmzFw__&Key-Pair-Id=K1LYXO563TGWFU&response-content-disposition=inline%3B+filename*%3DUTF-8%27%27forget_qa-00000-of-00001.parquet%3B+filename%3D%22forget_qa-00000-of-00001.parquet%22%3B&X-Xet-Cas-Uid=66b0c434a210bfb3f8bba264&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=cas%2F20260619%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260619T112109Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=cc60d85ecb2f2cfffe018399b773407c67fe3c48e8062167673fa45f13330f47 "HTTP/1.1 200 OK"
[2026-06-19 20:21:09,793][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/forget_qa_icl-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:10,011][httpx][INFO] - HTTP Request: GET https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/knowmem/forget_qa_icl-00000-of-00001.parquet "HTTP/1.1 302 Found"
[2026-06-19 20:21:10,207][httpx][INFO] - HTTP Request: GET https://cas-bridge.xethub.hf.co/xet-bridge-us/666a472428d005ac1c5990fb/781d81dc7417e5a7892182fb859eefb6a7e989b438d7086e6999e28a8d55da1f?Expires=1781871669&Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9jYXMtYnJpZGdlLnhldGh1Yi5oZi5jby94ZXQtYnJpZGdlLXVzLzY2NmE0NzI0MjhkMDA1YWMxYzU5OTBmYi83ODFkODFkYzc0MTdlNWE3ODkyMTgyZmI4NTllZWZiNmE3ZTk4OWI0MzhkNzA4NmU2OTk5ZTI4YThkNTVkYTFmKiIsIkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTc4MTg3MTY2OX19fV19&Signature=MEUCIQDvmpJ3a2GFjwi-iEEFD7HxN48rDOgGFmKA0b%7EwhBQrogIgHQMp3JR0PKAl69r-8%7EQ9KS6lvGPcHROzWAzRRGwHCOE_&Key-Pair-Id=K1LYXO563TGWFU&X-Xet-Cas-Uid=66b0c434a210bfb3f8bba264&response-content-disposition=inline%3B+filename*%3DUTF-8%27%27forget_qa_icl-00000-of-00001.parquet%3B+filename%3D%22forget_qa_icl-00000-of-00001.parquet%22%3B&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=cas%2F20260619%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260619T112109Z&X-Amz-Expires=3600&X-Amz-SignedHeaders=host&X-Amz-Signature=cc9ccec8f8a4b50c9f6e2bb8ed9768e90ca721f2c4a973ea1153c33ccdbf83f4 "HTTP/1.1 200 OK"
[2026-06-19 20:21:10,439][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/main/README.md "HTTP/1.1 307 Temporary Redirect"
[2026-06-19 20:21:10,445][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/api/resolve-cache/datasets/muse-bench/MUSE-News/506bd5b150b92814d45e4404a82f120ab2d748bf/README.md "HTTP/1.1 200 OK"
[2026-06-19 20:21:10,648][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/MUSE-News.py "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:10,859][httpx][INFO] - HTTP Request: HEAD https://s3.amazonaws.com/datasets.huggingface.co/datasets/datasets/muse-bench/MUSE-News/muse-bench/MUSE-News.py "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:11,062][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/.huggingface.yaml "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:11,276][httpx][INFO] - HTTP Request: GET https://datasets-server.huggingface.co/info?dataset=muse-bench/MUSE-News "HTTP/1.1 200 OK"
[2026-06-19 20:21:11,488][httpx][INFO] - HTTP Request: HEAD https://huggingface.co/datasets/muse-bench/MUSE-News/resolve/506bd5b150b92814d45e4404a82f120ab2d748bf/dataset_infos.json "HTTP/1.1 404 Not Found"
[2026-06-19 20:21:11,500][metrics][INFO] - Evaluating forget_knowmem_ROUGE