Buckets:

alphasyncllc/EdgeBench-bucket / sphere_eversion_formalization.json
toddalanrose's picture
download
raw
1.65 kB
{
"task_id": "sphere_eversion_formalization",
"name": "Sphere Eversion Formalization",
"category": "Formal Math & Theorem Proving",
"base_image": "lean_4_28_0_main",
"platform": "linux/amd64",
"internet": false,
"cwd": "/home/workspace/",
"submit_paths": [
"se-bmk-intern/sphere-eversion"
],
"submit_exclude": [
"se-bmk-intern/sphere-eversion/.lake"
],
"work": {
"image_tag": "96f62982feaa",
"specs_dir": null,
"agent_query": "You are a lean4 expert, now your task is to finish **all** sorries in this folder. Pay no attention to anything outside this folder. There are many sorries but do not be afraid as we value minor progress and the time is abundant. Try to do some easy problems and accumulate scores each round. Before you submit, run a `lake build` to verify the changes locally - if the build failed, no score will be given. Also, do not modify the signature of existing lemma/theorem/def as these changes will not pass the judge evaluation."
},
"judge": {
"image_tag": "580e3aa210fa",
"eval_cmd": "cd /home/workspace/se-bmk-intern/sphere-eversion && cp -r /home/workspace/baseline/.lake . && cp /home/workspace/baseline/lake-manifest.json . && lake build && cp /home/workspace/judge/se-bmk-intern/sphere-eversion/ListDeclAxiom.lean . && cd /home/workspace/judge/se-bmk-intern && python3 eval_lean.py --baseline-repo /home/workspace/judge/se-bmk-intern/sphere-eversion --current-repo /home/workspace/se-bmk-intern/sphere-eversion",
"eval_timeout": 2400,
"parser": "structured_json",
"rescale": {
"kind": "linear",
"lower": 0.0,
"upper": 1.0
}
}
}

Xet Storage Details

Size:
1.65 kB
·
Xet hash:
bbafd23891a33b46d827126b8000f652d2674bf22033cbe3142e3a8a66eea4f1

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.