Buckets:

alphasyncllc/EdgeBench-bucket / flt_regular_formalization.json
toddalanrose's picture
download
raw
1.81 kB
{
"task_id": "flt_regular_formalization",
"name": "Flt Regular Formalization",
"category": "Formal Math & Theorem Proving",
"base_image": "lean_4_28_0_main",
"platform": "linux/amd64",
"internet": false,
"cwd": "/home/workspace/",
"submit_paths": [
"se-bmk-intern/FltRegular"
],
"submit_exclude": [
"se-bmk-intern/FltRegular/.lake"
],
"work": {
"image_tag": "9800b0787b20",
"specs_dir": null,
"agent_query": "You are a lean4 expert, now your task is to finish **all** sorries in this folder. Pay no attention to anything outside this folder. There are many sorries but do not be afraid as we value minor progress and the time is abundant. Try to do some easy problems and accumulate scores each round. Before you submit, run a `lake build` to verify the changes locally - if the build failed, no score will be given. Do not modify the signature of existing lemma/theorem/def as these changes will not pass the judge evaluation. Also, since we evaluate the score via checking axioms transitivly, finishing `fermatLastTheoremSeven` without completeing `isRegularPrime_seven` and `flt_regular` will not count."
},
"judge": {
"image_tag": "838e4d32e0bb",
"eval_cmd": "cd /home/workspace/se-bmk-intern/FltRegular && cp -r /home/workspace/baseline/.lake . && cp /home/workspace/baseline/lake-manifest.json . && lake build && cp /home/workspace/judge/se-bmk-intern/FltRegular/ListDeclAxiom.lean . && cd /home/workspace/judge/se-bmk-intern && python3 eval_lean.py --current-repo /home/workspace/se-bmk-intern/FltRegular --mode weighted --weights /home/workspace/judge/se-bmk-intern/task/FltRegular_weight.json",
"eval_timeout": 2400,
"parser": "structured_json",
"rescale": {
"kind": "linear",
"lower": 0.0,
"upper": 1.0
}
}
}

Xet Storage Details

Size:
1.81 kB
·
Xet hash:
5879e7dee9722a09e95ca6ab64b6aa3cad07ad37512e0254ab6505664f45fcfb

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.