programbench/20260730_mini-v2.2.8_gpt-5-6-sol
Viewer • Updated • 1 • 6
ProgramBench
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
ProgramBench: Can Language Models Rebuild Programs From Scratch?
Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior. ProgramBench evaluates this capability across 200 real-world open-source projects spanning Rust, Go, C, C++, Haskell, and Java.
Links
models 0
None public yet
datasets 21
programbench/20260802_mini-v2.4.2_gpt-5-6-sol-xhigh
Viewer • Updated • 1 • 7
programbench/20260731_mini-v2.4.2_opus-5-xhigh
Viewer • Updated • 1 • 10
programbench/20260731_mini-v2.4.2_gemini-3-6-flash
Viewer • Updated • 1 • 5
programbench/20260729_mini-v2.2.8_gemini-3-5-flash
Viewer • Updated • 1 • 9
programbench/20260507_mini-v2.2.6_opus-4-7-xhigh
Viewer • Updated • 1 • 78
programbench/20260717_mini-v2.4.5_opus-4.8-xhigh
Viewer • Updated • 1 • 152
programbench/20260717_mini-v2.4.5_glm-5.2
Viewer • Updated • 1 • 482
programbench/20260508_mini-v2.2.6_gpt-5-5-xhigh
Viewer • Updated • 1 • 225
programbench/20260507_mini-v2.2.6_gpt-5-5
Viewer • Updated • 1 • 126