TestSuiteBench eth-sri/tsb-mutants Updated Oct 12 • 4.12k eth-sri/tsb-reference_tests Updated Oct 12 • 806 eth-sri/tsb-reference_impl Updated Oct 12 • 1.31k
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 135 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 52 zai-org/humaneval-x Updated Oct 25, 2022 • 4.24k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 28 • 1
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 49 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 76
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 87 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 145 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 151 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 103 • 2
TestSuiteBench eth-sri/tsb-mutants Updated Oct 12 • 4.12k eth-sri/tsb-reference_tests Updated Oct 12 • 806 eth-sri/tsb-reference_impl Updated Oct 12 • 1.31k
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 49 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 76
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 4
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 135 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 52 zai-org/humaneval-x Updated Oct 25, 2022 • 4.24k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 28 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 87 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 145 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 151 eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 103 • 2
