| Model ID,Compilation Success (%),Partial Replication (%),Correct Coefficient Direction (%),Significant Level Correctness (%) | |
| GPT 5.5 - Python,36.7,12.1,30.7,22.2 | |
| GPT 5.5 - Stata,35.9,6.5,21.0,11 | |
| GPT 5.5 - MetaGPT,55.0,11.4,48.5,32.5 | |
| GPT 5.5 - MetricsAI,52.1,14.2,46.5,33.6 | |
| GPT 5.5 - Codex,99.5,26.4,86.5,62 | |
| DeepSeek v4 Pro - MetaGPT,67.4,14.4,57.8 | |
| GPT 4o - MetaGPT,67.4,22,57.8 | |
| GPT 4o - Python,7,3.4,5.9 | |
| GPT 4o - Stata,1.1,0.1,1 |