Model ID,Compilation Success (%),Partial Replication (%),Correct Coefficient Direction (%),Significant Level Correctness (%)
GPT 5.5 - Python,36.7,12.1,30.7,22.2
GPT 5.5 - Stata,35.9,6.5,21.0,11
GPT 5.5 - MetaGPT,55.0,11.4,48.5,32.5
GPT 5.5 - MetricsAI,52.1,14.2,46.5,33.6
GPT 5.5 - Codex,99.5,26.4,86.5,62
DeepSeek v4 Pro - MetaGPT,67.4,14.4,57.8
GPT 4o - MetaGPT,67.4,22,57.8
GPT 4o - Python,7,3.4,5.9
GPT 4o - Stata,1.1,0.1,1